2024-06-02T22:42:05.587 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-02T22:42:05.588 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/pool-perm} --verbose --name teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633/orig.config.yaml 2024-06-02T22:42:05.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T22:42:05.741 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/pool-perm} email: ceph-qa@ceph.com first_in_suite: false job_id: '7738633' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2064 sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba sleep_before_teardown: 0 subset: 125/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOlrI80bnOoSQf3KLEZwqpn+jA6rva0qRnoy7zwGDf2DTQ+Q4gs3/IBHosW/E2hsYvfouTbCuG7uwS+YuhLiGes= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIAzKrqGDfgjxek+pRDbVFUV24TcLUUIPb05l40XqIT8naO78P9rpkuSEH5L3N3lc94zfvcKVkKrOiFTE6d8yAU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-02_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-02T22:42:05.741 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa; will attempt to use it 2024-06-02T22:42:05.742 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks 2024-06-02T22:42:05.742 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-02T22:42:05.743 INFO:teuthology.task.internal:Checking packages... 2024-06-02T22:42:05.768 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d89accfe3201286f000e065a1faea2a88c7a6ba' 2024-06-02T22:42:05.768 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T22:42:05.769 INFO:teuthology.packaging:ref: None 2024-06-02T22:42:05.769 INFO:teuthology.packaging:tag: None 2024-06-02T22:42:05.769 INFO:teuthology.packaging:branch: squid 2024-06-02T22:42:05.769 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:42:05.769 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-02T22:42:06.086 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2952.gdfcc4b3c 2024-06-02T22:42:06.088 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-02T22:42:06.097 INFO:teuthology.task.internal:no buildpackages task found 2024-06-02T22:42:06.098 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-02T22:42:06.123 INFO:teuthology.task.internal:Saving configuration 2024-06-02T22:42:06.139 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-02T22:42:06.146 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-02T22:42:06.171 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 22:37:08.156999', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOlrI80bnOoSQf3KLEZwqpn+jA6rva0qRnoy7zwGDf2DTQ+Q4gs3/IBHosW/E2hsYvfouTbCuG7uwS+YuhLiGes='} 2024-06-02T22:42:06.197 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 22:37:08.155962', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIAzKrqGDfgjxek+pRDbVFUV24TcLUUIPb05l40XqIT8naO78P9rpkuSEH5L3N3lc94zfvcKVkKrOiFTE6d8yAU='} 2024-06-02T22:42:06.197 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-02T22:42:06.203 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-06-02T22:42:06.204 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-06-02T22:42:06.204 INFO:teuthology.run_tasks:Running task console_log... 2024-06-02T22:42:06.263 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6d2f0c7be0>, signals=[15]) 2024-06-02T22:42:06.263 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-02T22:42:06.269 INFO:teuthology.task.internal:Opening connections... 2024-06-02T22:42:06.269 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:42:06.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:42:06.344 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:42:06.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:42:06.416 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-02T22:42:06.423 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-06-02T22:42:06.440 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-06-02T22:42:06.440 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-06-02T22:42:06.497 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-06-02T22:42:06.497 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-06-02T22:42:06.497 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-06-02T22:42:06.497 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-06-02T22:42:06.497 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-06-02T22:42:06.497 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-06-02T22:42:06.498 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T22:42:06.498 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-06-02T22:42:06.498 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-06-02T22:42:06.498 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T22:42:06.498 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-06-02T22:42:06.498 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T22:42:06.498 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T22:42:06.498 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T22:42:06.499 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-06-02T22:42:06.519 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-06-02T22:42:06.536 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-06-02T22:42:06.536 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-06-02T22:42:06.593 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-06-02T22:42:06.593 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-06-02T22:42:06.593 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-06-02T22:42:06.593 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-06-02T22:42:06.593 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-06-02T22:42:06.593 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-06-02T22:42:06.593 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T22:42:06.593 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-06-02T22:42:06.593 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-06-02T22:42:06.593 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T22:42:06.593 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-06-02T22:42:06.594 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T22:42:06.594 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T22:42:06.594 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T22:42:06.594 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-06-02T22:42:06.619 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-02T22:42:06.628 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-02T22:42:06.633 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-02T22:42:06.633 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-06-02T22:42:06.635 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-06-02T22:42:06.651 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-02T22:42:06.657 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-02T22:42:06.657 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-06-02T22:42:06.693 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-06-02T22:42:06.791 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-02T22:42:06.847 INFO:teuthology.run_tasks:Running task kernel... 2024-06-02T22:42:06.861 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-06-02T22:42:06.861 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-06-02T22:42:06.862 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T22:42:06.862 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T22:42:06.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:42:06.879 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-06-02T22:42:06.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:42:06.880 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-06-02T22:42:06.935 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-437.el9.x86_64 2024-06-02T22:42:06.936 INFO:teuthology.task.kernel:Running kernel on smithi082: 5.14.0-437.el9.x86_64 2024-06-02T22:42:06.936 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2024-06-02T22:42:06.937 INFO:teuthology.orchestra.run.smithi184.stdout:5.14.0-437.el9.x86_64 2024-06-02T22:42:06.937 INFO:teuthology.task.kernel:Running kernel on smithi184: 5.14.0-437.el9.x86_64 2024-06-02T22:42:06.937 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum install -y kernel 2024-06-02T22:42:09.041 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.1 MB 00:00 2024-06-02T22:42:09.458 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.1 MB 00:00 2024-06-02T22:42:10.767 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 31 MB/s | 19 MB 00:00 2024-06-02T22:42:11.950 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-06-02T22:42:14.834 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-06-02T22:42:16.167 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-06-02T22:42:16.426 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 17 kB 00:00 2024-06-02T22:42:17.701 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 17 kB 00:00 2024-06-02T22:42:17.838 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-06-02T22:42:19.514 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-06-02T22:42:23.035 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-06-02T22:42:24.778 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-06-02T22:42:25.075 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-02T22:42:25.075 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-02T22:42:25.168 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-06-02T22:42:25.181 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-06-02T22:42:25.182 INFO:teuthology.orchestra.run.smithi082.stdout:Install 4 Packages 2024-06-02T22:42:25.182 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:42:25.182 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 80 M 2024-06-02T22:42:25.182 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 124 M 2024-06-02T22:42:25.182 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-06-02T22:42:25.362 INFO:teuthology.orchestra.run.smithi082.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 6.1 MB/s | 893 kB 00:00 2024-06-02T22:42:25.637 INFO:teuthology.orchestra.run.smithi082.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-06-02T22:42:25.987 INFO:teuthology.orchestra.run.smithi082.stdout:(3/4): kernel-modules-core-5.14.0-452.el9.x86_6 46 MB/s | 29 MB 00:00 2024-06-02T22:42:26.304 INFO:teuthology.orchestra.run.smithi082.stdout:(4/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 32 MB/s | 35 MB 00:01 2024-06-02T22:42:26.304 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-06-02T22:42:26.304 INFO:teuthology.orchestra.run.smithi082.stdout:Total 71 MB/s | 80 MB 00:01 2024-06-02T22:42:26.809 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-02T22:42:26.809 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-02T22:42:26.908 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-06-02T22:42:26.916 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-06-02T22:42:26.916 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-06-02T22:42:26.916 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-06-02T22:42:26.916 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-06-02T22:42:26.916 INFO:teuthology.orchestra.run.smithi184.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-02T22:42:26.916 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-06-02T22:42:26.916 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-02T22:42:26.916 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-02T22:42:26.916 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-02T22:42:26.916 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:42:26.916 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-06-02T22:42:26.917 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-06-02T22:42:26.917 INFO:teuthology.orchestra.run.smithi184.stdout:Install 4 Packages 2024-06-02T22:42:26.917 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:42:26.917 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 80 M 2024-06-02T22:42:26.917 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 124 M 2024-06-02T22:42:26.917 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-06-02T22:42:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-06-02T22:42:27.351 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-06-02T22:42:27.351 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-06-02T22:42:27.537 INFO:teuthology.orchestra.run.smithi184.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 2.5 MB/s | 893 kB 00:00 2024-06-02T22:42:27.988 INFO:teuthology.orchestra.run.smithi184.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-06-02T22:42:28.300 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-06-02T22:42:28.301 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-06-02T22:42:28.763 INFO:teuthology.orchestra.run.smithi184.stdout:(3/4): kernel-modules-core-5.14.0-452.el9.x86_6 24 MB/s | 29 MB 00:01 2024-06-02T22:42:29.155 INFO:teuthology.orchestra.run.smithi184.stdout:(4/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 18 MB/s | 35 MB 00:01 2024-06-02T22:42:29.155 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-06-02T22:42:29.155 INFO:teuthology.orchestra.run.smithi184.stdout:Total 36 MB/s | 80 MB 00:02 2024-06-02T22:42:29.846 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-06-02T22:42:30.179 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-06-02T22:42:30.179 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-06-02T22:42:30.738 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-06-02T22:42:31.122 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-06-02T22:42:31.123 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-06-02T22:42:31.452 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-02T22:42:31.537 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:42:33.517 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-06-02T22:42:34.142 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-02T22:42:34.178 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:42:34.222 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:42:34.323 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:42:36.853 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:42:36.994 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:42:39.045 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:42:39.178 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:42:41.756 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:42:41.807 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:42:43.958 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:42:46.575 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:43:13.481 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:43:13.521 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:43:13.908 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:43:13.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-02T22:43:13.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:43:13.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:43:14.717 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:43:14.717 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:43:14.717 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-06-02T22:43:14.717 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-02T22:43:14.717 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-02T22:43:14.717 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-02T22:43:14.717 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-02T22:43:14.717 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:43:14.717 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-06-02T22:43:15.059 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T22:43:15.140 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T22:43:15.141 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T22:43:15.141 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-02T22:43:15.141 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-02T22:43:15.141 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-02T22:43:15.141 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-06-02T22:43:15.141 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2024-06-02T22:43:15.141 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T22:43:15.194 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T22:43:15.194 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T22:43:15.194 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 68.el9 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8264254 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-02T22:43:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-06-02T22:43:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-06-02T22:43:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-02T22:43:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-06-02T22:43:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-06-02T22:43:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:43:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-02T22:43:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-02T22:43:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-02T22:43:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-06-02T22:43:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:43:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-06-02T22:43:15.238 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-02T22:43:15.238 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 5.14.0-452.el9.x86_64 2024-06-02T22:43:15.238 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-02T22:43:15.851 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-06-02T22:43:16.052 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:43:16.100 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:43:16.382 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:43:16.382 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-02T22:43:16.382 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T22:43:16.382 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T22:43:17.207 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T22:43:17.208 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:43:17.208 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-06-02T22:43:17.208 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-02T22:43:17.208 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-02T22:43:17.208 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-02T22:43:17.208 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-02T22:43:17.208 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:43:17.208 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-06-02T22:43:17.262 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-02T22:43:17.296 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-06-02T22:43:17.298 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-06-02T22:43:17.328 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.GO7XnhE9Qx 2024-06-02T22:43:17.328 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GO7XnhE9Qx 2024-06-02T22:43:17.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.GO7XnhE9Qx 2024-06-02T22:43:17.527 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.GO7XnhE9Qx is 6KB 2024-06-02T22:43:17.575 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.GO7XnhE9Qx 2024-06-02T22:43:17.589 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T22:43:17.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-06-02T22:43:17.651 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-02T22:43:17.651 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-02T22:43:17.651 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-02T22:43:17.651 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-02T22:43:17.652 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-02T22:43:17.669 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T22:43:17.669 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T22:43:17.669 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-02T22:43:17.669 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-02T22:43:17.669 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-02T22:43:17.669 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-06-02T22:43:17.669 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2024-06-02T22:43:17.669 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T22:43:17.721 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T22:43:17.721 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T22:43:17.721 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2024-06-02T22:43:17.751 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2024-06-02T22:43:17.751 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2024-06-02T22:43:17.751 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.06 2024-06-02T22:43:17.751 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 68.el9 2024-06-02T22:43:17.751 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2024-06-02T22:43:17.751 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:Group : Unspecified 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 8264254 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : builder@centos.org 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : CentOS 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:43:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-02T22:43:17.753 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-02T22:43:17.753 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-02T22:43:17.753 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2024-06-02T22:43:17.753 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:43:17.753 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2024-06-02T22:43:17.753 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-02T22:43:17.754 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 5.14.0-452.el9.x86_64 2024-06-02T22:43:17.754 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-02T22:43:17.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-06-02T22:43:18.410 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2024-06-02T22:43:19.806 INFO:teuthology.orchestra.run.smithi184.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-02T22:43:19.837 INFO:teuthology.orchestra.run.smithi184.stderr:done 2024-06-02T22:43:19.839 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-06-02T22:43:19.854 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.OZXaGkQ71n 2024-06-02T22:43:19.854 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OZXaGkQ71n 2024-06-02T22:43:19.919 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.OZXaGkQ71n 2024-06-02T22:43:20.058 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.OZXaGkQ71n is 6KB 2024-06-02T22:43:20.078 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.OZXaGkQ71n 2024-06-02T22:43:20.092 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2024-06-02T22:43:20.156 INFO:teuthology.orchestra.run.smithi184.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-02T22:43:20.156 INFO:teuthology.orchestra.run.smithi184.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-02T22:43:20.156 INFO:teuthology.orchestra.run.smithi184.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-02T22:43:20.156 INFO:teuthology.orchestra.run.smithi184.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-02T22:43:20.157 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-02T22:43:20.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2024-06-02T22:43:47.829 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-06-02T22:43:47.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-02T22:43:47.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:43:50.304 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-06-02T22:43:50.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-06-02T22:43:50.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:44:06.303 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-06-02T22:44:08.862 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-06-02T22:44:15.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-02T22:44:15.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:44:17.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-06-02T22:44:17.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:44:18.366 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-06-02T22:44:20.926 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-06-02T22:44:30.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-02T22:44:30.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:44:32.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-06-02T22:44:32.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:44:48.798 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-06-02T22:45:03.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-02T22:45:03.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:45:04.123 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-06-02T22:45:04.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-02T22:45:04.614 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-452.el9.x86_64"... 2024-06-02T22:45:04.614 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-06-02T22:45:04.629 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-452.el9.x86_64 2024-06-02T22:45:04.629 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-02T22:45:04.629 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-02T22:45:04.630 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-02T22:45:04.722 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-06-02T22:45:05.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-06-02T22:45:05.123 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-452.el9.x86_64"... 2024-06-02T22:45:05.124 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-06-02T22:45:05.138 INFO:teuthology.orchestra.run.smithi184.stdout:5.14.0-452.el9.x86_64 2024-06-02T22:45:05.138 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-02T22:45:05.138 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-02T22:45:05.138 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-02T22:45:05.631 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-06-02T22:45:05.631 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-02T22:45:05.759 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2024-06-02T22:45:05.807 DEBUG:teuthology.parallel:result is None 2024-06-02T22:45:06.139 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-06-02T22:45:06.139 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-02T22:45:06.239 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2024-06-02T22:45:06.287 DEBUG:teuthology.parallel:result is None 2024-06-02T22:45:06.287 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-02T22:45:06.294 INFO:teuthology.task.internal:Creating test directory... 2024-06-02T22:45:06.294 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T22:45:06.297 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T22:45:06.312 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-02T22:45:06.320 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-02T22:45:06.331 INFO:teuthology.task.internal:Creating archive directory... 2024-06-02T22:45:06.331 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T22:45:06.348 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T22:45:06.384 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-02T22:45:06.391 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-02T22:45:06.391 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T22:45:06.410 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T22:45:06.476 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:45:06.486 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:45:06.589 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:45:06.599 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:45:06.601 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-02T22:45:06.608 INFO:teuthology.task.internal:Configuring sudo... 2024-06-02T22:45:06.608 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T22:45:06.610 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T22:45:06.635 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-02T22:45:06.651 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-02T22:45:06.651 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T22:45:06.676 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T22:45:06.693 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:45:06.774 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:45:06.818 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:45:06.899 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:45:06.940 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:45:06.940 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T22:45:07.005 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:45:07.042 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:45:07.100 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:45:07.182 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:45:07.228 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:45:07.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T22:45:07.309 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-06-02T22:45:07.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-06-02T22:45:07.358 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T22:45:07.399 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T22:45:07.720 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-02T22:45:07.727 INFO:teuthology.task.internal:Starting timer... 2024-06-02T22:45:07.728 INFO:teuthology.run_tasks:Running task pcp... 2024-06-02T22:45:07.738 INFO:teuthology.run_tasks:Running task selinux... 2024-06-02T22:45:07.746 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-06-02T22:45:07.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-06-02T22:45:07.785 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-06-02T22:45:07.787 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2024-06-02T22:45:07.885 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2024-06-02T22:45:07.887 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-02T22:45:07.887 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-06-02T22:45:07.905 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-06-02T22:45:07.906 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2024-06-02T22:45:07.936 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2024-06-02T22:45:07.936 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2024-06-02T22:45:07.936 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T22:45:07.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:45:07.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T22:45:08.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:45:08.031 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-02T22:45:08.031 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-06-02T22:45:08.057 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2024-06-02T22:45:08.372 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-02T22:45:08.382 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-02T22:45:08.385 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-02T22:45:08.534 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-02T22:45:08.544 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-02T22:45:08.545 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-02T22:49:24.806 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2024-06-02T22:49:24.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-02T22:49:24.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:49:24.885 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-06-02T22:49:24.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-02T22:49:24.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-06-02T22:49:24.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:49:25.045 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-06-02T22:49:25.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-06-02T22:49:25.122 INFO:teuthology.run_tasks:Running task clock... 2024-06-02T22:49:25.132 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-02T22:49:25.132 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T22:49:25.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T22:49:25.135 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T22:49:25.135 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T22:49:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T22:49:25.179 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T22:49:25.190 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T22:49:25.204 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-06-02T22:49:25.205 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T22:49:25.215 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-06-02T22:49:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T22:49:25.229 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2024-06-02T22:49:25.240 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2024-06-02T22:49:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T22:49:25.254 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T22:49:25.268 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T22:49:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-06-02T22:49:25.305 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T22:49:25.305 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-06-02T22:49:25.305 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:49:25.305 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:49:25.305 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:49:25.306 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:49:25.329 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-06-02T22:49:25.332 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T22:49:25.332 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-06-02T22:49:25.332 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:49:25.332 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:49:25.332 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:49:25.332 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:49:25.333 INFO:teuthology.run_tasks:Running task install... 2024-06-02T22:49:25.341 DEBUG:teuthology.task.install:project ceph 2024-06-02T22:49:25.341 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}} 2024-06-02T22:49:25.341 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-02T22:49:25.341 INFO:teuthology.task.install:Using flavor: default 2024-06-02T22:49:25.347 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-02T22:49:25.347 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-02T22:49:25.347 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T22:49:25.348 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:49:25.350 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T22:49:25.350 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:49:25.497 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-02T22:49:25.498 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-02T22:49:25.563 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-02T22:49:25.563 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-02T22:49:25.613 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T22:49:25.613 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:49:25.613 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T22:49:25.638 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T22:49:25.638 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T22:49:25.703 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T22:49:25.732 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T22:49:25.732 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:49:25.733 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T22:49:25.759 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T22:49:25.759 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T22:49:25.777 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T22:49:25.824 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T22:49:25.841 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-06-02T22:49:25.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-06-02T22:49:25.899 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T22:49:25.963 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2024-06-02T22:49:25.965 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2024-06-02T22:49:26.068 INFO:teuthology.orchestra.run.smithi082.stdout:45 files removed 2024-06-02T22:49:26.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T22:49:26.194 INFO:teuthology.orchestra.run.smithi184.stdout:45 files removed 2024-06-02T22:49:26.221 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T22:49:26.798 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 194 kB/s | 83 kB 00:00 2024-06-02T22:49:26.946 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 185 kB/s | 83 kB 00:00 2024-06-02T22:49:27.232 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-06-02T22:49:27.330 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-06-02T22:49:27.632 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2024-06-02T22:49:27.664 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2024-06-02T22:49:28.340 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-06-02T22:49:30.289 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.1 MB 00:02 2024-06-02T22:49:30.308 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-06-02T22:49:32.131 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-06-02T22:49:34.267 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.2 MB 00:00 2024-06-02T22:49:35.667 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 17 kB 00:00 2024-06-02T22:49:36.474 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.2 MB 00:00 2024-06-02T22:49:36.978 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-06-02T22:49:37.875 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 17 kB 00:00 2024-06-02T22:49:39.405 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-06-02T22:49:42.277 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-06-02T22:49:44.560 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-06-02T22:49:44.602 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T22:49:44.603 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T22:49:44.614 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T22:49:44.614 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T22:49:44.615 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T22:49:44.616 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T22:49:44.618 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T22:49:44.621 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T22:49:44.622 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T22:49:44.684 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-06-02T22:49:44.701 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-06-02T22:49:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-06-02T22:49:44.701 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-06-02T22:49:44.702 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-06-02T22:49:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T22:49:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-02T22:49:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-02T22:49:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-02T22:49:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-02T22:49:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-02T22:49:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-02T22:49:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-02T22:49:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-02T22:49:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-02T22:49:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-02T22:49:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-02T22:49:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-02T22:49:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-02T22:49:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-02T22:49:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-02T22:49:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-02T22:49:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T22:49:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T22:49:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T22:49:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-02T22:49:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-02T22:49:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-02T22:49:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T22:49:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T22:49:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T22:49:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-06-02T22:49:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T22:49:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T22:49:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-02T22:49:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T22:49:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T22:49:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T22:49:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T22:49:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T22:49:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T22:49:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-06-02T22:49:44.715 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-06-02T22:49:44.716 INFO:teuthology.orchestra.run.smithi082.stdout:Install 148 Packages 2024-06-02T22:49:44.716 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 11 Packages 2024-06-02T22:49:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:49:44.716 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 225 M 2024-06-02T22:49:44.717 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-06-02T22:49:45.261 INFO:teuthology.orchestra.run.smithi082.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-06-02T22:49:45.537 INFO:teuthology.orchestra.run.smithi082.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 3.2 MB/s | 890 kB 00:00 2024-06-02T22:49:45.620 INFO:teuthology.orchestra.run.smithi082.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 1.7 MB/s | 145 kB 00:00 2024-06-02T22:49:45.687 INFO:teuthology.orchestra.run.smithi082.stdout:(4/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 9.0 MB/s | 5.4 MB 00:00 2024-06-02T22:49:45.862 INFO:teuthology.orchestra.run.smithi082.stdout:(5/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 8.5 MB/s | 1.5 MB 00:00 2024-06-02T22:49:45.929 INFO:teuthology.orchestra.run.smithi082.stdout:(6/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 7.6 MB/s | 2.4 MB 00:00 2024-06-02T22:49:46.255 INFO:teuthology.orchestra.run.smithi082.stdout:(7/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 12 MB/s | 4.7 MB 00:00 2024-06-02T22:49:46.944 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T22:49:46.945 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T22:49:46.955 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T22:49:46.956 INFO:teuthology.orchestra.run.smithi184.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T22:49:46.957 INFO:teuthology.orchestra.run.smithi184.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T22:49:46.958 INFO:teuthology.orchestra.run.smithi184.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T22:49:46.959 INFO:teuthology.orchestra.run.smithi184.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T22:49:46.961 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T22:49:46.962 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T22:49:47.024 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-06-02T22:49:47.043 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================= 2024-06-02T22:49:47.043 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================= 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-02T22:49:47.044 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-02T22:49:47.045 INFO:teuthology.orchestra.run.smithi184.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T22:49:47.046 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T22:49:47.046 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T22:49:47.046 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T22:49:47.046 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T22:49:47.046 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T22:49:47.046 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-02T22:49:47.046 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-02T22:49:47.046 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T22:49:47.047 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-02T22:49:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-02T22:49:47.049 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T22:49:47.050 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-02T22:49:47.051 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T22:49:47.052 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T22:49:47.053 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T22:49:47.054 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T22:49:47.055 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout:Installing weak dependencies: 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-06-02T22:49:47.056 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================= 2024-06-02T22:49:47.057 INFO:teuthology.orchestra.run.smithi184.stdout:Install 148 Packages 2024-06-02T22:49:47.057 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 11 Packages 2024-06-02T22:49:47.057 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:49:47.057 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 225 M 2024-06-02T22:49:47.057 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-06-02T22:49:47.221 INFO:teuthology.orchestra.run.smithi082.stdout:(8/159): ceph-radosgw-19.0.0-2946.g3d89accf.el9 11 MB/s | 10 MB 00:00 2024-06-02T22:49:47.271 INFO:teuthology.orchestra.run.smithi082.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 506 kB/s | 25 kB 00:00 2024-06-02T22:49:47.680 INFO:teuthology.orchestra.run.smithi082.stdout:(10/159): ceph-common-19.0.0-2946.g3d89accf.el9 8.1 MB/s | 21 MB 00:02 2024-06-02T22:49:47.755 INFO:teuthology.orchestra.run.smithi082.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.9 MB/s | 221 kB 00:00 2024-06-02T22:49:47.822 INFO:teuthology.orchestra.run.smithi082.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 406 kB/s | 27 kB 00:00 2024-06-02T22:49:47.898 INFO:teuthology.orchestra.run.smithi082.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 423 kB/s | 32 kB 00:00 2024-06-02T22:49:48.102 INFO:teuthology.orchestra.run.smithi184.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-06-02T22:49:48.173 INFO:teuthology.orchestra.run.smithi082.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 2.7 MB/s | 747 kB 00:00 2024-06-02T22:49:48.331 INFO:teuthology.orchestra.run.smithi082.stdout:(15/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 7.0 MB/s | 17 MB 00:02 2024-06-02T22:49:48.357 INFO:teuthology.orchestra.run.smithi082.stdout:(16/159): libcephsqlite-19.0.0-2946.g3d89accf.e 889 kB/s | 163 kB 00:00 2024-06-02T22:49:48.390 INFO:teuthology.orchestra.run.smithi082.stdout:(17/159): librados-devel-19.0.0-2946.g3d89accf. 2.1 MB/s | 127 kB 00:00 2024-06-02T22:49:48.433 INFO:teuthology.orchestra.run.smithi082.stdout:(18/159): libradosstriper1-19.0.0-2946.g3d89acc 6.5 MB/s | 501 kB 00:00 2024-06-02T22:49:48.533 INFO:teuthology.orchestra.run.smithi082.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 452 kB/s | 45 kB 00:00 2024-06-02T22:49:48.987 INFO:teuthology.orchestra.run.smithi184.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 1.0 MB/s | 890 kB 00:00 2024-06-02T22:49:49.191 INFO:teuthology.orchestra.run.smithi082.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 205 kB/s | 135 kB 00:00 2024-06-02T22:49:49.261 INFO:teuthology.orchestra.run.smithi184.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 527 kB/s | 145 kB 00:00 2024-06-02T22:49:49.292 INFO:teuthology.orchestra.run.smithi082.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 1.6 MB/s | 162 kB 00:00 2024-06-02T22:49:49.559 INFO:teuthology.orchestra.run.smithi082.stdout:(22/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 4.6 MB/s | 5.3 MB 00:01 2024-06-02T22:49:49.684 INFO:teuthology.orchestra.run.smithi082.stdout:(23/159): python3-rbd-19.0.0-2946.g3d89accf.el9 2.3 MB/s | 300 kB 00:00 2024-06-02T22:49:49.759 INFO:teuthology.orchestra.run.smithi082.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.3 MB/s | 99 kB 00:00 2024-06-02T22:49:49.834 INFO:teuthology.orchestra.run.smithi082.stdout:(25/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.1 MB/s | 85 kB 00:00 2024-06-02T22:49:49.901 INFO:teuthology.orchestra.run.smithi082.stdout:(26/159): python3-rados-19.0.0-2946.g3d89accf.e 527 kB/s | 321 kB 00:00 2024-06-02T22:49:49.993 INFO:teuthology.orchestra.run.smithi082.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.8 MB/s | 171 kB 00:00 2024-06-02T22:49:50.020 INFO:teuthology.orchestra.run.smithi184.stdout:(4/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 2.4 MB/s | 5.4 MB 00:02 2024-06-02T22:49:50.060 INFO:teuthology.orchestra.run.smithi082.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 476 kB/s | 32 kB 00:00 2024-06-02T22:49:50.152 INFO:teuthology.orchestra.run.smithi082.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.5 MB/s | 142 kB 00:00 2024-06-02T22:49:50.644 INFO:teuthology.orchestra.run.smithi082.stdout:(30/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 3.8 MB/s | 3.1 MB 00:00 2024-06-02T22:49:50.720 INFO:teuthology.orchestra.run.smithi184.stdout:(5/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-06-02T22:49:50.986 INFO:teuthology.orchestra.run.smithi082.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 4.2 MB/s | 3.5 MB 00:00 2024-06-02T22:49:50.995 INFO:teuthology.orchestra.run.smithi184.stdout:(6/159): ceph-common-19.0.0-2946.g3d89accf.el9. 6.6 MB/s | 21 MB 00:03 2024-06-02T22:49:51.271 INFO:teuthology.orchestra.run.smithi184.stdout:(7/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 1.2 MB/s | 2.4 MB 00:02 2024-06-02T22:49:51.403 INFO:teuthology.orchestra.run.smithi082.stdout:(32/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 12 MB/s | 48 MB 00:04 2024-06-02T22:49:51.428 INFO:teuthology.orchestra.run.smithi082.stdout:(33/159): ceph-mgr-modules-core-19.0.0-2946.g3d 563 kB/s | 249 kB 00:00 2024-06-02T22:49:51.462 INFO:teuthology.orchestra.run.smithi082.stdout:(34/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 846 kB/s | 49 kB 00:00 2024-06-02T22:49:51.495 INFO:teuthology.orchestra.run.smithi082.stdout:(35/159): ceph-prometheus-alerts-19.0.0-2946.g3 246 kB/s | 16 kB 00:00 2024-06-02T22:49:51.529 INFO:teuthology.orchestra.run.smithi082.stdout:(36/159): ceph-volume-19.0.0-2946.g3d89accf.el9 3.8 MB/s | 264 kB 00:00 2024-06-02T22:49:51.621 INFO:teuthology.orchestra.run.smithi082.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 199 kB/s | 18 kB 00:00 2024-06-02T22:49:51.755 INFO:teuthology.orchestra.run.smithi082.stdout:(38/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 2.9 MB/s | 763 kB 00:00 2024-06-02T22:49:51.805 INFO:teuthology.orchestra.run.smithi082.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 438 kB/s | 80 kB 00:00 2024-06-02T22:49:51.922 INFO:teuthology.orchestra.run.smithi082.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-06-02T22:49:52.005 INFO:teuthology.orchestra.run.smithi082.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-06-02T22:49:52.047 INFO:teuthology.orchestra.run.smithi082.stdout:(42/159): libgfortran-11.4.1-3.el9.x86_64.rpm 2.7 MB/s | 803 kB 00:00 2024-06-02T22:49:52.063 INFO:teuthology.orchestra.run.smithi184.stdout:(8/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 3.5 MB/s | 4.7 MB 00:01 2024-06-02T22:49:52.131 INFO:teuthology.orchestra.run.smithi082.stdout:(43/159): ceph-mgr-diskprediction-local-19.0.0- 5.0 MB/s | 7.4 MB 00:01 2024-06-02T22:49:52.156 INFO:teuthology.orchestra.run.smithi082.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 980 kB/s | 106 kB 00:00 2024-06-02T22:49:52.190 INFO:teuthology.orchestra.run.smithi082.stdout:(45/159): python3-cryptography-36.0.1-4.el9.x86 6.7 MB/s | 1.2 MB 00:00 2024-06-02T22:49:52.215 INFO:teuthology.orchestra.run.smithi082.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-06-02T22:49:52.241 INFO:teuthology.orchestra.run.smithi082.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-06-02T22:49:52.263 INFO:teuthology.orchestra.run.smithi184.stdout:(9/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x86 13 MB/s | 17 MB 00:01 2024-06-02T22:49:52.288 INFO:teuthology.orchestra.run.smithi184.stdout:(10/159): ceph-selinux-19.0.0-2946.g3d89accf.el 112 kB/s | 25 kB 00:00 2024-06-02T22:49:52.366 INFO:teuthology.orchestra.run.smithi082.stdout:(48/159): python3-pycparser-2.20-6.el9.noarch.r 577 kB/s | 135 kB 00:00 2024-06-02T22:49:52.397 INFO:teuthology.orchestra.run.smithi184.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.0 MB/s | 221 kB 00:00 2024-06-02T22:49:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:(49/159): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-06-02T22:49:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:(50/159): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-06-02T22:49:52.472 INFO:teuthology.orchestra.run.smithi184.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 361 kB/s | 27 kB 00:00 2024-06-02T22:49:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-06-02T22:49:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:(52/159): boost-program-options-1.75.0-8.el9.x8 709 kB/s | 107 kB 00:00 2024-06-02T22:49:52.542 INFO:teuthology.orchestra.run.smithi082.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-06-02T22:49:52.547 INFO:teuthology.orchestra.run.smithi184.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 423 kB/s | 32 kB 00:00 2024-06-02T22:49:52.567 INFO:teuthology.orchestra.run.smithi082.stdout:(54/159): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-06-02T22:49:52.585 INFO:teuthology.orchestra.run.smithi082.stdout:(55/159): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-06-02T22:49:52.610 INFO:teuthology.orchestra.run.smithi082.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-06-02T22:49:52.635 INFO:teuthology.orchestra.run.smithi082.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-06-02T22:49:52.660 INFO:teuthology.orchestra.run.smithi082.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-06-02T22:49:52.703 INFO:teuthology.orchestra.run.smithi082.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-06-02T22:49:52.756 INFO:teuthology.orchestra.run.smithi184.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 3.5 MB/s | 747 kB 00:00 2024-06-02T22:49:52.769 INFO:teuthology.orchestra.run.smithi082.stdout:(60/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-06-02T22:49:52.786 INFO:teuthology.orchestra.run.smithi082.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-06-02T22:49:52.811 INFO:teuthology.orchestra.run.smithi082.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-06-02T22:49:52.831 INFO:teuthology.orchestra.run.smithi184.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 2.1 MB/s | 163 kB 00:00 2024-06-02T22:49:52.845 INFO:teuthology.orchestra.run.smithi082.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-06-02T22:49:52.887 INFO:teuthology.orchestra.run.smithi082.stdout:(64/159): libtool-2.4.6-45.el9.x86_64.rpm 2.5 MB/s | 582 kB 00:00 2024-06-02T22:49:52.904 INFO:teuthology.orchestra.run.smithi082.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 600 kB/s | 35 kB 00:00 2024-06-02T22:49:52.907 INFO:teuthology.orchestra.run.smithi184.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.6 MB/s | 127 kB 00:00 2024-06-02T22:49:52.929 INFO:teuthology.orchestra.run.smithi082.stdout:(66/159): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-06-02T22:49:53.065 INFO:teuthology.orchestra.run.smithi184.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 3.1 MB/s | 501 kB 00:00 2024-06-02T22:49:53.071 INFO:teuthology.orchestra.run.smithi082.stdout:(67/159): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-06-02T22:49:53.121 INFO:teuthology.orchestra.run.smithi082.stdout:(68/159): postgresql-13.14-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-06-02T22:49:53.155 INFO:teuthology.orchestra.run.smithi082.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-06-02T22:49:53.180 INFO:teuthology.orchestra.run.smithi082.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-06-02T22:49:53.264 INFO:teuthology.orchestra.run.smithi082.stdout:(71/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-06-02T22:49:53.307 INFO:teuthology.orchestra.run.smithi082.stdout:(72/159): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-06-02T22:49:53.331 INFO:teuthology.orchestra.run.smithi082.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-06-02T22:49:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:(74/159): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-06-02T22:49:53.465 INFO:teuthology.orchestra.run.smithi082.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-06-02T22:49:53.490 INFO:teuthology.orchestra.run.smithi082.stdout:(76/159): python3-colorama-0.4.6-3.el9.noarch.r 385 kB/s | 61 kB 00:00 2024-06-02T22:49:53.516 INFO:teuthology.orchestra.run.smithi082.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-06-02T22:49:53.541 INFO:teuthology.orchestra.run.smithi082.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 507 kB/s | 26 kB 00:00 2024-06-02T22:49:53.567 INFO:teuthology.orchestra.run.smithi082.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-06-02T22:49:53.592 INFO:teuthology.orchestra.run.smithi082.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-06-02T22:49:53.618 INFO:teuthology.orchestra.run.smithi082.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-06-02T22:49:53.701 INFO:teuthology.orchestra.run.smithi082.stdout:(82/159): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-06-02T22:49:53.726 INFO:teuthology.orchestra.run.smithi082.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-06-02T22:49:53.751 INFO:teuthology.orchestra.run.smithi082.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-06-02T22:49:53.777 INFO:teuthology.orchestra.run.smithi082.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-06-02T22:49:53.819 INFO:teuthology.orchestra.run.smithi082.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 632 kB/s | 42 kB 00:00 2024-06-02T22:49:53.844 INFO:teuthology.orchestra.run.smithi082.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-06-02T22:49:53.869 INFO:teuthology.orchestra.run.smithi082.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-02T22:49:53.894 INFO:teuthology.orchestra.run.smithi082.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-06-02T22:49:53.920 INFO:teuthology.orchestra.run.smithi082.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-02T22:49:53.987 INFO:teuthology.orchestra.run.smithi082.stdout:(91/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-06-02T22:49:54.012 INFO:teuthology.orchestra.run.smithi082.stdout:(92/159): python3-requests-oauthlib-1.3.0-12.el 457 kB/s | 54 kB 00:00 2024-06-02T22:49:54.054 INFO:teuthology.orchestra.run.smithi082.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 624 kB/s | 42 kB 00:00 2024-06-02T22:49:54.079 INFO:teuthology.orchestra.run.smithi082.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 662 kB/s | 44 kB 00:00 2024-06-02T22:49:54.121 INFO:teuthology.orchestra.run.smithi082.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-06-02T22:49:54.138 INFO:teuthology.orchestra.run.smithi082.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 611 kB/s | 36 kB 00:00 2024-06-02T22:49:54.197 INFO:teuthology.orchestra.run.smithi082.stdout:(97/159): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-06-02T22:49:54.214 INFO:teuthology.orchestra.run.smithi082.stdout:(98/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 514 kB/s | 47 kB 00:00 2024-06-02T22:49:54.231 INFO:teuthology.orchestra.run.smithi082.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2024-06-02T22:49:54.256 INFO:teuthology.orchestra.run.smithi082.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.2 MB/s | 94 kB 00:00 2024-06-02T22:49:54.273 INFO:teuthology.orchestra.run.smithi082.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-06-02T22:49:54.282 INFO:teuthology.orchestra.run.smithi184.stdout:(18/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 4.4 MB/s | 5.3 MB 00:01 2024-06-02T22:49:54.298 INFO:teuthology.orchestra.run.smithi082.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-06-02T22:49:54.357 INFO:teuthology.orchestra.run.smithi184.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 604 kB/s | 45 kB 00:00 2024-06-02T22:49:54.441 INFO:teuthology.orchestra.run.smithi184.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 1.6 MB/s | 135 kB 00:00 2024-06-02T22:49:54.474 INFO:teuthology.orchestra.run.smithi082.stdout:(103/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-06-02T22:49:54.499 INFO:teuthology.orchestra.run.smithi082.stdout:(104/159): lua-devel-5.4.4-4.el9.x86_64.rpm 99 kB/s | 22 kB 00:00 2024-06-02T22:49:54.516 INFO:teuthology.orchestra.run.smithi184.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 2.1 MB/s | 162 kB 00:00 2024-06-02T22:49:54.625 INFO:teuthology.orchestra.run.smithi184.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 2.9 MB/s | 321 kB 00:00 2024-06-02T22:49:54.633 INFO:teuthology.orchestra.run.smithi082.stdout:(105/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-06-02T22:49:54.883 INFO:teuthology.orchestra.run.smithi082.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2024-06-02T22:49:54.958 INFO:teuthology.orchestra.run.smithi082.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 673 kB/s | 309 kB 00:00 2024-06-02T22:49:54.983 INFO:teuthology.orchestra.run.smithi082.stdout:(108/159): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-06-02T22:49:55.033 INFO:teuthology.orchestra.run.smithi082.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-06-02T22:49:55.059 INFO:teuthology.orchestra.run.smithi082.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 644 kB/s | 49 kB 00:00 2024-06-02T22:49:55.117 INFO:teuthology.orchestra.run.smithi082.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 806 kB/s | 67 kB 00:00 2024-06-02T22:49:55.134 INFO:teuthology.orchestra.run.smithi184.stdout:(23/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 17 MB/s | 48 MB 00:02 2024-06-02T22:49:55.143 INFO:teuthology.orchestra.run.smithi082.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-06-02T22:49:55.159 INFO:teuthology.orchestra.run.smithi184.stdout:(24/159): python3-rbd-19.0.0-2946.g3d89accf.el9 562 kB/s | 300 kB 00:00 2024-06-02T22:49:55.184 INFO:teuthology.orchestra.run.smithi184.stdout:(25/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.9 MB/s | 99 kB 00:00 2024-06-02T22:49:55.218 INFO:teuthology.orchestra.run.smithi184.stdout:(26/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.4 MB/s | 85 kB 00:00 2024-06-02T22:49:55.260 INFO:teuthology.orchestra.run.smithi082.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-06-02T22:49:55.284 INFO:teuthology.orchestra.run.smithi184.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 2.5 MB/s | 171 kB 00:00 2024-06-02T22:49:55.301 INFO:teuthology.orchestra.run.smithi082.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-06-02T22:49:55.335 INFO:teuthology.orchestra.run.smithi082.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 577 kB/s | 43 kB 00:00 2024-06-02T22:49:55.351 INFO:teuthology.orchestra.run.smithi184.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 476 kB/s | 32 kB 00:00 2024-06-02T22:49:55.394 INFO:teuthology.orchestra.run.smithi082.stdout:(116/159): libarrow-9.0.0-11.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-06-02T22:49:55.419 INFO:teuthology.orchestra.run.smithi082.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-06-02T22:49:55.444 INFO:teuthology.orchestra.run.smithi082.stdout:(118/159): python3-cachetools-4.2.4-1.el9.noarc 226 kB/s | 32 kB 00:00 2024-06-02T22:49:55.468 INFO:teuthology.orchestra.run.smithi184.stdout:(29/159): ceph-radosgw-19.0.0-2946.g3d89accf.el 2.4 MB/s | 10 MB 00:04 2024-06-02T22:49:55.478 INFO:teuthology.orchestra.run.smithi082.stdout:(119/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-06-02T22:49:55.494 INFO:teuthology.orchestra.run.smithi184.stdout:(30/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.0 MB/s | 142 kB 00:00 2024-06-02T22:49:55.503 INFO:teuthology.orchestra.run.smithi082.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-06-02T22:49:55.537 INFO:teuthology.orchestra.run.smithi082.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-06-02T22:49:55.552 INFO:teuthology.orchestra.run.smithi184.stdout:(31/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 8.4 MB/s | 3.1 MB 00:00 2024-06-02T22:49:55.562 INFO:teuthology.orchestra.run.smithi082.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-06-02T22:49:55.603 INFO:teuthology.orchestra.run.smithi184.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 4.9 MB/s | 249 kB 00:00 2024-06-02T22:49:55.621 INFO:teuthology.orchestra.run.smithi082.stdout:(123/159): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-06-02T22:49:55.636 INFO:teuthology.orchestra.run.smithi184.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 1.4 MB/s | 49 kB 00:00 2024-06-02T22:49:55.646 INFO:teuthology.orchestra.run.smithi082.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-06-02T22:49:55.670 INFO:teuthology.orchestra.run.smithi184.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 494 kB/s | 16 kB 00:00 2024-06-02T22:49:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:(125/159): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-06-02T22:49:55.696 INFO:teuthology.orchestra.run.smithi082.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-06-02T22:49:55.720 INFO:teuthology.orchestra.run.smithi184.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 5.2 MB/s | 264 kB 00:00 2024-06-02T22:49:55.722 INFO:teuthology.orchestra.run.smithi082.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-06-02T22:49:55.747 INFO:teuthology.orchestra.run.smithi082.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-06-02T22:49:55.772 INFO:teuthology.orchestra.run.smithi082.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2024-06-02T22:49:55.796 INFO:teuthology.orchestra.run.smithi184.stdout:(36/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 9.9 MB/s | 763 kB 00:00 2024-06-02T22:49:55.823 INFO:teuthology.orchestra.run.smithi082.stdout:(130/159): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-06-02T22:49:55.846 INFO:teuthology.orchestra.run.smithi184.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 367 kB/s | 18 kB 00:00 2024-06-02T22:49:55.848 INFO:teuthology.orchestra.run.smithi082.stdout:(131/159): python3-logutils-0.3.5-21.el9.noarch 460 kB/s | 46 kB 00:00 2024-06-02T22:49:55.865 INFO:teuthology.orchestra.run.smithi082.stdout:(132/159): python3-more-itertools-8.12.0-2.el9. 853 kB/s | 79 kB 00:00 2024-06-02T22:49:55.890 INFO:teuthology.orchestra.run.smithi082.stdout:(133/159): python3-natsort-7.1.1-5.el9.noarch.r 857 kB/s | 58 kB 00:00 2024-06-02T22:49:55.921 INFO:teuthology.orchestra.run.smithi184.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-06-02T22:49:55.932 INFO:teuthology.orchestra.run.smithi082.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-06-02T22:49:55.958 INFO:teuthology.orchestra.run.smithi082.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-06-02T22:49:55.983 INFO:teuthology.orchestra.run.smithi082.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 975 kB/s | 90 kB 00:00 2024-06-02T22:49:56.000 INFO:teuthology.orchestra.run.smithi082.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 421 kB/s | 28 kB 00:00 2024-06-02T22:49:56.013 INFO:teuthology.orchestra.run.smithi184.stdout:(39/159): libgfortran-11.4.1-3.el9.x86_64.rpm 8.6 MB/s | 803 kB 00:00 2024-06-02T22:49:56.025 INFO:teuthology.orchestra.run.smithi082.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-06-02T22:49:56.047 INFO:teuthology.orchestra.run.smithi184.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 5.7 MB/s | 195 kB 00:00 2024-06-02T22:49:56.059 INFO:teuthology.orchestra.run.smithi082.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-06-02T22:49:56.075 INFO:teuthology.orchestra.run.smithi082.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 784 kB/s | 59 kB 00:00 2024-06-02T22:49:56.089 INFO:teuthology.orchestra.run.smithi184.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-06-02T22:49:56.093 INFO:teuthology.orchestra.run.smithi082.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 532 kB/s | 36 kB 00:00 2024-06-02T22:49:56.126 INFO:teuthology.orchestra.run.smithi082.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 761 kB/s | 51 kB 00:00 2024-06-02T22:49:56.147 INFO:teuthology.orchestra.run.smithi184.stdout:(42/159): python3-cryptography-36.0.1-4.el9.x86 21 MB/s | 1.2 MB 00:00 2024-06-02T22:49:56.160 INFO:teuthology.orchestra.run.smithi082.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-06-02T22:49:56.181 INFO:teuthology.orchestra.run.smithi184.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-06-02T22:49:56.185 INFO:teuthology.orchestra.run.smithi082.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 974 kB/s | 90 kB 00:00 2024-06-02T22:49:56.223 INFO:teuthology.orchestra.run.smithi184.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-06-02T22:49:56.227 INFO:teuthology.orchestra.run.smithi082.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-06-02T22:49:56.244 INFO:teuthology.orchestra.run.smithi082.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-06-02T22:49:56.265 INFO:teuthology.orchestra.run.smithi184.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-06-02T22:49:56.269 INFO:teuthology.orchestra.run.smithi082.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-06-02T22:49:56.324 INFO:teuthology.orchestra.run.smithi184.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-06-02T22:49:56.369 INFO:teuthology.orchestra.run.smithi082.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-06-02T22:49:56.416 INFO:teuthology.orchestra.run.smithi184.stdout:(47/159): automake-1.16.2-8.el9.noarch.rpm 7.4 MB/s | 689 kB 00:00 2024-06-02T22:49:56.466 INFO:teuthology.orchestra.run.smithi184.stdout:(48/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 3.5 MB/s | 3.5 MB 00:00 2024-06-02T22:49:56.499 INFO:teuthology.orchestra.run.smithi184.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-06-02T22:49:56.533 INFO:teuthology.orchestra.run.smithi184.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 651 kB/s | 22 kB 00:00 2024-06-02T22:49:56.575 INFO:teuthology.orchestra.run.smithi184.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-06-02T22:49:56.600 INFO:teuthology.orchestra.run.smithi184.stdout:(52/159): boost-program-options-1.75.0-8.el9.x8 797 kB/s | 107 kB 00:00 2024-06-02T22:49:56.626 INFO:teuthology.orchestra.run.smithi184.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-06-02T22:49:56.668 INFO:teuthology.orchestra.run.smithi184.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-06-02T22:49:56.670 INFO:teuthology.orchestra.run.smithi082.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 7.7 MB/s | 2.3 MB 00:00 2024-06-02T22:49:56.730 INFO:teuthology.orchestra.run.smithi082.stdout:(150/159): librados2-19.0.0-2946.g3d89accf.el9. 7.0 MB/s | 3.4 MB 00:00 2024-06-02T22:49:56.755 INFO:teuthology.orchestra.run.smithi184.stdout:(55/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-06-02T22:49:56.779 INFO:teuthology.orchestra.run.smithi082.stdout:(151/159): NetworkManager-libnm-1.47.91-1.el9.x 17 MB/s | 1.8 MB 00:00 2024-06-02T22:49:56.785 INFO:teuthology.orchestra.run.smithi184.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-06-02T22:49:56.810 INFO:teuthology.orchestra.run.smithi184.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.9 MB/s | 160 kB 00:00 2024-06-02T22:49:56.836 INFO:teuthology.orchestra.run.smithi184.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-06-02T22:49:56.854 INFO:teuthology.orchestra.run.smithi082.stdout:(152/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 5.4 MB/s | 3.1 MB 00:00 2024-06-02T22:49:56.869 INFO:teuthology.orchestra.run.smithi184.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-06-02T22:49:56.871 INFO:teuthology.orchestra.run.smithi082.stdout:(153/159): NetworkManager-team-1.47.91-1.el9.x8 295 kB/s | 41 kB 00:00 2024-06-02T22:49:56.894 INFO:teuthology.orchestra.run.smithi184.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 582 kB 00:00 2024-06-02T22:49:56.904 INFO:teuthology.orchestra.run.smithi082.stdout:(154/159): NetworkManager-tui-1.47.91-1.el9.x86 1.9 MB/s | 248 kB 00:00 2024-06-02T22:49:56.911 INFO:teuthology.orchestra.run.smithi184.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 608 kB/s | 25 kB 00:00 2024-06-02T22:49:56.921 INFO:teuthology.orchestra.run.smithi082.stdout:(155/159): elfutils-debuginfod-client-0.191-4.e 548 kB/s | 37 kB 00:00 2024-06-02T22:49:56.937 INFO:teuthology.orchestra.run.smithi184.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-06-02T22:49:56.962 INFO:teuthology.orchestra.run.smithi184.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-06-02T22:49:56.963 INFO:teuthology.orchestra.run.smithi082.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 4.3 MB/s | 260 kB 00:00 2024-06-02T22:49:56.996 INFO:teuthology.orchestra.run.smithi184.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-06-02T22:49:57.013 INFO:teuthology.orchestra.run.smithi184.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 701 kB/s | 35 kB 00:00 2024-06-02T22:49:57.072 INFO:teuthology.orchestra.run.smithi082.stdout:(157/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-06-02T22:49:57.097 INFO:teuthology.orchestra.run.smithi082.stdout:(158/159): elfutils-libelf-0.191-4.el9.x86_64.r 916 kB/s | 207 kB 00:00 2024-06-02T22:49:57.114 INFO:teuthology.orchestra.run.smithi184.stdout:(66/159): ceph-mgr-diskprediction-local-19.0.0- 4.6 MB/s | 7.4 MB 00:01 2024-06-02T22:49:57.164 INFO:teuthology.orchestra.run.smithi082.stdout:(159/159): openssl-3.2.1-1.el9.x86_64.rpm 5.6 MB/s | 1.3 MB 00:00 2024-06-02T22:49:57.170 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-06-02T22:49:57.170 INFO:teuthology.orchestra.run.smithi082.stdout:Total 18 MB/s | 225 MB 00:12 2024-06-02T22:49:57.197 INFO:teuthology.orchestra.run.smithi184.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-06-02T22:49:57.272 INFO:teuthology.orchestra.run.smithi184.stdout:(68/159): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-06-02T22:49:57.306 INFO:teuthology.orchestra.run.smithi184.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 8.2 MB/s | 911 kB 00:00 2024-06-02T22:49:57.331 INFO:teuthology.orchestra.run.smithi184.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-06-02T22:49:57.390 INFO:teuthology.orchestra.run.smithi184.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-06-02T22:49:57.440 INFO:teuthology.orchestra.run.smithi184.stdout:(72/159): postgresql-13.14-1.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-06-02T22:49:57.465 INFO:teuthology.orchestra.run.smithi184.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-06-02T22:49:57.549 INFO:teuthology.orchestra.run.smithi184.stdout:(74/159): postgresql-server-13.14-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-06-02T22:49:57.574 INFO:teuthology.orchestra.run.smithi184.stdout:(75/159): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-06-02T22:49:57.608 INFO:teuthology.orchestra.run.smithi184.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-06-02T22:49:57.641 INFO:teuthology.orchestra.run.smithi184.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-06-02T22:49:57.671 INFO:teuthology.orchestra.run.smithi184.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-06-02T22:49:57.692 INFO:teuthology.orchestra.run.smithi184.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-06-02T22:49:57.709 INFO:teuthology.orchestra.run.smithi184.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-06-02T22:49:57.734 INFO:teuthology.orchestra.run.smithi184.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 829 kB/s | 35 kB 00:00 2024-06-02T22:49:57.776 INFO:teuthology.orchestra.run.smithi184.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-06-02T22:49:57.852 INFO:teuthology.orchestra.run.smithi184.stdout:(83/159): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-06-02T22:49:57.877 INFO:teuthology.orchestra.run.smithi184.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-06-02T22:49:57.902 INFO:teuthology.orchestra.run.smithi184.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-06-02T22:49:57.927 INFO:teuthology.orchestra.run.smithi184.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-06-02T22:49:57.953 INFO:teuthology.orchestra.run.smithi184.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-06-02T22:49:57.978 INFO:teuthology.orchestra.run.smithi184.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-02T22:49:58.003 INFO:teuthology.orchestra.run.smithi184.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-06-02T22:49:58.029 INFO:teuthology.orchestra.run.smithi184.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-02T22:49:58.054 INFO:teuthology.orchestra.run.smithi184.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-06-02T22:49:58.121 INFO:teuthology.orchestra.run.smithi184.stdout:(92/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-06-02T22:49:58.147 INFO:teuthology.orchestra.run.smithi184.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 452 kB/s | 42 kB 00:00 2024-06-02T22:49:58.172 INFO:teuthology.orchestra.run.smithi184.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-06-02T22:49:58.197 INFO:teuthology.orchestra.run.smithi184.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-06-02T22:49:58.222 INFO:teuthology.orchestra.run.smithi184.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-06-02T22:49:58.248 INFO:teuthology.orchestra.run.smithi184.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-06-02T22:49:58.273 INFO:teuthology.orchestra.run.smithi184.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-06-02T22:49:58.290 INFO:teuthology.orchestra.run.smithi184.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-06-02T22:49:58.315 INFO:teuthology.orchestra.run.smithi184.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.2 MB/s | 94 kB 00:00 2024-06-02T22:49:58.357 INFO:teuthology.orchestra.run.smithi184.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-06-02T22:49:58.357 INFO:teuthology.orchestra.run.smithi184.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-06-02T22:49:58.408 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-06-02T22:49:58.566 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-06-02T22:49:58.566 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-06-02T22:49:58.600 INFO:teuthology.orchestra.run.smithi184.stdout:(103/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-06-02T22:49:58.617 INFO:teuthology.orchestra.run.smithi184.stdout:(104/159): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-06-02T22:49:58.792 INFO:teuthology.orchestra.run.smithi184.stdout:(105/159): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-06-02T22:49:58.876 INFO:teuthology.orchestra.run.smithi184.stdout:(106/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-06-02T22:49:58.909 INFO:teuthology.orchestra.run.smithi184.stdout:(107/159): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-06-02T22:49:58.934 INFO:teuthology.orchestra.run.smithi184.stdout:(108/159): grpc-data-1.46.7-10.el9.noarch.rpm 137 kB/s | 19 kB 00:00 2024-06-02T22:49:58.968 INFO:teuthology.orchestra.run.smithi184.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-06-02T22:49:59.060 INFO:teuthology.orchestra.run.smithi184.stdout:(110/159): libunwind-1.6.2-1.el9.x86_64.rpm 735 kB/s | 67 kB 00:00 2024-06-02T22:49:59.085 INFO:teuthology.orchestra.run.smithi184.stdout:(111/159): liboath-2.6.7-2.el9.x86_64.rpm 323 kB/s | 49 kB 00:00 2024-06-02T22:49:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:(112/159): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-06-02T22:49:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:(113/159): luarocks-3.9.2-5.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-06-02T22:49:59.386 INFO:teuthology.orchestra.run.smithi184.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.7 MB/s | 839 kB 00:00 2024-06-02T22:49:59.411 INFO:teuthology.orchestra.run.smithi184.stdout:(115/159): python3-asyncssh-2.13.2-5.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-06-02T22:49:59.436 INFO:teuthology.orchestra.run.smithi184.stdout:(116/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 168 kB/s | 43 kB 00:00 2024-06-02T22:49:59.462 INFO:teuthology.orchestra.run.smithi184.stdout:(117/159): python3-cachetools-4.2.4-1.el9.noarc 426 kB/s | 32 kB 00:00 2024-06-02T22:49:59.496 INFO:teuthology.orchestra.run.smithi184.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 178 kB/s | 15 kB 00:00 2024-06-02T22:49:59.521 INFO:teuthology.orchestra.run.smithi184.stdout:(119/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-06-02T22:49:59.563 INFO:teuthology.orchestra.run.smithi184.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-06-02T22:49:59.588 INFO:teuthology.orchestra.run.smithi184.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-06-02T22:49:59.614 INFO:teuthology.orchestra.run.smithi184.stdout:(122/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-06-02T22:49:59.772 INFO:teuthology.orchestra.run.smithi184.stdout:(123/159): python3-grpcio-1.46.7-10.el9.x86_64. 9.8 MB/s | 2.0 MB 00:00 2024-06-02T22:49:59.798 INFO:teuthology.orchestra.run.smithi184.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2024-06-02T22:49:59.823 INFO:teuthology.orchestra.run.smithi184.stdout:(125/159): python3-grpcio-tools-1.46.7-10.el9.x 617 kB/s | 144 kB 00:00 2024-06-02T22:49:59.848 INFO:teuthology.orchestra.run.smithi184.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-06-02T22:49:59.873 INFO:teuthology.orchestra.run.smithi184.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-06-02T22:49:59.899 INFO:teuthology.orchestra.run.smithi184.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-06-02T22:49:59.924 INFO:teuthology.orchestra.run.smithi184.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-06-02T22:49:59.949 INFO:teuthology.orchestra.run.smithi184.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 920 kB/s | 46 kB 00:00 2024-06-02T22:49:59.983 INFO:teuthology.orchestra.run.smithi184.stdout:(131/159): python3-kubernetes-26.1.0-2.el9.noar 9.3 MB/s | 1.0 MB 00:00 2024-06-02T22:50:00.008 INFO:teuthology.orchestra.run.smithi184.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 988 kB/s | 58 kB 00:00 2024-06-02T22:50:00.034 INFO:teuthology.orchestra.run.smithi184.stdout:(133/159): python3-more-itertools-8.12.0-2.el9. 721 kB/s | 79 kB 00:00 2024-06-02T22:50:00.059 INFO:teuthology.orchestra.run.smithi184.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-06-02T22:50:00.084 INFO:teuthology.orchestra.run.smithi184.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-06-02T22:50:00.109 INFO:teuthology.orchestra.run.smithi184.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-06-02T22:50:00.151 INFO:teuthology.orchestra.run.smithi184.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-06-02T22:50:00.168 INFO:teuthology.orchestra.run.smithi184.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 366 kB/s | 31 kB 00:00 2024-06-02T22:50:00.193 INFO:teuthology.orchestra.run.smithi184.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-06-02T22:50:00.210 INFO:teuthology.orchestra.run.smithi184.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-06-02T22:50:00.227 INFO:teuthology.orchestra.run.smithi184.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 608 kB/s | 36 kB 00:00 2024-06-02T22:50:00.244 INFO:teuthology.orchestra.run.smithi184.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-02T22:50:00.270 INFO:teuthology.orchestra.run.smithi184.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-06-02T22:50:00.311 INFO:teuthology.orchestra.run.smithi184.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-06-02T22:50:00.328 INFO:teuthology.orchestra.run.smithi184.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-06-02T22:50:00.353 INFO:teuthology.orchestra.run.smithi184.stdout:(146/159): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-06-02T22:50:00.379 INFO:teuthology.orchestra.run.smithi184.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-06-02T22:50:00.471 INFO:teuthology.orchestra.run.smithi184.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-06-02T22:50:00.630 INFO:teuthology.orchestra.run.smithi184.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-06-02T22:50:00.697 INFO:teuthology.orchestra.run.smithi184.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-06-02T22:50:00.699 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-06-02T22:50:00.700 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-06-02T22:50:00.739 INFO:teuthology.orchestra.run.smithi184.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 1.0 MB/s | 41 kB 00:00 2024-06-02T22:50:00.772 INFO:teuthology.orchestra.run.smithi184.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 7.3 MB/s | 248 kB 00:00 2024-06-02T22:50:00.814 INFO:teuthology.orchestra.run.smithi184.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 880 kB/s | 37 kB 00:00 2024-06-02T22:50:00.873 INFO:teuthology.orchestra.run.smithi184.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-06-02T22:50:00.923 INFO:teuthology.orchestra.run.smithi184.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-06-02T22:50:00.982 INFO:teuthology.orchestra.run.smithi184.stdout:(156/159): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-06-02T22:50:01.049 INFO:teuthology.orchestra.run.smithi184.stdout:(157/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 36 MB/s | 2.4 MB 00:00 2024-06-02T22:50:01.174 INFO:teuthology.orchestra.run.smithi184.stdout:(158/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 3.9 MB/s | 3.1 MB 00:00 2024-06-02T22:50:01.366 INFO:teuthology.orchestra.run.smithi184.stdout:(159/159): librados2-19.0.0-2946.g3d89accf.el9. 3.3 MB/s | 3.4 MB 00:01 2024-06-02T22:50:01.369 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-06-02T22:50:01.369 INFO:teuthology.orchestra.run.smithi184.stdout:Total 16 MB/s | 225 MB 00:14 2024-06-02T22:50:02.589 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-06-02T22:50:02.744 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-06-02T22:50:02.745 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-06-02T22:50:04.872 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-06-02T22:50:04.873 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-06-02T22:50:07.104 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-06-02T22:50:07.202 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T22:50:07.245 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T22:50:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T22:50:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T22:50:07.377 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T22:50:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T22:50:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T22:50:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:50:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:50:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:50:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:50:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T22:50:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T22:50:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T22:50:08.457 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T22:50:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:50:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:50:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T22:50:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T22:50:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T22:50:08.718 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T22:50:08.915 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T22:50:09.097 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T22:50:09.226 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T22:50:09.286 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T22:50:09.406 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:50:09.521 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:50:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:50:09.847 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T22:50:09.949 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T22:50:09.985 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-02T22:50:10.020 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-02T22:50:10.102 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-02T22:50:10.136 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-02T22:50:10.180 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-02T22:50:10.215 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-02T22:50:10.248 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-02T22:50:10.317 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-02T22:50:10.370 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-02T22:50:10.401 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-02T22:50:10.444 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-02T22:50:10.521 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-02T22:50:10.555 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-02T22:50:10.599 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-02T22:50:10.627 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-02T22:50:10.698 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-02T22:50:10.759 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-02T22:50:10.833 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-02T22:50:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-02T22:50:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-02T22:50:11.185 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-06-02T22:50:11.288 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T22:50:11.317 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T22:50:11.382 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T22:50:11.413 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T22:50:11.430 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T22:50:11.498 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T22:50:11.554 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-02T22:50:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-02T22:50:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-02T22:50:11.712 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-02T22:50:11.754 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-02T22:50:11.793 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-02T22:50:11.834 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-02T22:50:11.846 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T22:50:11.956 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:50:11.995 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-02T22:50:12.053 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-02T22:50:12.061 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:50:12.091 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:50:12.108 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-02T22:50:12.182 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T22:50:12.190 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:50:12.212 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T22:50:12.220 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T22:50:12.249 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T22:50:12.260 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T22:50:12.296 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T22:50:12.331 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T22:50:12.375 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T22:50:12.417 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T22:50:12.453 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T22:50:12.517 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T22:50:12.538 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:50:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T22:50:12.602 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T22:50:12.642 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:50:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T22:50:12.664 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T22:50:12.710 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T22:50:12.732 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T22:50:12.738 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T22:50:12.753 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T22:50:12.769 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T22:50:12.812 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T22:50:12.844 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T22:50:12.869 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T22:50:12.951 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T22:50:12.952 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T22:50:13.079 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T22:50:13.117 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T22:50:13.254 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T22:50:13.315 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T22:50:13.335 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T22:50:13.372 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T22:50:13.410 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T22:50:13.425 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:50:13.446 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T22:50:13.494 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T22:50:13.499 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:50:13.523 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T22:50:13.558 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T22:50:13.591 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T22:50:13.633 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T22:50:13.670 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T22:50:13.708 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:50:13.758 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T22:50:13.806 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T22:50:13.838 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T22:50:13.844 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T22:50:13.893 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T22:50:13.924 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T22:50:13.971 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-02T22:50:14.000 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T22:50:14.006 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-02T22:50:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T22:50:14.079 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-02T22:50:14.115 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-02T22:50:14.157 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-02T22:50:14.191 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-02T22:50:14.218 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-02T22:50:14.286 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-02T22:50:14.340 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-02T22:50:14.371 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-02T22:50:14.406 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-02T22:50:14.481 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-02T22:50:14.517 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-02T22:50:14.561 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-02T22:50:14.589 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-02T22:50:14.666 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-02T22:50:14.712 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-02T22:50:14.787 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-02T22:50:14.787 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T22:50:14.834 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T22:50:14.868 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T22:50:14.928 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-02T22:50:14.970 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T22:50:14.981 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-02T22:50:15.023 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T22:50:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T22:50:15.157 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T22:50:15.191 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T22:50:15.362 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T22:50:15.393 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T22:50:15.472 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T22:50:15.500 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-02T22:50:15.577 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-02T22:50:15.615 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-02T22:50:15.657 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-02T22:50:15.711 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-02T22:50:15.740 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-02T22:50:15.781 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-02T22:50:15.931 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-02T22:50:15.985 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-02T22:50:16.040 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-02T22:50:16.112 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T22:50:16.127 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T22:50:16.152 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T22:50:16.188 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T22:50:16.235 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T22:50:16.250 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T22:50:16.271 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T22:50:16.315 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T22:50:16.356 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T22:50:16.492 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T22:50:16.584 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T22:50:16.625 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T22:50:16.945 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T22:50:16.985 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T22:50:17.026 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T22:50:17.058 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T22:50:17.108 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T22:50:17.185 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T22:50:17.309 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T22:50:17.348 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T22:50:17.376 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T22:50:17.420 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T22:50:17.458 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T22:50:17.489 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T22:50:17.509 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T22:50:17.520 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T22:50:17.554 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T22:50:17.587 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T22:50:17.596 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T22:50:17.624 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T22:50:17.629 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T22:50:17.657 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T22:50:17.664 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T22:50:17.750 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T22:50:17.810 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T22:50:17.842 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T22:50:17.889 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T22:50:17.970 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T22:50:17.986 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T22:50:18.011 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T22:50:18.034 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T22:50:18.102 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T22:50:18.133 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-02T22:50:18.177 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T22:50:18.648 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T22:50:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T22:50:18.756 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T22:50:18.799 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T22:50:18.832 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T22:50:18.877 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T22:50:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T22:50:18.979 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T22:50:19.024 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T22:50:19.032 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-02T22:50:19.110 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T22:50:19.152 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T22:50:19.328 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T22:50:19.375 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T22:50:19.453 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T22:50:20.103 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T22:50:20.223 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T22:50:21.478 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T22:50:21.561 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:50:21.571 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T22:50:21.596 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:50:21.599 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T22:50:21.632 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T22:50:21.949 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T22:50:21.995 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T22:50:22.094 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T22:50:22.125 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-02T22:50:22.139 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:50:22.164 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T22:50:22.182 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T22:50:22.265 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T22:50:22.265 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T22:50:22.265 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T22:50:22.266 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:22.300 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T22:50:22.642 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T22:50:22.674 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T22:50:22.744 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T22:50:22.775 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-02T22:50:25.013 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:50:25.331 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:50:25.885 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:50:25.925 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T22:50:26.025 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T22:50:26.026 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T22:50:26.026 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T22:50:26.026 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:50:26.060 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T22:50:33.958 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T22:50:33.958 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-06-02T22:50:33.958 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-06-02T22:50:33.958 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-06-02T22:50:33.958 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-06-02T22:50:33.959 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-06-02T22:50:33.959 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-06-02T22:50:33.959 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-06-02T22:50:33.959 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:34.138 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T22:50:34.154 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T22:50:34.154 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:34.154 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T22:50:34.154 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:35.633 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T22:50:35.659 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T22:50:35.659 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:35.660 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T22:50:35.660 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T22:50:35.660 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T22:50:35.660 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:35.883 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T22:50:35.906 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T22:50:35.906 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:35.906 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T22:50:35.907 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T22:50:35.907 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T22:50:35.907 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:36.350 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T22:50:36.373 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T22:50:36.373 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:36.374 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T22:50:36.374 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T22:50:36.374 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T22:50:36.374 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:36.472 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T22:50:36.529 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T22:50:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T22:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T22:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T22:50:36.905 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T22:50:37.002 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T22:50:37.142 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T22:50:37.176 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T22:50:37.208 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T22:50:37.235 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T22:50:37.489 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T22:50:37.490 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2024-06-02T22:50:37.490 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2024-06-02T22:50:37.490 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2024-06-02T22:50:37.490 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2024-06-02T22:50:37.490 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2024-06-02T22:50:37.490 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /root 2024-06-02T22:50:37.490 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2024-06-02T22:50:37.490 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:50:37.650 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T22:50:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T22:50:37.665 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T22:50:37.665 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:37.665 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T22:50:37.666 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:50:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T22:50:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-02T22:50:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-02T22:50:37.832 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T22:50:38.869 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T22:50:38.908 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T22:50:39.152 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T22:50:39.179 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T22:50:39.179 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:39.180 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T22:50:39.180 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T22:50:39.180 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T22:50:39.180 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:50:39.413 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T22:50:39.436 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T22:50:39.436 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:39.436 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T22:50:39.436 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T22:50:39.436 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T22:50:39.436 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:50:39.870 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T22:50:39.889 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T22:50:39.900 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T22:50:39.912 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T22:50:39.913 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:39.913 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T22:50:39.913 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T22:50:39.913 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T22:50:39.913 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:50:40.003 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T22:50:40.019 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T22:50:40.068 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T22:50:40.124 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T22:50:40.170 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-02T22:50:40.202 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T22:50:40.226 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T22:50:40.226 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:40.226 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T22:50:40.226 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T22:50:40.226 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T22:50:40.226 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T22:50:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T22:50:40.307 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T22:50:40.365 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T22:50:40.386 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-02T22:50:40.440 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-02T22:50:40.442 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T22:50:40.531 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T22:50:40.670 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T22:50:40.715 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T22:50:40.747 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T22:50:40.775 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T22:50:41.196 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T22:50:41.223 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T22:50:41.255 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-02T22:50:41.317 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-02T22:50:41.345 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T22:50:41.346 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T22:50:41.372 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T22:50:41.395 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T22:50:41.395 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:41.395 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T22:50:41.395 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T22:50:41.395 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T22:50:41.395 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T22:50:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T22:50:41.470 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:41.470 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T22:50:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:41.520 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T22:50:41.543 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T22:50:41.543 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:41.544 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T22:50:41.544 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T22:50:41.544 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T22:50:41.544 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:41.846 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T22:50:41.869 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T22:50:41.869 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:41.870 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T22:50:41.870 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T22:50:41.870 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T22:50:41.870 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:42.386 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T22:50:42.432 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T22:50:43.403 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T22:50:43.432 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T22:50:43.534 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T22:50:43.704 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-02T22:50:43.734 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T22:50:43.758 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T22:50:43.758 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:43.758 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T22:50:43.759 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T22:50:43.759 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T22:50:43.759 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:50:43.801 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T22:50:43.813 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T22:50:43.914 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-02T22:50:43.972 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-02T22:50:44.868 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T22:50:44.909 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T22:50:44.932 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T22:50:44.932 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:44.932 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T22:50:44.932 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T22:50:44.932 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T22:50:44.932 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:50:44.984 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T22:50:45.007 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T22:50:45.007 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:45.007 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T22:50:45.007 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:50:45.051 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T22:50:45.074 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T22:50:45.075 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:45.075 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T22:50:45.075 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T22:50:45.075 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T22:50:45.075 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:50:45.377 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T22:50:45.401 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T22:50:45.401 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:50:45.402 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T22:50:45.402 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T22:50:45.402 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T22:50:45.402 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:50:46.433 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-02T22:50:46.475 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-02T22:50:46.515 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-02T22:50:46.548 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T22:50:46.575 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T22:50:46.771 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-02T22:50:46.821 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T22:50:46.854 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-02T22:50:46.911 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T22:50:46.940 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T22:50:46.978 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T22:50:47.583 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:50:47.618 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:50:47.638 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:50:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-02T22:50:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T22:50:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T22:50:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T22:50:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T22:50:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T22:50:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T22:50:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T22:50:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T22:50:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T22:50:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T22:50:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T22:50:49.047 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T22:50:49.080 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T22:50:49.090 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:50:49.090 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:50:49.274 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:50:49.274 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T22:50:49.342 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T22:50:49.383 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T22:50:49.448 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T22:50:49.913 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-02T22:50:49.955 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-02T22:50:49.995 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-02T22:50:50.028 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T22:50:50.055 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T22:50:50.244 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-02T22:50:50.293 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T22:50:50.326 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-02T22:50:50.357 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T22:50:50.388 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T22:50:50.425 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T22:50:51.053 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:50:51.114 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:50:51.134 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:50:51.986 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-02T22:50:52.077 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T22:50:52.118 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T22:50:52.207 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T22:50:52.247 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T22:50:52.272 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T22:50:52.297 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T22:50:52.323 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T22:50:52.323 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T22:50:52.408 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T22:50:52.441 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T22:50:52.441 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T22:50:52.525 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T22:50:52.550 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T22:50:52.557 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:50:52.557 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:50:52.744 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:50:52.744 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T22:50:52.853 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T22:50:52.878 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T22:50:52.943 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T22:50:55.032 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T22:50:55.032 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-02T22:50:55.032 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-02T22:50:55.032 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-02T22:50:55.032 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-02T22:50:55.032 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-02T22:50:55.032 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-02T22:50:55.032 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-02T22:50:55.032 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:50:55.032 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:50:55.032 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-02T22:50:55.033 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-02T22:50:55.034 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-02T22:50:55.034 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-02T22:50:55.046 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-02T22:50:55.047 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T22:50:55.048 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T22:50:55.049 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T22:50:55.050 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T22:50:55.051 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T22:50:55.052 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T22:50:55.053 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T22:50:55.054 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T22:50:55.055 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T22:50:55.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T22:50:55.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T22:50:55.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T22:50:55.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T22:50:55.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T22:50:55.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T22:50:55.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T22:50:55.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T22:50:55.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T22:50:55.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T22:50:55.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T22:50:55.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T22:50:57.995 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T22:50:57.996 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:57.996 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-06-02T22:50:57.996 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T22:50:57.996 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T22:50:57.996 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T22:50:57.996 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T22:50:57.997 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T22:50:57.997 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T22:50:57.997 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T22:50:57.997 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:57.997 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:57.998 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T22:50:57.998 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T22:50:57.998 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-06-02T22:50:57.998 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T22:50:57.998 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T22:50:57.998 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T22:50:57.999 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T22:50:57.999 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:57.999 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:57.999 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:57.999 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:57.999 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:50:58.000 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.000 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.000 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.000 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:50:58.000 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:50:58.000 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:50:58.001 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:50:58.001 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:50:58.001 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.001 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.001 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:50:58.001 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.002 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.002 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.002 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:50:58.002 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:50:58.002 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.003 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.003 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:50:58.003 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T22:50:58.003 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T22:50:58.003 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T22:50:58.003 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T22:50:58.004 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T22:50:58.004 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T22:50:58.004 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T22:50:58.004 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T22:50:58.004 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T22:50:58.004 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T22:50:58.005 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T22:50:58.005 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.005 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.005 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.005 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T22:50:58.005 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T22:50:58.006 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T22:50:58.006 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T22:50:58.006 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T22:50:58.006 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.006 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.007 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T22:50:58.007 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.007 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T22:50:58.007 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T22:50:58.007 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T22:50:58.007 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T22:50:58.007 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T22:50:58.007 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T22:50:58.007 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T22:50:58.008 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T22:50:58.009 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T22:50:58.009 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.009 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T22:50:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T22:50:58.011 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T22:50:58.011 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T22:50:58.011 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T22:50:58.011 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T22:50:58.011 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T22:50:58.011 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T22:50:58.011 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T22:50:58.011 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T22:50:58.011 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T22:50:58.011 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T22:50:58.011 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T22:50:58.012 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T22:50:58.013 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T22:50:58.014 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:50:58.015 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-06-02T22:50:58.443 DEBUG:teuthology.parallel:result is None 2024-06-02T22:50:58.578 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T22:50:58.578 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-02T22:50:58.578 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-02T22:50:58.578 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-02T22:50:58.578 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-02T22:50:58.579 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-02T22:50:58.580 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T22:50:58.581 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T22:50:58.582 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T22:50:58.583 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T22:50:58.584 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T22:50:58.585 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T22:50:58.585 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T22:50:58.585 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T22:50:58.585 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T22:50:58.585 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T22:50:58.585 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T22:50:58.585 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T22:50:58.585 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T22:50:58.585 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T22:50:58.585 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T22:50:58.586 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T22:50:58.587 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T22:50:58.588 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T22:50:58.589 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T22:50:58.590 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T22:50:58.591 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T22:50:58.591 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T22:50:58.591 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T22:50:58.591 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T22:50:58.591 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T22:50:58.591 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T22:50:58.591 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T22:50:58.591 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T22:50:58.591 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T22:51:01.422 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T22:51:01.423 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:01.423 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2024-06-02T22:51:01.423 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T22:51:01.423 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T22:51:01.423 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T22:51:01.423 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T22:51:01.423 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T22:51:01.423 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T22:51:01.423 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T22:51:01.423 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.423 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:51:01.424 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.425 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T22:51:01.426 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T22:51:01.427 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T22:51:01.428 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T22:51:01.429 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T22:51:01.430 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T22:51:01.431 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T22:51:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T22:51:01.433 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T22:51:01.434 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.435 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.435 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:51:01.435 INFO:teuthology.orchestra.run.smithi184.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T22:51:01.435 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T22:51:01.435 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T22:51:01.435 INFO:teuthology.orchestra.run.smithi184.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T22:51:01.435 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T22:51:01.435 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T22:51:01.435 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T22:51:01.435 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:01.436 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-06-02T22:51:01.871 DEBUG:teuthology.parallel:result is None 2024-06-02T22:51:01.871 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:51:02.021 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T22:51:02.047 INFO:teuthology.orchestra.run.smithi082.stdout:19.0.0-2946.g3d89accf.el9 2024-06-02T22:51:02.048 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-02T22:51:02.048 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-02T22:51:02.051 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:51:02.264 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T22:51:02.288 INFO:teuthology.orchestra.run.smithi184.stdout:19.0.0-2946.g3d89accf.el9 2024-06-02T22:51:02.288 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-02T22:51:02.288 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-02T22:51:02.291 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-02T22:51:02.291 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:02.291 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T22:51:02.323 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:02.323 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T22:51:02.356 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-02T22:51:02.357 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:02.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T22:51:02.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T22:51:02.461 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:02.461 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T22:51:02.489 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T22:51:02.554 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-02T22:51:02.555 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:02.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T22:51:02.582 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T22:51:02.649 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:02.649 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T22:51:02.675 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T22:51:02.741 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-02T22:51:02.741 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:02.741 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T22:51:02.769 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T22:51:02.836 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:02.836 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T22:51:02.862 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T22:51:02.927 INFO:teuthology.run_tasks:Running task ceph... 2024-06-02T22:51:03.005 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-06-02T22:51:03.005 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2024-06-02T22:51:03.008 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2024-06-02T22:51:03.033 INFO:tasks.ceph:Disabling ceph logrotate... 2024-06-02T22:51:03.033 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-02T22:51:03.075 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-02T22:51:03.100 INFO:tasks.ceph:Creating extra log directories... 2024-06-02T22:51:03.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-02T22:51:03.142 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-02T22:51:03.172 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-06-02T22:51:03.172 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-06-02T22:51:03.172 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-06-02T22:51:03.172 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:03.172 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-06-02T22:51:03.223 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-06-02T22:51:03.338 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-06-02T22:51:03.363 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:03.363 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-06-02T22:51:03.379 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-06-02T22:51:03.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-06-02T22:51:03.520 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-06-02T22:51:03.520 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-06-02T22:51:03.520 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/pool-perm}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7738633', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'dfcc4b3c2c55532c4c04fa47551c9df1dffdf746'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2064, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'sleep_before_teardown': 0, 'subset': '125/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'dfcc4b3c2c55532c4c04fa47551c9df1dffdf746', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOlrI80bnOoSQf3KLEZwqpn+jA6rva0qRnoy7zwGDf2DTQ+Q4gs3/IBHosW/E2hsYvfouTbCuG7uwS+YuhLiGes=', 'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIAzKrqGDfgjxek+pRDbVFUV24TcLUUIPb05l40XqIT8naO78P9rpkuSEH5L3N3lc94zfvcKVkKrOiFTE6d8yAU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '861a8dcf7aa816a26e13f039336f7ed0a9aec0fa', 'timestamp': '2024-06-02_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-06-02T22:51:03.521 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-02T22:51:03.523 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-02T22:51:03.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2024-06-02T22:51:03.579 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2024-06-02T22:51:03.635 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:03.635 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T22:51:03.657 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T22:51:03.657 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-06-02T22:51:03.712 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T22:51:03.712 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:51:03.713 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-06-02T22:51:03.713 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:51:03.713 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:51:03.713 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-06-02 22:50:49.805186859 +0000 2024-06-02T22:51:03.713 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-06-02 22:48:47.464464811 +0000 2024-06-02T22:51:03.713 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-06-02 22:48:47.464464811 +0000 2024-06-02T22:51:03.713 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-06-02 22:48:47.464464811 +0000 2024-06-02T22:51:03.713 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T22:51:03.775 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-06-02T22:51:03.775 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-06-02T22:51:03.776 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000243579 s, 2.1 MB/s 2024-06-02T22:51:03.777 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T22:51:03.833 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-06-02T22:51:03.887 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T22:51:03.888 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:51:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-06-02T22:51:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:51:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:51:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-06-02 22:50:49.805186859 +0000 2024-06-02T22:51:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-06-02 22:48:47.803457700 +0000 2024-06-02T22:51:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-06-02 22:48:47.803457700 +0000 2024-06-02T22:51:03.888 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-06-02 22:48:47.803457700 +0000 2024-06-02T22:51:03.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T22:51:03.950 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-06-02T22:51:03.951 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-06-02T22:51:03.951 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000168243 s, 3.0 MB/s 2024-06-02T22:51:03.952 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T22:51:04.009 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-06-02T22:51:04.065 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T22:51:04.066 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:51:04.066 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 709 Links: 1 2024-06-02T22:51:04.066 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:51:04.066 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:51:04.066 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-06-02 22:50:49.806186838 +0000 2024-06-02T22:51:04.067 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-06-02 22:48:48.132450798 +0000 2024-06-02T22:51:04.067 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-06-02 22:48:48.132450798 +0000 2024-06-02T22:51:04.067 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-06-02 22:48:48.132450798 +0000 2024-06-02T22:51:04.067 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T22:51:04.129 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-06-02T22:51:04.129 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-06-02T22:51:04.129 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000186501 s, 2.7 MB/s 2024-06-02T22:51:04.130 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T22:51:04.186 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-06-02T22:51:04.241 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T22:51:04.241 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:51:04.241 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 727 Links: 1 2024-06-02T22:51:04.242 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:51:04.242 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:51:04.242 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-06-02 22:50:49.806186838 +0000 2024-06-02T22:51:04.242 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-06-02 22:48:48.491443267 +0000 2024-06-02T22:51:04.242 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-06-02 22:48:48.491443267 +0000 2024-06-02T22:51:04.242 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-06-02 22:48:48.491443267 +0000 2024-06-02T22:51:04.242 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T22:51:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-06-02T22:51:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-06-02T22:51:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000160617 s, 3.2 MB/s 2024-06-02T22:51:04.306 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T22:51:04.362 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T22:51:04.362 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:04.363 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T22:51:04.381 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T22:51:04.382 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-06-02T22:51:04.438 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T22:51:04.438 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:51:04.438 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-06-02T22:51:04.438 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:51:04.438 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:51:04.438 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-06-02 22:50:53.282629343 +0000 2024-06-02T22:51:04.438 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-06-02 22:48:46.090952692 +0000 2024-06-02T22:51:04.438 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-06-02 22:48:46.090952692 +0000 2024-06-02T22:51:04.438 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-06-02 22:48:46.090952692 +0000 2024-06-02T22:51:04.439 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T22:51:04.502 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-06-02T22:51:04.502 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-06-02T22:51:04.502 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000208717 s, 2.5 MB/s 2024-06-02T22:51:04.503 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T22:51:04.561 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-06-02T22:51:04.618 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T22:51:04.619 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:51:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-06-02T22:51:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:51:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:51:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-06-02 22:50:53.283629323 +0000 2024-06-02T22:51:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-06-02 22:48:46.425945574 +0000 2024-06-02T22:51:04.620 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-06-02 22:48:46.425945574 +0000 2024-06-02T22:51:04.620 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-06-02 22:48:46.425945574 +0000 2024-06-02T22:51:04.620 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T22:51:04.682 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-06-02T22:51:04.682 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-06-02T22:51:04.682 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000216417 s, 2.4 MB/s 2024-06-02T22:51:04.684 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T22:51:04.740 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-06-02T22:51:04.795 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T22:51:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:51:04.796 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-06-02T22:51:04.796 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:51:04.796 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:51:04.796 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-06-02 22:50:53.283629323 +0000 2024-06-02T22:51:04.796 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-06-02 22:48:46.749938689 +0000 2024-06-02T22:51:04.796 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-06-02 22:48:46.749938689 +0000 2024-06-02T22:51:04.796 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-06-02 22:48:46.749938689 +0000 2024-06-02T22:51:04.796 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T22:51:04.858 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-06-02T22:51:04.858 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-06-02T22:51:04.859 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000189765 s, 2.7 MB/s 2024-06-02T22:51:04.860 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T22:51:04.915 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-06-02T22:51:04.971 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T22:51:04.971 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:51:04.971 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-06-02T22:51:04.971 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:51:04.971 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:51:04.971 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-06-02 22:50:53.283629323 +0000 2024-06-02T22:51:04.971 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-06-02 22:48:47.075931762 +0000 2024-06-02T22:51:04.971 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-06-02 22:48:47.075931762 +0000 2024-06-02T22:51:04.971 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-06-02 22:48:47.075931762 +0000 2024-06-02T22:51:04.972 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T22:51:05.034 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-06-02T22:51:05.034 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-06-02T22:51:05.035 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000219501 s, 2.3 MB/s 2024-06-02T22:51:05.036 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T22:51:05.091 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T22:51:05.092 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-02T22:51:05.092 INFO:tasks.ceph:Generating config... 2024-06-02T22:51:05.093 INFO:tasks.ceph:[client] client mount timeout = 600 2024-06-02T22:51:05.093 INFO:tasks.ceph:[client] debug client = 20 2024-06-02T22:51:05.093 INFO:tasks.ceph:[client] debug ms = 1 2024-06-02T22:51:05.093 INFO:tasks.ceph:[client] pid file = 2024-06-02T22:51:05.093 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-06-02T22:51:05.093 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-06-02T22:51:05.093 INFO:tasks.ceph:[mds] debug mds = 20 2024-06-02T22:51:05.093 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mds] debug ms = 1 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mds] mds debug frag = True 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mgr] debug client = 20 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mgr] debug ms = 1 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mon] debug mon = 20 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mon] debug ms = 1 2024-06-02T22:51:05.094 INFO:tasks.ceph:[mon] debug paxos = 20 2024-06-02T22:51:05.095 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-06-02T22:51:05.095 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] debug ms = 1 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] debug osd = 20 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-06-02T22:51:05.095 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-06-02T22:51:05.096 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-06-02T22:51:05.096 INFO:tasks.ceph:Setting up mon.a... 2024-06-02T22:51:05.096 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-06-02T22:51:05.148 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.keyring 2024-06-02T22:51:05.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-06-02T22:51:05.194 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-02T22:51:05.258 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.82'), ('mon.b', '172.21.15.184'), ('mon.c', '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]')] 2024-06-02T22:51:05.259 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.82,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-06-02T22:51:05.260 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:05.260 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-06-02T22:51:05.313 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.82 --add b 172.21.15.184 --addv c '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:05.399 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:05.399 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: generated fsid 6f85057c-cf41-4021-ae61-b6064b1147d0 2024-06-02T22:51:05.399 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = quincy 2024-06-02T22:51:05.399 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 0 2024-06-02T22:51:05.399 INFO:teuthology.orchestra.run.smithi082.stdout:fsid 6f85057c-cf41-4021-ae61-b6064b1147d0 2024-06-02T22:51:05.399 INFO:teuthology.orchestra.run.smithi082.stdout:last_changed 2024-06-02T22:51:05.400391+0000 2024-06-02T22:51:05.399 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-06-02T22:51:05.400391+0000 2024-06-02T22:51:05.399 INFO:teuthology.orchestra.run.smithi082.stdout:min_mon_release 17 (quincy) 2024-06-02T22:51:05.399 INFO:teuthology.orchestra.run.smithi082.stdout:election_strategy: 1 2024-06-02T22:51:05.399 INFO:teuthology.orchestra.run.smithi082.stdout:0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-06-02T22:51:05.400 INFO:teuthology.orchestra.run.smithi082.stdout:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-06-02T22:51:05.400 INFO:teuthology.orchestra.run.smithi082.stdout:2: [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] mon.c 2024-06-02T22:51:05.400 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-06-02T22:51:05.401 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-06-02T22:51:05.416 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6f85057c-cf41-4021-ae61-b6064b1147d0... 2024-06-02T22:51:05.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-02T22:51:05.459 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-02T22:51:05.499 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-06-02T22:51:05.499 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-06-02T22:51:05.499 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-02T22:51:05.499 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-06-02T22:51:05.499 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.499 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-06-02T22:51:05.499 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.499 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-06-02T22:51:05.499 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.499 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-06-02T22:51:05.499 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-06-02T22:51:05.500 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-06-02T22:51:05.501 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.82,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 6f85057c-cf41-4021-ae61-b6064b1147d0 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-06-02T22:51:05.502 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug trim objects = true 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.503 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 20 2024-06-02T22:51:05.504 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 20 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 10 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-06-02T22:51:05.505 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-06-02T22:51:05.506 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-02T22:51:05.507 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: mon down mkfs grace = 300 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-02T22:51:05.508 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2024-06-02T22:51:05.509 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2024-06-02T22:51:05.510 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds balancer = 20 2024-06-02T22:51:05.510 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-06-02T22:51:05.510 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2024-06-02T22:51:05.510 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = True 2024-06-02T22:51:05.510 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2024-06-02T22:51:05.510 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = True 2024-06-02T22:51:05.510 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-06-02T22:51:05.510 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-06-02T22:51:05.510 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.511 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2024-06-02T22:51:05.512 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2024-06-02T22:51:05.513 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.82,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = 6f85057c-cf41-4021-ae61-b6064b1147d0 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2024-06-02T22:51:05.514 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug trim objects = true 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.515 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-06-02T22:51:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-06-02T22:51:05.517 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2024-06-02T22:51:05.518 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2024-06-02T22:51:05.519 INFO:teuthology.orchestra.run.smithi184.stdout: mon down mkfs grace = 300 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: mon op complaint time = 120 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: client mount timeout = 600 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = "" 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2024-06-02T22:51:05.520 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds = 20 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds balancer = 20 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug frag = True 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug scatterstat = True 2024-06-02T22:51:05.521 INFO:teuthology.orchestra.run.smithi184.stdout: mds op complaint time = 180 2024-06-02T22:51:05.522 INFO:teuthology.orchestra.run.smithi184.stdout: mds verify scatter = True 2024-06-02T22:51:05.522 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2024-06-02T22:51:05.522 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2024-06-02T22:51:05.522 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2024-06-02T22:51:05.523 INFO:tasks.ceph:Creating admin key on mon.a... 2024-06-02T22:51:05.523 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-06-02T22:51:05.617 INFO:tasks.ceph:Copying monmap to all nodes... 2024-06-02T22:51:05.617 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:05.617 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-06-02T22:51:05.632 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:05.632 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-06-02T22:51:05.688 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:51:05.688 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:05.688 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-02T22:51:05.688 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-02T22:51:05.763 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:05.763 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:05.818 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:51:05.818 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:05.818 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-02T22:51:05.818 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-02T22:51:05.853 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:05.853 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:05.909 INFO:tasks.ceph:Setting up mon nodes... 2024-06-02T22:51:05.963 INFO:tasks.ceph:Setting up mgr nodes... 2024-06-02T22:51:05.963 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-06-02T22:51:06.017 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-06-02T22:51:06.020 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-06-02T22:51:06.090 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-06-02T22:51:06.092 INFO:tasks.ceph:Setting up mds nodes... 2024-06-02T22:51:06.092 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-06-02T22:51:06.146 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-06-02T22:51:06.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-06-02T22:51:06.179 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-06-02T22:51:06.274 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-06-02T22:51:06.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-06-02T22:51:06.302 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-06-02T22:51:06.358 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-06-02T22:51:06.360 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-06-02T22:51:06.388 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-06-02T22:51:06.481 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-06-02T22:51:06.484 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-06-02T22:51:06.509 INFO:tasks.ceph_client:Setting up client nodes... 2024-06-02T22:51:06.509 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-02T22:51:06.550 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-06-02T22:51:06.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-06-02T22:51:06.645 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-06-02T22:51:06.657 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-06-02T22:51:06.699 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-06-02T22:51:06.711 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-06-02T22:51:06.792 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-06-02T22:51:06.805 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-06-02T22:51:06.805 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-02T22:51:06.805 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-06-02T22:51:06.830 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T22:51:06.830 INFO:tasks.ceph:role: osd.0 2024-06-02T22:51:06.830 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:51:06.830 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-02T22:51:06.902 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T22:51:06.902 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T22:51:06.902 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T22:51:06.903 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T22:51:06.903 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T22:51:06.903 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-06-02T22:51:06.903 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T22:51:06.903 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T22:51:06.903 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T22:51:06.903 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T22:51:07.403 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-06-02T22:51:07.405 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-06-02T22:51:07.405 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-06-02T22:51:07.507 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-06-02T22:51:07.540 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-06-02T22:51:07.606 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T22:51:07.607 INFO:tasks.ceph:role: osd.1 2024-06-02T22:51:07.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:51:07.607 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-02T22:51:07.679 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T22:51:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T22:51:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T22:51:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T22:51:07.680 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T22:51:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-06-02T22:51:07.680 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T22:51:07.680 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T22:51:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T22:51:07.680 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T22:51:08.134 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-06-02T22:51:08.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-06-02T22:51:08.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-06-02T22:51:08.210 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-06-02T22:51:08.278 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-06-02T22:51:08.343 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T22:51:08.343 INFO:tasks.ceph:role: osd.2 2024-06-02T22:51:08.344 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:51:08.344 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-02T22:51:08.415 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T22:51:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T22:51:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T22:51:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T22:51:08.415 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T22:51:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-06-02T22:51:08.416 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T22:51:08.416 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T22:51:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T22:51:08.416 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T22:51:08.913 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-06-02T22:51:08.914 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-06-02T22:51:08.915 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-06-02T22:51:09.017 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-06-02T22:51:09.046 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-06-02T22:51:09.111 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T22:51:09.111 INFO:tasks.ceph:role: osd.3 2024-06-02T22:51:09.111 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:51:09.111 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-02T22:51:09.184 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T22:51:09.184 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T22:51:09.184 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T22:51:09.184 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T22:51:09.184 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T22:51:09.184 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-06-02T22:51:09.184 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T22:51:09.184 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T22:51:09.184 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T22:51:09.184 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T22:51:09.696 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-06-02T22:51:09.698 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-06-02T22:51:09.698 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-06-02T22:51:09.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-06-02T22:51:09.877 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:09.974+0000 7f35f4014640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-06-02T22:51:09.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:09.980+0000 7f35f4014640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-06-02T22:51:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:09.980+0000 7f35f4014640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-02T22:51:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:09.980+0000 7f35f4014640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-02T22:51:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:09.980+0000 7f35f4014640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-02T22:51:09.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:09.985+0000 7f35f4014640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-06-02T22:51:12.838 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-02T22:51:12.867 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:12.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:12.957+0000 7fce745b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-06-02T22:51:12.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:12.957+0000 7fce745b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-06-02T22:51:12.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:12.957+0000 7fce745b1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-02T22:51:12.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:12.957+0000 7fce745b1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-02T22:51:12.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:12.957+0000 7fce745b1640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-02T22:51:12.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:12.958+0000 7fce745b1640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-06-02T22:51:15.800 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-02T22:51:15.830 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:15.920+0000 7faa8a7cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-06-02T22:51:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:15.921+0000 7faa8a7cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-06-02T22:51:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:15.921+0000 7faa8a7cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-02T22:51:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:15.921+0000 7faa8a7cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-02T22:51:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:15.921+0000 7faa8a7cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-02T22:51:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:15.921+0000 7faa8a7cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-06-02T22:51:18.781 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-02T22:51:18.810 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:18.901+0000 7f0c59a1d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-06-02T22:51:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:18.901+0000 7f0c59a1d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-06-02T22:51:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:18.901+0000 7f0c59a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-02T22:51:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:18.901+0000 7f0c59a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-02T22:51:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:18.901+0000 7f0c59a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-02T22:51:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:18.902+0000 7f0c59a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-06-02T22:51:21.750 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-02T22:51:21.781 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-06-02T22:51:21.812 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T22:51:21.812 INFO:tasks.ceph:role: osd.4 2024-06-02T22:51:21.812 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:51:21.812 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-02T22:51:21.889 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T22:51:21.889 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T22:51:21.889 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T22:51:21.889 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T22:51:21.890 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T22:51:21.890 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-06-02T22:51:21.890 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T22:51:21.890 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T22:51:21.890 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T22:51:21.890 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T22:51:22.416 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-06-02T22:51:22.418 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-06-02T22:51:22.418 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-06-02T22:51:22.567 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-06-02T22:51:22.600 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-06-02T22:51:22.665 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T22:51:22.666 INFO:tasks.ceph:role: osd.5 2024-06-02T22:51:22.666 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:51:22.666 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-02T22:51:22.738 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T22:51:22.738 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T22:51:22.738 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T22:51:22.738 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T22:51:22.738 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T22:51:22.739 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-06-02T22:51:22.739 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T22:51:22.739 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T22:51:22.739 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T22:51:22.739 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T22:51:23.178 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-06-02T22:51:23.180 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-06-02T22:51:23.180 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-06-02T22:51:23.277 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-06-02T22:51:23.306 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-06-02T22:51:23.370 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T22:51:23.370 INFO:tasks.ceph:role: osd.6 2024-06-02T22:51:23.370 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:51:23.370 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-02T22:51:23.443 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T22:51:23.443 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T22:51:23.443 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T22:51:23.443 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T22:51:23.443 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T22:51:23.443 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-06-02T22:51:23.444 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T22:51:23.444 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T22:51:23.444 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T22:51:23.444 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T22:51:23.937 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-06-02T22:51:23.939 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-06-02T22:51:23.939 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-06-02T22:51:24.074 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-06-02T22:51:24.106 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-06-02T22:51:24.172 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T22:51:24.172 INFO:tasks.ceph:role: osd.7 2024-06-02T22:51:24.172 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:51:24.172 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-02T22:51:24.244 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T22:51:24.244 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T22:51:24.244 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T22:51:24.244 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T22:51:24.244 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T22:51:24.244 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-06-02T22:51:24.245 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T22:51:24.245 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T22:51:24.245 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T22:51:24.245 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T22:51:24.719 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-06-02T22:51:24.721 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-06-02T22:51:24.721 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-06-02T22:51:24.843 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-06-02T22:51:24.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:24.969 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:24.968+0000 7f4884418640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-06-02T22:51:24.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:24.969+0000 7f4884418640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-06-02T22:51:24.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:24.969+0000 7f4884418640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-02T22:51:24.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:24.969+0000 7f4884418640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-02T22:51:24.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:24.969+0000 7f4884418640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-02T22:51:24.971 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:24.970+0000 7f4884418640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-06-02T22:51:27.821 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-02T22:51:27.852 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:27.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:27.945+0000 7fc3c625d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-06-02T22:51:27.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:27.946+0000 7fc3c625d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-06-02T22:51:27.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:27.946+0000 7fc3c625d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-02T22:51:27.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:27.946+0000 7fc3c625d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-02T22:51:27.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:27.946+0000 7fc3c625d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-02T22:51:27.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:27.946+0000 7fc3c625d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-06-02T22:51:30.795 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-02T22:51:30.824 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:30.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:30.918+0000 7f39fe3ad640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-06-02T22:51:30.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:30.918+0000 7f39fe3ad640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-06-02T22:51:30.919 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:30.918+0000 7f39fe3ad640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-02T22:51:30.919 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:30.918+0000 7f39fe3ad640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-02T22:51:30.919 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:30.918+0000 7f39fe3ad640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-02T22:51:30.919 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:30.919+0000 7f39fe3ad640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-06-02T22:51:33.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:51:33.524 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:51:33.778 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-02T22:51:33.804 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:33.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:33.892+0000 7fe797901640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-06-02T22:51:33.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:33.892+0000 7fe797901640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-06-02T22:51:33.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:33.892+0000 7fe797901640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-02T22:51:33.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:33.892+0000 7fe797901640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-02T22:51:33.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:33.892+0000 7fe797901640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-02T22:51:33.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:33.893+0000 7fe797901640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-06-02T22:51:36.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-02T22:51:36.777 INFO:tasks.ceph:Reading keys from all nodes... 2024-06-02T22:51:36.778 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:36.778 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-06-02T22:51:36.808 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:36.808 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-06-02T22:51:36.875 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:36.876 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-06-02T22:51:36.942 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:36.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-06-02T22:51:37.010 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:37.010 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-06-02T22:51:37.077 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:37.077 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-06-02T22:51:37.143 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:37.160 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-06-02T22:51:37.208 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:37.209 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-06-02T22:51:37.239 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:37.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-06-02T22:51:37.308 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:37.308 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-06-02T22:51:37.378 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:37.378 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-06-02T22:51:37.447 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:37.447 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-06-02T22:51:37.515 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:37.515 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-06-02T22:51:37.582 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:37.582 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-06-02T22:51:37.648 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:37.648 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-06-02T22:51:37.665 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:37.665 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-06-02T22:51:37.722 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:37.722 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-06-02T22:51:37.738 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:37.738 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-06-02T22:51:37.794 INFO:tasks.ceph:Adding keys to all mons... 2024-06-02T22:51:37.794 DEBUG:teuthology.orchestra.run.smithi082:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-02T22:51:37.796 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-02T22:51:37.837 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.y] 2024-06-02T22:51:37.838 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xmnhQdARAAmNiCMML2eHb0wcNAW45Fyw== 2024-06-02T22:51:37.838 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-06-02T22:51:37.838 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm0JTKCBAAndEAxOeEeclgFu+ITHYS5g== 2024-06-02T22:51:37.838 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-06-02T22:51:37.838 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xmYVVpEBAA+49UXndP6JiF1dcwkBFqlw== 2024-06-02T22:51:37.838 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.0] 2024-06-02T22:51:37.838 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBd91xmEasoOhAAn6YZXmsI4CVreLyIC30o4Q== 2024-06-02T22:51:37.838 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.1] 2024-06-02T22:51:37.838 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBg91xmJdkfORAA0rRjyHkrw/mK6gUgZvQNBA== 2024-06-02T22:51:37.838 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.2] 2024-06-02T22:51:37.838 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBj91xmeTPxNhAAooQjxmZuy8trF6vOdHJTiA== 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.3] 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBm91xmcjbGNRAAuvxHJk3NYqJ6qFVwfN4pTg== 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.x] 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm8/dxBRAAav4Fr7WoUlsnw8abkaZlTA== 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xmuZhxFRAA/Sj+Z2Hh0XmmMLB27h+SgA== 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xmf4THHBAAXUhfYk2mRNxtPj5B4HHVZQ== 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.4] 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBs91xmCHjaORAA3dKnGKAZH64lFFq2rkReiA== 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.5] 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBv91xmaeZ7OBAAs12vs2Jp8AB/3/Pjp3fHEQ== 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.6] 2024-06-02T22:51:37.839 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBy91xmTfXNNhAAXYTITs5gu0klkjGHWW4s2Q== 2024-06-02T22:51:37.840 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.7] 2024-06-02T22:51:37.840 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQB191xm/2M9NRAAg194AhFY+9WbbJ/9DufSMw== 2024-06-02T22:51:37.840 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-06-02T22:51:37.840 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g== 2024-06-02T22:51:37.840 INFO:teuthology.orchestra.run.smithi082.stdout:[client.2] 2024-06-02T22:51:37.840 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm352MJhAAEMeMOG4RTRYcbQU3S3v2MA== 2024-06-02T22:51:37.840 INFO:teuthology.orchestra.run.smithi082.stdout:[client.1] 2024-06-02T22:51:37.840 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xmDhLEKRAA9fyng5JM+1I/MYHEX3ITgw== 2024-06-02T22:51:37.840 INFO:teuthology.orchestra.run.smithi082.stdout:[client.3] 2024-06-02T22:51:37.840 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xmxPxRLxAAO6UAflCnHzmvq4DrYZfTKg== 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBa91xmnhQdARAAmNiCMML2eHb0wcNAW45Fyw== 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBa91xm0JTKCBAAndEAxOeEeclgFu+ITHYS5g== 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBa91xmYVVpEBAA+49UXndP6JiF1dcwkBFqlw== 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBd91xmEasoOhAAn6YZXmsI4CVreLyIC30o4Q== 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBg91xmJdkfORAA0rRjyHkrw/mK6gUgZvQNBA== 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBj91xmeTPxNhAAooQjxmZuy8trF6vOdHJTiA== 2024-06-02T22:51:37.859 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBm91xmcjbGNRAAuvxHJk3NYqJ6qFVwfN4pTg== 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBa91xm8/dxBRAAav4Fr7WoUlsnw8abkaZlTA== 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBa91xmuZhxFRAA/Sj+Z2Hh0XmmMLB27h+SgA== 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBa91xmf4THHBAAXUhfYk2mRNxtPj5B4HHVZQ== 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBs91xmCHjaORAA3dKnGKAZH64lFFq2rkReiA== 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBv91xmaeZ7OBAAs12vs2Jp8AB/3/Pjp3fHEQ== 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBy91xmTfXNNhAAXYTITs5gu0klkjGHWW4s2Q== 2024-06-02T22:51:37.860 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2024-06-02T22:51:37.861 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQB191xm/2M9NRAAg194AhFY+9WbbJ/9DufSMw== 2024-06-02T22:51:37.861 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2024-06-02T22:51:37.861 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g== 2024-06-02T22:51:37.861 INFO:teuthology.orchestra.run.smithi184.stdout:[client.2] 2024-06-02T22:51:37.861 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBa91xm352MJhAAEMeMOG4RTRYcbQU3S3v2MA== 2024-06-02T22:51:37.861 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2024-06-02T22:51:37.861 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBa91xmDhLEKRAA9fyng5JM+1I/MYHEX3ITgw== 2024-06-02T22:51:37.861 INFO:teuthology.orchestra.run.smithi184.stdout:[client.3] 2024-06-02T22:51:37.861 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBa91xmxPxRLxAAO6UAflCnHzmvq4DrYZfTKg== 2024-06-02T22:51:37.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T22:51:37.884 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T22:51:37.954 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T22:51:37.956 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T22:51:38.008 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T22:51:38.011 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T22:51:38.063 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.066 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.116 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.118 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.171 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.221 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.223 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.273 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T22:51:38.276 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T22:51:38.325 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T22:51:38.327 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T22:51:38.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T22:51:38.383 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T22:51:38.436 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.438 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.489 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.491 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.540 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.543 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.593 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.595 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T22:51:38.645 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T22:51:38.647 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T22:51:38.701 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T22:51:38.703 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T22:51:38.756 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T22:51:38.758 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T22:51:38.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T22:51:38.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T22:51:38.866 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-06-02T22:51:38.866 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-06-02T22:51:38.890 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-02T22:51:38.985 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-06-02T22:51:39.009 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-06-02T22:51:39.034 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-02T22:51:39.130 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-06-02T22:51:39.154 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-06-02T22:51:39.219 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-02T22:51:39.313 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-06-02T22:51:39.337 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:39.339 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-02T22:51:39.392 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-06-02T22:51:39.392 INFO:tasks.ceph.mon.a:Restarting daemon 2024-06-02T22:51:39.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-06-02T22:51:39.395 INFO:tasks.ceph.mon.a:Started 2024-06-02T22:51:39.395 INFO:tasks.ceph.mon.b:Restarting daemon 2024-06-02T22:51:39.395 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-06-02T22:51:39.434 INFO:tasks.ceph.mon.b:Started 2024-06-02T22:51:39.435 INFO:tasks.ceph.mon.c:Restarting daemon 2024-06-02T22:51:39.435 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-06-02T22:51:39.436 INFO:tasks.ceph.mon.c:Started 2024-06-02T22:51:39.437 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-06-02T22:51:39.437 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-06-02T22:51:39.437 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-06-02T22:51:39.439 INFO:tasks.ceph.mgr.y:Started 2024-06-02T22:51:39.439 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-06-02T22:51:39.439 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-06-02T22:51:39.441 INFO:tasks.ceph.mgr.x:Started 2024-06-02T22:51:39.441 INFO:tasks.ceph:Setting crush tunables to default 2024-06-02T22:51:39.441 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd crush tunables default 2024-06-02T22:51:39.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.541+0000 7f170da8c640 1 Processor -- start 2024-06-02T22:51:39.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.541+0000 7f170da8c640 1 -- start start 2024-06-02T22:51:39.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.541+0000 7f170da8c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1708147a60 0x7f170806fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:39.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.541+0000 7f170da8c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 0x7f170806b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:39.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.541+0000 7f170da8c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f170806eb50 con 0x7f170806de60 2024-06-02T22:51:39.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.541+0000 7f170da8c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f170806bd60 con 0x7f1708147a60 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.541+0000 7f170da8c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f170806ee30 con 0x7f170806b3c0 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f17077fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1708147a60 0x7f170806fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f1707fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f170806de60 0x7f170806e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35494/0 (socket says 172.21.15.82:35494) 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f1707fff640 1 -- 172.21.15.82:0/2907799978 learned_addr learned my addr 172.21.15.82:0/2907799978 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f17077fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1708147a60 0x7f170806fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40476/0 (socket says 172.21.15.82:40476) 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f17077fe640 1 -- 172.21.15.82:0/2907799978 >> v2:172.21.15.82:3300/0 conn(0x7f1708147a60 msgr2=0x7f170806fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f17077fe640 1 -- 172.21.15.82:0/2907799978 >> v2:172.21.15.82:3300/0 conn(0x7f1708147a60 msgr2=0x7f170806fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f17077fe640 1 --2- 172.21.15.82:0/2907799978 >> v2:172.21.15.82:3300/0 conn(0x7f1708147a60 0x7f170806fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f17077fe640 1 --2- 172.21.15.82:0/2907799978 >> v2:172.21.15.82:3300/0 conn(0x7f1708147a60 0x7f170806fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f16fffff640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 0x7f170806b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f16fffff640 1 -- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 msgr2=0x7f170806b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f16fffff640 1 -- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 msgr2=0x7f170806b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f16fffff640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 0x7f170806b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T22:51:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.542+0000 7f16fffff640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 0x7f170806b820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T22:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2585988400 0 0) 0x7f170806eb50 con 0x7f170806de60 2024-06-02T22:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16f4003520 con 0x7f170806de60 2024-06-02T22:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 315159599 0 0) 0x7f16f4003520 con 0x7f170806de60 2024-06-02T22:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 msgr2=0x7f170806b820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 0x7f170806b820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 >> v2:172.21.15.82:3300/0 conn(0x7f1708147a60 msgr2=0x7f170806fbf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 --2- 172.21.15.82:0/2907799978 >> v2:172.21.15.82:3300/0 conn(0x7f1708147a60 0x7f170806fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170806f110 con 0x7f170806de60 2024-06-02T22:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f17000019f0 con 0x7f170806de60 2024-06-02T22:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 >> v1:172.21.15.82:6789/0 conn(0x7f170806de60 legacy=0x7f170806e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 0x7f16f40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16f4003fe0 0x7f16f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16f4004d40 0x7f16f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f170806ee30 con 0x7f16f4003fe0 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f16f400bb00 con 0x7f16f4004d40 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.700+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f16f400bd00 con 0x7f170806b3c0 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.701+0000 7f17077fe640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 0x7f16f40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.701+0000 7f16fffff640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16f4003fe0 0x7f16f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.701+0000 7f1707fff640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16f4004d40 0x7f16f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.701+0000 7f17077fe640 1 -- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16f4004d40 msgr2=0x7f16f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.701+0000 7f17077fe640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16f4004d40 0x7f16f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.701+0000 7f17077fe640 1 -- 172.21.15.82:0/2907799978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16f4003fe0 msgr2=0x7f16f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.701+0000 7f17077fe640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16f4003fe0 0x7f16f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.701+0000 7f17077fe640 1 -- 172.21.15.82:0/2907799978 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f4003520 con 0x7f170806b3c0 2024-06-02T22:51:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.701+0000 7f16fffff640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16f4003fe0 0x7f16f4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:51:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.702+0000 7f17077fe640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 0x7f16f40039b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f16f800b9e0 tx=0x7f16f4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bba0be057db68bbd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.702+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8030070 con 0x7f170806b3c0 2024-06-02T22:51:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.702+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f802adb0 con 0x7f170806b3c0 2024-06-02T22:51:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.702+0000 7f1706ffd640 1 -- 172.21.15.82:0/2907799978 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f800b5e0 con 0x7f170806b3c0 2024-06-02T22:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.703+0000 7f170da8c640 1 -- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 msgr2=0x7f16f40039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.703+0000 7f170da8c640 1 --2- 172.21.15.82:0/2907799978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170806b3c0 0x7f16f40039b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f16f800b9e0 tx=0x7f16f4005830 comp rx=0 tx=0).stop 2024-06-02T22:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.703+0000 7f1707fff640 1 -- 172.21.15.82:0/2907799978 reap_dead start 2024-06-02T22:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.703+0000 7f170da8c640 1 -- 172.21.15.82:0/2907799978 shutdown_connections 2024-06-02T22:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.703+0000 7f170da8c640 1 -- 172.21.15.82:0/2907799978 >> 172.21.15.82:0/2907799978 conn(0x7f170806cff0 msgr2=0x7f17080b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.703+0000 7f170da8c640 1 -- 172.21.15.82:0/2907799978 shutdown_connections 2024-06-02T22:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.703+0000 7f170da8c640 1 -- 172.21.15.82:0/2907799978 wait complete. 2024-06-02T22:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.704+0000 7f170da8c640 1 Processor -- start 2024-06-02T22:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.704+0000 7f170da8c640 1 -- start start 2024-06-02T22:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f170da8c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f170806b3c0 0x7f17080cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f170da8c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17081f7ac0 0x7f17081601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f170da8c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17081f7f40 0x7f1708160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f170da8c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f17080702b0 con 0x7f170806b3c0 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f170da8c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1708070130 con 0x7f17081f7f40 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f170da8c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f170806b820 con 0x7f17081f7ac0 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f17077fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f170806b3c0 0x7f17080cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f17077fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f170806b3c0 0x7f17080cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40488/0 (socket says 172.21.15.82:40488) 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f17077fe640 1 -- 172.21.15.82:0/1598135616 learned_addr learned my addr 172.21.15.82:0/1598135616 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f16fffff640 1 --2- 172.21.15.82:0/1598135616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17081f7ac0 0x7f17081601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f1707fff640 1 --2- 172.21.15.82:0/1598135616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17081f7f40 0x7f1708160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f17077fe640 1 -- 172.21.15.82:0/1598135616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17081f7ac0 msgr2=0x7f17081601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f17077fe640 1 --2- 172.21.15.82:0/1598135616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17081f7ac0 0x7f17081601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f17077fe640 1 -- 172.21.15.82:0/1598135616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17081f7f40 msgr2=0x7f1708160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f17077fe640 1 --2- 172.21.15.82:0/1598135616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17081f7f40 0x7f1708160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f17077fe640 1 -- 172.21.15.82:0/1598135616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17080c68b0 con 0x7f170806b3c0 2024-06-02T22:51:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.705+0000 7f16fffff640 1 --2- 172.21.15.82:0/1598135616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17081f7ac0 0x7f17081601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:51:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.706+0000 7f17077fe640 1 --2- 172.21.15.82:0/1598135616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f170806b3c0 0x7f17080cf9b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f16f800bb00 tx=0x7f16f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.706+0000 7f1704ff9640 1 -- 172.21.15.82:0/1598135616 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8043020 con 0x7f170806b3c0 2024-06-02T22:51:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.706+0000 7f1704ff9640 1 -- 172.21.15.82:0/1598135616 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f803f680 con 0x7f170806b3c0 2024-06-02T22:51:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.706+0000 7f1704ff9640 1 -- 172.21.15.82:0/1598135616 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f800b5e0 con 0x7f170806b3c0 2024-06-02T22:51:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.706+0000 7f170da8c640 1 -- 172.21.15.82:0/1598135616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17080c6b90 con 0x7f170806b3c0 2024-06-02T22:51:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.706+0000 7f170da8c640 1 -- 172.21.15.82:0/1598135616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17081420c0 con 0x7f170806b3c0 2024-06-02T22:51:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.706+0000 7f1704ff9640 1 -- 172.21.15.82:0/1598135616 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f16f8046020 con 0x7f170806b3c0 2024-06-02T22:51:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.706+0000 7f1704ff9640 1 -- 172.21.15.82:0/1598135616 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f16f803dc10 con 0x7f170806b3c0 2024-06-02T22:51:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.707+0000 7f170da8c640 1 -- 172.21.15.82:0/1598135616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f170806bbf0 con 0x7f170806b3c0 2024-06-02T22:51:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.709+0000 7f1704ff9640 1 -- 172.21.15.82:0/1598135616 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f170806bbf0 con 0x7f170806b3c0 2024-06-02T22:51:39.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.775+0000 7f170da8c640 1 -- 172.21.15.82:0/1598135616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1708068ad0 con 0x7f170806b3c0 2024-06-02T22:51:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.776+0000 7f1704ff9640 1 -- 172.21.15.82:0/1598135616 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f16f804d030 con 0x7f170806b3c0 2024-06-02T22:51:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2024-06-02T22:51:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.777+0000 7f170da8c640 1 -- 172.21.15.82:0/1598135616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f170806b3c0 msgr2=0x7f17080cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.777+0000 7f170da8c640 1 --2- 172.21.15.82:0/1598135616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f170806b3c0 0x7f17080cf9b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f16f800bb00 tx=0x7f16f8004730 comp rx=0 tx=0).stop 2024-06-02T22:51:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.777+0000 7f170da8c640 1 -- 172.21.15.82:0/1598135616 shutdown_connections 2024-06-02T22:51:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.777+0000 7f170da8c640 1 --2- 172.21.15.82:0/1598135616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17081f7f40 0x7f1708160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.777+0000 7f170da8c640 1 --2- 172.21.15.82:0/1598135616 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17081f7ac0 0x7f17081601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.777+0000 7f170da8c640 1 --2- 172.21.15.82:0/1598135616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f170806b3c0 0x7f17080cf9b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.777+0000 7f170da8c640 1 -- 172.21.15.82:0/1598135616 >> 172.21.15.82:0/1598135616 conn(0x7f170806cff0 msgr2=0x7f17080b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.777+0000 7f170da8c640 1 -- 172.21.15.82:0/1598135616 shutdown_connections 2024-06-02T22:51:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:39.777+0000 7f170da8c640 1 -- 172.21.15.82:0/1598135616 wait complete. 2024-06-02T22:51:39.788 INFO:tasks.ceph:check_enable_crimson: False 2024-06-02T22:51:39.788 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-06-02T22:51:39.788 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:39.788 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-06-02T22:51:39.806 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:39.807+0000 7f7cec013040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T22:51:39.813 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:39.813 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-06-02T22:51:39.823 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:39.824+0000 7f1b0231c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T22:51:39.878 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:39.878 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-06-02T22:51:39.942 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:51:39.942 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-06-02T22:51:39.969 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:39.969+0000 7f7cec013040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:51:39.978 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:39.979+0000 7f1b0231c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:51:39.993 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:39.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-06-02T22:51:40.019 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:40.019 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-06-02T22:51:40.024 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:40.025+0000 7f7cec013040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T22:51:40.034 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:40.034+0000 7f1b0231c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T22:51:40.058 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:40.058 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-06-02T22:51:40.124 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:51:40.124 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-06-02T22:51:40.189 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new d2b6a99b-23c8-4269-95f5-6363b40a6721 0 2024-06-02T22:51:40.274 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:40.274+0000 7f7cec013040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T22:51:40.298 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:40.298+0000 7f1b0231c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T22:51:40.318 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:40.318+0000 7f7cec013040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T22:51:40.329 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.329+0000 7f80287af640 1 Processor -- start 2024-06-02T22:51:40.329 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.329+0000 7f80287af640 1 -- start start 2024-06-02T22:51:40.330 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.330+0000 7f80287af640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f802006bad0 0x7f80200affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.330 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.330+0000 7f80287af640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8020072cf0 0x7f80200ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.330 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.330+0000 7f80287af640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80200b0690 con 0x7f8020070540 2024-06-02T22:51:40.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.330+0000 7f80287af640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f8020071fc0 con 0x7f8020072cf0 2024-06-02T22:51:40.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.330+0000 7f80287af640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8020072210 con 0x7f802006bad0 2024-06-02T22:51:40.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.330+0000 7f8026d4c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8020072cf0 0x7f80200ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.330+0000 7f8025d4a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f802006bad0 0x7f80200affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.330+0000 7f8026d4c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8020072cf0 0x7f80200ae730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:44270/0 (socket says 172.21.15.184:44270) 2024-06-02T22:51:40.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.330+0000 7f8026d4c640 1 -- 172.21.15.184:0/2299069011 learned_addr learned my addr 172.21.15.184:0/2299069011 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-02T22:51:40.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.331+0000 7f8026d4c640 1 -- 172.21.15.184:0/2299069011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f802006bad0 msgr2=0x7f80200affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:40.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.331+0000 7f8026d4c640 1 --2- 172.21.15.184:0/2299069011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f802006bad0 0x7f80200affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.331+0000 7f8026d4c640 1 -- 172.21.15.184:0/2299069011 >> v1:172.21.15.82:6789/0 conn(0x7f8020070540 legacy=0x7f802006b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.331+0000 7f8026d4c640 1 -- 172.21.15.184:0/2299069011 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80200724f0 con 0x7f8020072cf0 2024-06-02T22:51:40.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.331+0000 7f8025d4a640 1 --2- 172.21.15.184:0/2299069011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f802006bad0 0x7f80200affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:51:40.332 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.331+0000 7f8026d4c640 1 --2- 172.21.15.184:0/2299069011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8020072cf0 0x7f80200ae730 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8018009e50 tx=0x7f801802a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e7bd0ca0ba41616 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:40.332 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.331+0000 7f8025549640 1 -- 172.21.15.184:0/2299069011 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018036070 con 0x7f8020072cf0 2024-06-02T22:51:40.333 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.331+0000 7f8025549640 1 -- 172.21.15.184:0/2299069011 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8018031600 con 0x7f8020072cf0 2024-06-02T22:51:40.333 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.331+0000 7f8025549640 1 -- 172.21.15.184:0/2299069011 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80180319d0 con 0x7f8020072cf0 2024-06-02T22:51:40.333 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.332+0000 7f80287af640 1 -- 172.21.15.184:0/2299069011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8020072cf0 msgr2=0x7f80200ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.333 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.332+0000 7f80287af640 1 --2- 172.21.15.184:0/2299069011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8020072cf0 0x7f80200ae730 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8018009e50 tx=0x7f801802a610 comp rx=0 tx=0).stop 2024-06-02T22:51:40.333 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.332+0000 7f80287af640 1 -- 172.21.15.184:0/2299069011 shutdown_connections 2024-06-02T22:51:40.333 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.332+0000 7f80287af640 1 --2- 172.21.15.184:0/2299069011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8020072cf0 0x7f80200ae730 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.333 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.332+0000 7f80287af640 1 --2- 172.21.15.184:0/2299069011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f802006bad0 0x7f80200affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.333 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.332+0000 7f80287af640 1 -- 172.21.15.184:0/2299069011 >> 172.21.15.184:0/2299069011 conn(0x7f80200b2a70 msgr2=0x7f80200b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:40.333 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.332+0000 7f80287af640 1 -- 172.21.15.184:0/2299069011 shutdown_connections 2024-06-02T22:51:40.333 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.332+0000 7f80287af640 1 -- 172.21.15.184:0/2299069011 wait complete. 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.333+0000 7f80287af640 1 Processor -- start 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.333+0000 7f80287af640 1 -- start start 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f80287af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f802006bad0 0x7f80201f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f80287af640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8020070540 0x7f80200cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f80287af640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8020072cf0 0x7f80200ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f80287af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8020070920 con 0x7f802006bad0 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f80287af640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8020147cd0 con 0x7f8020070540 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f80287af640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f80200b4260 con 0x7f8020072cf0 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f8025d4a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8020070540 0x7f80200cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f8025d4a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8020070540 0x7f80200cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:44278/0 (socket says 172.21.15.184:44278) 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f8026d4c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8020072cf0 0x7f80200ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f8025d4a640 1 -- 172.21.15.184:0/1011876180 learned_addr learned my addr 172.21.15.184:0/1011876180 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-02T22:51:40.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f802654b640 1 --2- 172.21.15.184:0/1011876180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f802006bad0 0x7f80201f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f8025d4a640 1 -- 172.21.15.184:0/1011876180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8020072cf0 msgr2=0x7f80200ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f8025d4a640 1 --2- 172.21.15.184:0/1011876180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8020072cf0 0x7f80200ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f8025d4a640 1 -- 172.21.15.184:0/1011876180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f802006bad0 msgr2=0x7f80201f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f8025d4a640 1 --2- 172.21.15.184:0/1011876180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f802006bad0 0x7f80201f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.334+0000 7f8025d4a640 1 -- 172.21.15.184:0/1011876180 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80200cde30 con 0x7f8020070540 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.335+0000 7f8025d4a640 1 --2- 172.21.15.184:0/1011876180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8020070540 0x7f80200cf690 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f801c00ebe0 tx=0x7f801c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.335+0000 7f8016ffd640 1 -- 172.21.15.184:0/1011876180 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c017070 con 0x7f8020070540 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.335+0000 7f8016ffd640 1 -- 172.21.15.184:0/1011876180 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801c00cc30 con 0x7f8020070540 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.335+0000 7f80287af640 1 -- 172.21.15.184:0/1011876180 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80200ce110 con 0x7f8020070540 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.335+0000 7f8016ffd640 1 -- 172.21.15.184:0/1011876180 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c013470 con 0x7f8020070540 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.335+0000 7f80287af640 1 -- 172.21.15.184:0/1011876180 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80200ce6d0 con 0x7f8020070540 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.335+0000 7f8016ffd640 1 -- 172.21.15.184:0/1011876180 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f801c01a070 con 0x7f8020070540 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.335+0000 7f8016ffd640 1 -- 172.21.15.184:0/1011876180 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f801c013de0 con 0x7f8020070540 2024-06-02T22:51:40.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.336+0000 7f80287af640 1 -- 172.21.15.184:0/1011876180 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8020068ad0 con 0x7f8020070540 2024-06-02T22:51:40.338 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.338+0000 7f8016ffd640 1 -- 172.21.15.184:0/1011876180 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f801c005990 con 0x7f8020070540 2024-06-02T22:51:40.347 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:40.347+0000 7f1b0231c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T22:51:40.410 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.410+0000 7f80287af640 1 -- 172.21.15.184:0/1011876180 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2b6a99b-23c8-4269-95f5-6363b40a6721", "id": 0} v 0) -- 0x7f802006c2b0 con 0x7f8020070540 2024-06-02T22:51:40.416 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.416+0000 7f8016ffd640 1 -- 172.21.15.184:0/1011876180 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2b6a99b-23c8-4269-95f5-6363b40a6721", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f801c005b70 con 0x7f8020070540 2024-06-02T22:51:40.416 INFO:teuthology.orchestra.run.smithi184.stdout:0 2024-06-02T22:51:40.417 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.417+0000 7f80287af640 1 -- 172.21.15.184:0/1011876180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8020070540 msgr2=0x7f80200cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.417 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.417+0000 7f80287af640 1 --2- 172.21.15.184:0/1011876180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8020070540 0x7f80200cf690 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f801c00ebe0 tx=0x7f801c00c520 comp rx=0 tx=0).stop 2024-06-02T22:51:40.417 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.417+0000 7f80287af640 1 -- 172.21.15.184:0/1011876180 shutdown_connections 2024-06-02T22:51:40.417 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.417+0000 7f80287af640 1 --2- 172.21.15.184:0/1011876180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8020072cf0 0x7f80200ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.417 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.417+0000 7f80287af640 1 --2- 172.21.15.184:0/1011876180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8020070540 0x7f80200cf690 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.417 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.417+0000 7f80287af640 1 --2- 172.21.15.184:0/1011876180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f802006bad0 0x7f80201f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.418 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.417+0000 7f80287af640 1 -- 172.21.15.184:0/1011876180 >> 172.21.15.184:0/1011876180 conn(0x7f80200b2a70 msgr2=0x7f802006b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:40.418 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.417+0000 7f80287af640 1 -- 172.21.15.184:0/1011876180 shutdown_connections 2024-06-02T22:51:40.418 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.417+0000 7f80287af640 1 -- 172.21.15.184:0/1011876180 wait complete. 2024-06-02T22:51:40.428 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new d3f7e607-2b7f-4ec6-9af3-75b45c024c79 1 2024-06-02T22:51:40.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.527+0000 7f98d9e10640 1 Processor -- start 2024-06-02T22:51:40.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.527+0000 7f98d9e10640 1 -- start start 2024-06-02T22:51:40.528 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.528+0000 7f98d9e10640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f98d406b630 0x7f98d415f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.528 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.528+0000 7f98d9e10640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406ba10 0x7f98d41584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.528+0000 7f98d9e10640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98d40b06e0 con 0x7f98d406f9d0 2024-06-02T22:51:40.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.528+0000 7f98d9e10640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f98d40cf340 con 0x7f98d406b630 2024-06-02T22:51:40.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.528+0000 7f98d9e10640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f98d40721e0 con 0x7f98d406ba10 2024-06-02T22:51:40.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.528+0000 7f98d3fff640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406ba10 0x7f98d41584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.528+0000 7f98cbfff640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f98d406f9d0 0x7f98d40cec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:60118/0 (socket says 172.21.15.184:60118) 2024-06-02T22:51:40.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.528+0000 7f98d37fe640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f98d406b630 0x7f98d415f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.528+0000 7f98cbfff640 1 -- 172.21.15.184:0/2189901701 learned_addr learned my addr 172.21.15.184:0/2189901701 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-06-02T22:51:40.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.529+0000 7f98d3fff640 1 -- 172.21.15.184:0/2189901701 >> v2:172.21.15.184:3300/0 conn(0x7f98d406b630 msgr2=0x7f98d415f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:40.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.529+0000 7f98d3fff640 1 --2- 172.21.15.184:0/2189901701 >> v2:172.21.15.184:3300/0 conn(0x7f98d406b630 0x7f98d415f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.529+0000 7f98d3fff640 1 -- 172.21.15.184:0/2189901701 >> v1:172.21.15.184:6789/0 conn(0x7f98d406f9d0 legacy=0x7f98d40cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.529+0000 7f98d3fff640 1 -- 172.21.15.184:0/2189901701 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d40b0120 con 0x7f98d406ba10 2024-06-02T22:51:40.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.529+0000 7f98d37fe640 1 --2- 172.21.15.184:0/2189901701 >> v2:172.21.15.184:3300/0 conn(0x7f98d406b630 0x7f98d415f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.530+0000 7f98d3fff640 1 --2- 172.21.15.184:0/2189901701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406ba10 0x7f98d41584a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009d90 tx=0x7f98cc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba4107671d98e6a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.530+0000 7f98d2ffd640 1 -- 172.21.15.184:0/2189901701 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98cc007740 con 0x7f98d406ba10 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.530+0000 7f98d2ffd640 1 -- 172.21.15.184:0/2189901701 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98cc0078e0 con 0x7f98d406ba10 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.530+0000 7f98d2ffd640 1 -- 172.21.15.184:0/2189901701 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98cc007cb0 con 0x7f98d406ba10 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.530+0000 7f98d9e10640 1 -- 172.21.15.184:0/2189901701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406ba10 msgr2=0x7f98d41584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.530+0000 7f98d9e10640 1 --2- 172.21.15.184:0/2189901701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406ba10 0x7f98d41584a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98cc009d90 tx=0x7f98cc02a660 comp rx=0 tx=0).stop 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.531+0000 7f98d9e10640 1 -- 172.21.15.184:0/2189901701 shutdown_connections 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.531+0000 7f98d9e10640 1 --2- 172.21.15.184:0/2189901701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406ba10 0x7f98d41584a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.531+0000 7f98d9e10640 1 --2- 172.21.15.184:0/2189901701 >> v2:172.21.15.184:3300/0 conn(0x7f98d406b630 0x7f98d415f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.531+0000 7f98d9e10640 1 -- 172.21.15.184:0/2189901701 >> 172.21.15.184:0/2189901701 conn(0x7f98d40b2ae0 msgr2=0x7f98d40b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.531+0000 7f98d9e10640 1 -- 172.21.15.184:0/2189901701 shutdown_connections 2024-06-02T22:51:40.531 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.531+0000 7f98d9e10640 1 -- 172.21.15.184:0/2189901701 wait complete. 2024-06-02T22:51:40.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.532+0000 7f98d9e10640 1 Processor -- start 2024-06-02T22:51:40.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.532+0000 7f98d9e10640 1 -- start start 2024-06-02T22:51:40.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d9e10640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406b630 0x7f98d4156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d9e10640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98d406ba10 0x7f98d414a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d9e10640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98d406f9d0 0x7f98d414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d9e10640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f98d406ff40 con 0x7f98d406ba10 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d9e10640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f98d406e300 con 0x7f98d406f9d0 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d9e10640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f98d41589e0 con 0x7f98d406b630 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d37fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406b630 0x7f98d4156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d37fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406b630 0x7f98d4156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:34276/0 (socket says 172.21.15.184:34276) 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d37fe640 1 -- 172.21.15.184:0/2346642038 learned_addr learned my addr 172.21.15.184:0/2346642038 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d3fff640 1 --2- 172.21.15.184:0/2346642038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98d406f9d0 0x7f98d414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98cbfff640 1 --2- 172.21.15.184:0/2346642038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98d406ba10 0x7f98d414a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d37fe640 1 -- 172.21.15.184:0/2346642038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98d406f9d0 msgr2=0x7f98d414a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d37fe640 1 --2- 172.21.15.184:0/2346642038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98d406f9d0 0x7f98d414a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d37fe640 1 -- 172.21.15.184:0/2346642038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98d406ba10 msgr2=0x7f98d414a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d37fe640 1 --2- 172.21.15.184:0/2346642038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98d406ba10 0x7f98d414a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d37fe640 1 -- 172.21.15.184:0/2346642038 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d4159a00 con 0x7f98d406b630 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d37fe640 1 --2- 172.21.15.184:0/2346642038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406b630 0x7f98d4156770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f98c400ebe0 tx=0x7f98c400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:40.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d0ff9640 1 -- 172.21.15.184:0/2346642038 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4017070 con 0x7f98d406b630 2024-06-02T22:51:40.536 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d0ff9640 1 -- 172.21.15.184:0/2346642038 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c400cc30 con 0x7f98d406b630 2024-06-02T22:51:40.536 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d9e10640 1 -- 172.21.15.184:0/2346642038 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d4159ce0 con 0x7f98d406b630 2024-06-02T22:51:40.536 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d0ff9640 1 -- 172.21.15.184:0/2346642038 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4013470 con 0x7f98d406b630 2024-06-02T22:51:40.536 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d9e10640 1 -- 172.21.15.184:0/2346642038 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d415a2a0 con 0x7f98d406b630 2024-06-02T22:51:40.536 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d0ff9640 1 -- 172.21.15.184:0/2346642038 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f98c401a070 con 0x7f98d406b630 2024-06-02T22:51:40.536 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.533+0000 7f98d0ff9640 1 -- 172.21.15.184:0/2346642038 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f98c401c8e0 con 0x7f98d406b630 2024-06-02T22:51:40.536 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.534+0000 7f98d9e10640 1 -- 172.21.15.184:0/2346642038 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d4068ad0 con 0x7f98d406b630 2024-06-02T22:51:40.536 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.536+0000 7f98d0ff9640 1 -- 172.21.15.184:0/2346642038 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f98c401cb30 con 0x7f98d406b630 2024-06-02T22:51:40.608 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.609+0000 7f98d9e10640 1 -- 172.21.15.184:0/2346642038 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d3f7e607-2b7f-4ec6-9af3-75b45c024c79", "id": 1} v 0) -- 0x7f98d4073300 con 0x7f98d406b630 2024-06-02T22:51:40.617 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.617+0000 7f98d0ff9640 1 -- 172.21.15.184:0/2346642038 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d3f7e607-2b7f-4ec6-9af3-75b45c024c79", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f98c401cd10 con 0x7f98d406b630 2024-06-02T22:51:40.617 INFO:teuthology.orchestra.run.smithi184.stdout:1 2024-06-02T22:51:40.618 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.618+0000 7f98d9e10640 1 -- 172.21.15.184:0/2346642038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406b630 msgr2=0x7f98d4156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.618 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.618+0000 7f98d9e10640 1 --2- 172.21.15.184:0/2346642038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406b630 0x7f98d4156770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f98c400ebe0 tx=0x7f98c400c520 comp rx=0 tx=0).stop 2024-06-02T22:51:40.618 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.618+0000 7f98d9e10640 1 -- 172.21.15.184:0/2346642038 shutdown_connections 2024-06-02T22:51:40.618 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.618+0000 7f98d9e10640 1 --2- 172.21.15.184:0/2346642038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98d406f9d0 0x7f98d414a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.619 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.618+0000 7f98d9e10640 1 --2- 172.21.15.184:0/2346642038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98d406ba10 0x7f98d414a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.619 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.618+0000 7f98d9e10640 1 --2- 172.21.15.184:0/2346642038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d406b630 0x7f98d4156770 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.619 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.618+0000 7f98d9e10640 1 -- 172.21.15.184:0/2346642038 >> 172.21.15.184:0/2346642038 conn(0x7f98d40b2ae0 msgr2=0x7f98d40cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:40.619 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.618+0000 7f98d9e10640 1 -- 172.21.15.184:0/2346642038 shutdown_connections 2024-06-02T22:51:40.619 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.618+0000 7f98d9e10640 1 -- 172.21.15.184:0/2346642038 wait complete. 2024-06-02T22:51:40.628 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 0f64f417-9df1-442e-af5c-37655eb0806b 2 2024-06-02T22:51:40.730 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.730+0000 7f3ec29d5640 1 Processor -- start 2024-06-02T22:51:40.730 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.730+0000 7f3ec29d5640 1 -- start start 2024-06-02T22:51:40.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ec29d5640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3ebc0b11c0 0x7f3ebc0d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ec29d5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 0x7f3ebc0cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ec29d5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc0d0d20 con 0x7f3ebc0d0400 2024-06-02T22:51:40.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ec29d5640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f3ebc0cf9f0 con 0x7f3ebc0b11c0 2024-06-02T22:51:40.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ec29d5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3ebc0cfcd0 con 0x7f3ebc0cd510 2024-06-02T22:51:40.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ec0f72640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 0x7f3ebc0cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ec0f72640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 0x7f3ebc0cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:34292/0 (socket says 172.21.15.184:34292) 2024-06-02T22:51:40.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ec0f72640 1 -- 172.21.15.184:0/3014676690 learned_addr learned my addr 172.21.15.184:0/3014676690 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-02T22:51:40.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ebb7fe640 1 --2- 172.21.15.184:0/3014676690 >> v2:172.21.15.184:3300/0 conn(0x7f3ebc0b11c0 0x7f3ebc0d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ebb7fe640 1 -- 172.21.15.184:0/3014676690 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 msgr2=0x7f3ebc0cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:40.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ebb7fe640 1 --2- 172.21.15.184:0/3014676690 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 0x7f3ebc0cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ebb7fe640 1 -- 172.21.15.184:0/3014676690 >> v1:172.21.15.82:6789/0 conn(0x7f3ebc0d0400 legacy=0x7f3ebc15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ebb7fe640 1 -- 172.21.15.184:0/3014676690 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ebc0cffb0 con 0x7f3ebc0b11c0 2024-06-02T22:51:40.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.732+0000 7f3ec0f72640 1 --2- 172.21.15.184:0/3014676690 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 0x7f3ebc0cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:51:40.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.733+0000 7f3ebb7fe640 1 --2- 172.21.15.184:0/3014676690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc0b11c0 0x7f3ebc0d07e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0097a0 tx=0x7f3eac02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ff9df42bbadd0a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:40.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.733+0000 7f3ebaffd640 1 -- 172.21.15.184:0/3014676690 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac037070 con 0x7f3ebc0b11c0 2024-06-02T22:51:40.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.733+0000 7f3ebaffd640 1 -- 172.21.15.184:0/3014676690 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eac02ae50 con 0x7f3ebc0b11c0 2024-06-02T22:51:40.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.733+0000 7f3ebaffd640 1 -- 172.21.15.184:0/3014676690 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac032660 con 0x7f3ebc0b11c0 2024-06-02T22:51:40.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.734+0000 7f3ec29d5640 1 -- 172.21.15.184:0/3014676690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc0b11c0 msgr2=0x7f3ebc0d07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.734+0000 7f3ec29d5640 1 --2- 172.21.15.184:0/3014676690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc0b11c0 0x7f3ebc0d07e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0097a0 tx=0x7f3eac02a100 comp rx=0 tx=0).stop 2024-06-02T22:51:40.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.734+0000 7f3ec29d5640 1 -- 172.21.15.184:0/3014676690 shutdown_connections 2024-06-02T22:51:40.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.734+0000 7f3ec29d5640 1 --2- 172.21.15.184:0/3014676690 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 0x7f3ebc0cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.734+0000 7f3ec29d5640 1 --2- 172.21.15.184:0/3014676690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc0b11c0 0x7f3ebc0d07e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.734+0000 7f3ec29d5640 1 -- 172.21.15.184:0/3014676690 >> 172.21.15.184:0/3014676690 conn(0x7f3ebc0b3970 msgr2=0x7f3ebc0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:40.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.734+0000 7f3ec29d5640 1 -- 172.21.15.184:0/3014676690 shutdown_connections 2024-06-02T22:51:40.736 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.734+0000 7f3ec29d5640 1 -- 172.21.15.184:0/3014676690 wait complete. 2024-06-02T22:51:40.736 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.736+0000 7f3ec29d5640 1 Processor -- start 2024-06-02T22:51:40.736 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.736+0000 7f3ec29d5640 1 -- start start 2024-06-02T22:51:40.739 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.737+0000 7f3ec29d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ebc0b11c0 0x7f3ebc14d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.739 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec29d5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 0x7f3ebc14da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.739 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec29d5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc0d0400 0x7f3ebc0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.739 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec29d5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ebc15c3d0 con 0x7f3ebc0b11c0 2024-06-02T22:51:40.739 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec29d5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3ebc0ccff0 con 0x7f3ebc0d0400 2024-06-02T22:51:40.739 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec29d5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3ebc0cc930 con 0x7f3ebc0cd510 2024-06-02T22:51:40.739 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec0f72640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc0d0400 0x7f3ebc0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.739 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec0f72640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc0d0400 0x7f3ebc0c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:44320/0 (socket says 172.21.15.184:44320) 2024-06-02T22:51:40.739 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec0f72640 1 -- 172.21.15.184:0/2994645210 learned_addr learned my addr 172.21.15.184:0/2994645210 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-02T22:51:40.739 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ebb7fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 0x7f3ebc14da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ebbfff640 1 --2- 172.21.15.184:0/2994645210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ebc0b11c0 0x7f3ebc14d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec0f72640 1 -- 172.21.15.184:0/2994645210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 msgr2=0x7f3ebc14da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec0f72640 1 --2- 172.21.15.184:0/2994645210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 0x7f3ebc14da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec0f72640 1 -- 172.21.15.184:0/2994645210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ebc0b11c0 msgr2=0x7f3ebc14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec0f72640 1 --2- 172.21.15.184:0/2994645210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ebc0b11c0 0x7f3ebc14d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec0f72640 1 -- 172.21.15.184:0/2994645210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ebc14d7b0 con 0x7f3ebc0d0400 2024-06-02T22:51:40.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec0f72640 1 --2- 172.21.15.184:0/2994645210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc0d0400 0x7f3ebc0c9900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400efc0 tx=0x7f3eb400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:40.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3eb8ff9640 1 -- 172.21.15.184:0/2994645210 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400cbe0 con 0x7f3ebc0d0400 2024-06-02T22:51:40.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3eb8ff9640 1 -- 172.21.15.184:0/2994645210 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb400cd80 con 0x7f3ebc0d0400 2024-06-02T22:51:40.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec29d5640 1 -- 172.21.15.184:0/2994645210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ebc0b5c10 con 0x7f3ebc0d0400 2024-06-02T22:51:40.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3eb8ff9640 1 -- 172.21.15.184:0/2994645210 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4003bb0 con 0x7f3ebc0d0400 2024-06-02T22:51:40.741 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.738+0000 7f3ec29d5640 1 -- 172.21.15.184:0/2994645210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ebc0b61b0 con 0x7f3ebc0d0400 2024-06-02T22:51:40.741 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.739+0000 7f3eb8ff9640 1 -- 172.21.15.184:0/2994645210 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3eb401b030 con 0x7f3ebc0d0400 2024-06-02T22:51:40.741 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.739+0000 7f3eb8ff9640 1 -- 172.21.15.184:0/2994645210 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f3eb4014c30 con 0x7f3ebc0d0400 2024-06-02T22:51:40.741 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.739+0000 7f3ec29d5640 1 -- 172.21.15.184:0/2994645210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ebc068ad0 con 0x7f3ebc0d0400 2024-06-02T22:51:40.741 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.741+0000 7f3eb8ff9640 1 -- 172.21.15.184:0/2994645210 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3eb4022020 con 0x7f3ebc0d0400 2024-06-02T22:51:40.813 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.814+0000 7f3ec29d5640 1 -- 172.21.15.184:0/2994645210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0f64f417-9df1-442e-af5c-37655eb0806b", "id": 2} v 0) -- 0x7f3ebc0b7da0 con 0x7f3ebc0d0400 2024-06-02T22:51:40.819 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.820+0000 7f3eb8ff9640 1 -- 172.21.15.184:0/2994645210 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f64f417-9df1-442e-af5c-37655eb0806b", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f3ebc14d7b0 con 0x7f3ebc0d0400 2024-06-02T22:51:40.820 INFO:teuthology.orchestra.run.smithi184.stdout:2 2024-06-02T22:51:40.821 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.820+0000 7f3ec29d5640 1 -- 172.21.15.184:0/2994645210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc0d0400 msgr2=0x7f3ebc0c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.821 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.820+0000 7f3ec29d5640 1 --2- 172.21.15.184:0/2994645210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc0d0400 0x7f3ebc0c9900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400efc0 tx=0x7f3eb400c490 comp rx=0 tx=0).stop 2024-06-02T22:51:40.821 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.820+0000 7f3ec29d5640 1 -- 172.21.15.184:0/2994645210 shutdown_connections 2024-06-02T22:51:40.821 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.820+0000 7f3ec29d5640 1 --2- 172.21.15.184:0/2994645210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc0d0400 0x7f3ebc0c9900 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.822 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.820+0000 7f3ec29d5640 1 --2- 172.21.15.184:0/2994645210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ebc0cd510 0x7f3ebc14da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.822 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.820+0000 7f3ec29d5640 1 --2- 172.21.15.184:0/2994645210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ebc0b11c0 0x7f3ebc14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.822 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.820+0000 7f3ec29d5640 1 -- 172.21.15.184:0/2994645210 >> 172.21.15.184:0/2994645210 conn(0x7f3ebc0b3970 msgr2=0x7f3ebc15b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:40.822 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.820+0000 7f3ec29d5640 1 -- 172.21.15.184:0/2994645210 shutdown_connections 2024-06-02T22:51:40.822 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.820+0000 7f3ec29d5640 1 -- 172.21.15.184:0/2994645210 wait complete. 2024-06-02T22:51:40.830 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new c8aa8753-58af-495d-9092-4c5f541a45fe 3 2024-06-02T22:51:40.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.941+0000 7f963e529640 1 Processor -- start 2024-06-02T22:51:40.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.941+0000 7f963e529640 1 -- start start 2024-06-02T22:51:40.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f963e529640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f963815c2c0 0x7f963806b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f963e529640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9638072950 0x7f96380b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f963e529640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96380ce900 con 0x7f963806b900 2024-06-02T22:51:40.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f963e529640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f96380b4ad0 con 0x7f963815c2c0 2024-06-02T22:51:40.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f963e529640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f96380cebe0 con 0x7f9638072950 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f96377fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9638072950 0x7f96380b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f963cac6640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f963806b900 0x7f96380718e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:60132/0 (socket says 172.21.15.184:60132) 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f963cac6640 1 -- 172.21.15.184:0/3039758742 learned_addr learned my addr 172.21.15.184:0/3039758742 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f9637fff640 1 --2- 172.21.15.184:0/3039758742 >> v2:172.21.15.82:3300/0 conn(0x7f963815c2c0 0x7f963806b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f96377fe640 1 -- 172.21.15.184:0/3039758742 >> v2:172.21.15.82:3300/0 conn(0x7f963815c2c0 msgr2=0x7f963806b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f96377fe640 1 --2- 172.21.15.184:0/3039758742 >> v2:172.21.15.82:3300/0 conn(0x7f963815c2c0 0x7f963806b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f96377fe640 1 -- 172.21.15.184:0/3039758742 >> v1:172.21.15.184:6789/0 conn(0x7f963806b900 legacy=0x7f96380718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.942+0000 7f9636ffd640 1 -- 172.21.15.184:0/3039758742 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 355393048 0 0) 0x7f96380ce900 con 0x7f963806b900 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.943+0000 7f96377fe640 1 -- 172.21.15.184:0/3039758742 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96380b4760 con 0x7f9638072950 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.943+0000 7f9637fff640 1 --2- 172.21.15.184:0/3039758742 >> v2:172.21.15.82:3300/0 conn(0x7f963815c2c0 0x7f963806b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.943+0000 7f96377fe640 1 --2- 172.21.15.184:0/3039758742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9638072950 0x7f96380b4f60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f962c0097a0 tx=0x7f962c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f07d227d8d1a31 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.943+0000 7f9636ffd640 1 -- 172.21.15.184:0/3039758742 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c037070 con 0x7f9638072950 2024-06-02T22:51:40.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.943+0000 7f9636ffd640 1 -- 172.21.15.184:0/3039758742 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962c032440 con 0x7f9638072950 2024-06-02T22:51:40.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.943+0000 7f9636ffd640 1 -- 172.21.15.184:0/3039758742 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c02ae60 con 0x7f9638072950 2024-06-02T22:51:40.948 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.944+0000 7f963e529640 1 -- 172.21.15.184:0/3039758742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9638072950 msgr2=0x7f96380b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.948 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.944+0000 7f963e529640 1 --2- 172.21.15.184:0/3039758742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9638072950 0x7f96380b4f60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f962c0097a0 tx=0x7f962c02a110 comp rx=0 tx=0).stop 2024-06-02T22:51:40.948 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.944+0000 7f963e529640 1 -- 172.21.15.184:0/3039758742 shutdown_connections 2024-06-02T22:51:40.948 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.944+0000 7f963e529640 1 --2- 172.21.15.184:0/3039758742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9638072950 0x7f96380b4f60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.948 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.944+0000 7f963e529640 1 --2- 172.21.15.184:0/3039758742 >> v2:172.21.15.82:3300/0 conn(0x7f963815c2c0 0x7f963806b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.948 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.944+0000 7f963e529640 1 -- 172.21.15.184:0/3039758742 >> 172.21.15.184:0/3039758742 conn(0x7f96380b22b0 msgr2=0x7f96380b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:40.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.944+0000 7f963e529640 1 -- 172.21.15.184:0/3039758742 shutdown_connections 2024-06-02T22:51:40.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.944+0000 7f963e529640 1 -- 172.21.15.184:0/3039758742 wait complete. 2024-06-02T22:51:40.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.945+0000 7f963e529640 1 Processor -- start 2024-06-02T22:51:40.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.945+0000 7f963e529640 1 -- start start 2024-06-02T22:51:40.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f963e529640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f963806b900 0x7f9638158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f963e529640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638072950 0x7f963815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f963e529640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f963815c2c0 0x7f963815ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:40.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f963e529640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9638072170 con 0x7f9638072950 2024-06-02T22:51:40.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f963e529640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9638071ff0 con 0x7f963806b900 2024-06-02T22:51:40.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f963e529640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f96380ce400 con 0x7f963815c2c0 2024-06-02T22:51:40.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f963cac6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f963815c2c0 0x7f963815ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f9637fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f963806b900 0x7f9638158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f963cac6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f963815c2c0 0x7f963815ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:34316/0 (socket says 172.21.15.184:34316) 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f9637fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f963806b900 0x7f9638158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:44324/0 (socket says 172.21.15.184:44324) 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f963cac6640 1 -- 172.21.15.184:0/3434333821 learned_addr learned my addr 172.21.15.184:0/3434333821 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.946+0000 7f96377fe640 1 --2- 172.21.15.184:0/3434333821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638072950 0x7f963815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f963cac6640 1 -- 172.21.15.184:0/3434333821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f963806b900 msgr2=0x7f9638158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f963cac6640 1 --2- 172.21.15.184:0/3434333821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f963806b900 0x7f9638158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f963cac6640 1 -- 172.21.15.184:0/3434333821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638072950 msgr2=0x7f963815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f963cac6640 1 --2- 172.21.15.184:0/3434333821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638072950 0x7f963815dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f963cac6640 1 -- 172.21.15.184:0/3434333821 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9638157990 con 0x7f963815c2c0 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f96377fe640 1 --2- 172.21.15.184:0/3434333821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638072950 0x7f963815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:51:40.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f963cac6640 1 --2- 172.21.15.184:0/3434333821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f963815c2c0 0x7f963815ebd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f963000c780 tx=0x7f963000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:40.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f9634ff9640 1 -- 172.21.15.184:0/3434333821 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630018070 con 0x7f963815c2c0 2024-06-02T22:51:40.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f9634ff9640 1 -- 172.21.15.184:0/3434333821 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9630004d60 con 0x7f963815c2c0 2024-06-02T22:51:40.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f9634ff9640 1 -- 172.21.15.184:0/3434333821 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963000a880 con 0x7f963815c2c0 2024-06-02T22:51:40.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f963e529640 1 -- 172.21.15.184:0/3434333821 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9638157c70 con 0x7f963815c2c0 2024-06-02T22:51:40.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f963e529640 1 -- 172.21.15.184:0/3434333821 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9638158230 con 0x7f963815c2c0 2024-06-02T22:51:40.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f9634ff9640 1 -- 172.21.15.184:0/3434333821 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f963000aa20 con 0x7f963815c2c0 2024-06-02T22:51:40.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.947+0000 7f9634ff9640 1 -- 172.21.15.184:0/3434333821 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f9630012890 con 0x7f963815c2c0 2024-06-02T22:51:40.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.948+0000 7f963e529640 1 -- 172.21.15.184:0/3434333821 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96380683c0 con 0x7f963815c2c0 2024-06-02T22:51:40.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:40.950+0000 7f9634ff9640 1 -- 172.21.15.184:0/3434333821 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9630012400 con 0x7f963815c2c0 2024-06-02T22:51:41.034 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.034+0000 7f963e529640 1 -- 172.21.15.184:0/3434333821 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c8aa8753-58af-495d-9092-4c5f541a45fe", "id": 3} v 0) -- 0x7f96380675e0 con 0x7f963815c2c0 2024-06-02T22:51:41.039 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.040+0000 7f9634ff9640 1 -- 172.21.15.184:0/3434333821 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c8aa8753-58af-495d-9092-4c5f541a45fe", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f9630012ae0 con 0x7f963815c2c0 2024-06-02T22:51:41.040 INFO:teuthology.orchestra.run.smithi184.stdout:3 2024-06-02T22:51:41.041 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.041+0000 7f963e529640 1 -- 172.21.15.184:0/3434333821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f963815c2c0 msgr2=0x7f963815ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.041 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.041+0000 7f963e529640 1 --2- 172.21.15.184:0/3434333821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f963815c2c0 0x7f963815ebd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f963000c780 tx=0x7f963000cc40 comp rx=0 tx=0).stop 2024-06-02T22:51:41.041 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.041+0000 7f963e529640 1 -- 172.21.15.184:0/3434333821 shutdown_connections 2024-06-02T22:51:41.041 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.041+0000 7f963e529640 1 --2- 172.21.15.184:0/3434333821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f963815c2c0 0x7f963815ebd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.041 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.041+0000 7f963e529640 1 --2- 172.21.15.184:0/3434333821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638072950 0x7f963815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.041 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.041+0000 7f963e529640 1 --2- 172.21.15.184:0/3434333821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f963806b900 0x7f9638158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.041 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.041+0000 7f963e529640 1 -- 172.21.15.184:0/3434333821 >> 172.21.15.184:0/3434333821 conn(0x7f96380b22b0 msgr2=0x7f963806c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:41.041 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.041+0000 7f963e529640 1 -- 172.21.15.184:0/3434333821 shutdown_connections 2024-06-02T22:51:41.041 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.041+0000 7f963e529640 1 -- 172.21.15.184:0/3434333821 wait complete. 2024-06-02T22:51:41.048 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:41.049+0000 7f7cec013040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T22:51:41.051 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new f420e520-a8a0-4125-b8dc-89a5b553428e 4 2024-06-02T22:51:41.134 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:41.135+0000 7f7cec013040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T22:51:41.144 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:41.145+0000 7f1b0231c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T22:51:41.151 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.151+0000 7f8f05f63640 1 Processor -- start 2024-06-02T22:51:41.151 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.151+0000 7f8f05f63640 1 -- start start 2024-06-02T22:51:41.153 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.152+0000 7f8f05f63640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8f0015ade0 0x7f8f000cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.153 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.152+0000 7f8f05f63640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8f0006e960 0x7f8f000cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.153 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.152+0000 7f8f05f63640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f000cf630 con 0x7f8f0015e950 2024-06-02T22:51:41.153 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.152+0000 7f8f05f63640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8f000cf910 con 0x7f8f0006e960 2024-06-02T22:51:41.153 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.152+0000 7f8f05f63640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f8f000cfbf0 con 0x7f8f0015ade0 2024-06-02T22:51:41.153 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.152+0000 7f8eff7fe640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8f0015ade0 0x7f8f000cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.153 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.152+0000 7f8eff7fe640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8f0015ade0 0x7f8f000cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:44336/0 (socket says 172.21.15.184:44336) 2024-06-02T22:51:41.154 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.152+0000 7f8eff7fe640 1 -- 172.21.15.184:0/3639542623 learned_addr learned my addr 172.21.15.184:0/3639542623 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-02T22:51:41.154 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.152+0000 7f8ef7fff640 1 --2- 172.21.15.184:0/3639542623 >> v2:172.21.15.82:3300/0 conn(0x7f8f0006e960 0x7f8f000cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.154 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.152+0000 7f8eff7fe640 1 -- 172.21.15.184:0/3639542623 >> v2:172.21.15.82:3300/0 conn(0x7f8f0006e960 msgr2=0x7f8f000cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:41.154 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.152+0000 7f8eff7fe640 1 --2- 172.21.15.184:0/3639542623 >> v2:172.21.15.82:3300/0 conn(0x7f8f0006e960 0x7f8f000cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.154 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.153+0000 7f8eff7fe640 1 -- 172.21.15.184:0/3639542623 >> v1:172.21.15.82:6789/0 conn(0x7f8f0015e950 legacy=0x7f8f000cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.154 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.153+0000 7f8eff7fe640 1 -- 172.21.15.184:0/3639542623 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f000cbcf0 con 0x7f8f0015ade0 2024-06-02T22:51:41.154 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.153+0000 7f8ef7fff640 1 --2- 172.21.15.184:0/3639542623 >> v2:172.21.15.82:3300/0 conn(0x7f8f0006e960 0x7f8f000cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:51:41.154 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.153+0000 7f8eff7fe640 1 --2- 172.21.15.184:0/3639542623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f0015ade0 0x7f8f000cede0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f000ce820 tx=0x7f8ef002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aa2d724a72b93ad server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:41.154 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.153+0000 7f8efeffd640 1 -- 172.21.15.184:0/3639542623 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0037070 con 0x7f8f0015ade0 2024-06-02T22:51:41.154 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.153+0000 7f8efeffd640 1 -- 172.21.15.184:0/3639542623 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef0032440 con 0x7f8f0015ade0 2024-06-02T22:51:41.154 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.153+0000 7f8efeffd640 1 -- 172.21.15.184:0/3639542623 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0032810 con 0x7f8f0015ade0 2024-06-02T22:51:41.157 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.154+0000 7f8f05f63640 1 -- 172.21.15.184:0/3639542623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f0015ade0 msgr2=0x7f8f000cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.157 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.154+0000 7f8f05f63640 1 --2- 172.21.15.184:0/3639542623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f0015ade0 0x7f8f000cede0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f000ce820 tx=0x7f8ef002a270 comp rx=0 tx=0).stop 2024-06-02T22:51:41.157 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.154+0000 7f8f05f63640 1 -- 172.21.15.184:0/3639542623 shutdown_connections 2024-06-02T22:51:41.158 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.154+0000 7f8f05f63640 1 --2- 172.21.15.184:0/3639542623 >> v2:172.21.15.82:3300/0 conn(0x7f8f0006e960 0x7f8f000cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.158 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.154+0000 7f8f05f63640 1 --2- 172.21.15.184:0/3639542623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f0015ade0 0x7f8f000cede0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.158 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.154+0000 7f8f05f63640 1 -- 172.21.15.184:0/3639542623 >> 172.21.15.184:0/3639542623 conn(0x7f8f000b2970 msgr2=0x7f8f000b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:41.158 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.154+0000 7f8f05f63640 1 -- 172.21.15.184:0/3639542623 shutdown_connections 2024-06-02T22:51:41.158 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.154+0000 7f8f05f63640 1 -- 172.21.15.184:0/3639542623 wait complete. 2024-06-02T22:51:41.158 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.155+0000 7f8f05f63640 1 Processor -- start 2024-06-02T22:51:41.158 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.155+0000 7f8f05f63640 1 -- start start 2024-06-02T22:51:41.158 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8f05f63640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f0006e960 0x7f8f0014ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.158 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8f05f63640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0015ade0 0x7f8f0014d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.158 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8f05f63640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f0015e950 0x7f8f000b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8f05f63640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8f000cb9a0 con 0x7f8f0015ade0 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8f05f63640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0015b1c0 con 0x7f8f0015e950 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8f05f63640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8f000cdc10 con 0x7f8f0006e960 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8eff7fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f0006e960 0x7f8f0014ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8efffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f0015e950 0x7f8f000b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8efffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f0015e950 0x7f8f000b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:44348/0 (socket says 172.21.15.184:44348) 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8efffff640 1 -- 172.21.15.184:0/2587258660 learned_addr learned my addr 172.21.15.184:0/2587258660 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8ef7fff640 1 --2- 172.21.15.184:0/2587258660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0015ade0 0x7f8f0014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8eff7fe640 1 -- 172.21.15.184:0/2587258660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f0015e950 msgr2=0x7f8f000b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8eff7fe640 1 --2- 172.21.15.184:0/2587258660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f0015e950 0x7f8f000b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8eff7fe640 1 -- 172.21.15.184:0/2587258660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0015ade0 msgr2=0x7f8f0014d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.156+0000 7f8eff7fe640 1 --2- 172.21.15.184:0/2587258660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0015ade0 0x7f8f0014d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.157+0000 7f8eff7fe640 1 -- 172.21.15.184:0/2587258660 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f000b4690 con 0x7f8f0006e960 2024-06-02T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.157+0000 7f8efffff640 1 --2- 172.21.15.184:0/2587258660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f0015e950 0x7f8f000b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.157+0000 7f8eff7fe640 1 --2- 172.21.15.184:0/2587258660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f0006e960 0x7f8f0014ef60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0031000 tx=0x7f8ef00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.157+0000 7f8efcff9640 1 -- 172.21.15.184:0/2587258660 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0041020 con 0x7f8f0006e960 2024-06-02T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.157+0000 7f8efcff9640 1 -- 172.21.15.184:0/2587258660 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef0030780 con 0x7f8f0006e960 2024-06-02T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.157+0000 7f8f05f63640 1 -- 172.21.15.184:0/2587258660 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f000b4930 con 0x7f8f0006e960 2024-06-02T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.157+0000 7f8efcff9640 1 -- 172.21.15.184:0/2587258660 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0037040 con 0x7f8f0006e960 2024-06-02T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.157+0000 7f8f05f63640 1 -- 172.21.15.184:0/2587258660 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f000b51d0 con 0x7f8f0006e960 2024-06-02T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.157+0000 7f8efcff9640 1 -- 172.21.15.184:0/2587258660 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8ef0044020 con 0x7f8f0006e960 2024-06-02T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.157+0000 7f8efcff9640 1 -- 172.21.15.184:0/2587258660 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8ef003dbf0 con 0x7f8f0006e960 2024-06-02T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.158+0000 7f8f05f63640 1 -- 172.21.15.184:0/2587258660 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f000b4d20 con 0x7f8f0006e960 2024-06-02T22:51:41.161 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.160+0000 7f8efcff9640 1 -- 172.21.15.184:0/2587258660 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8ef004b030 con 0x7f8f0006e960 2024-06-02T22:51:41.177 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:41.177+0000 7f7cec013040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T22:51:41.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.233+0000 7f8f05f63640 1 -- 172.21.15.184:0/2587258660 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f420e520-a8a0-4125-b8dc-89a5b553428e", "id": 4} v 0) -- 0x7f8f00068ad0 con 0x7f8f0006e960 2024-06-02T22:51:41.236 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:41.237+0000 7f1b0231c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T22:51:41.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.238+0000 7f8efcff9640 1 -- 172.21.15.184:0/2587258660 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f420e520-a8a0-4125-b8dc-89a5b553428e", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8ef003d420 con 0x7f8f0006e960 2024-06-02T22:51:41.238 INFO:teuthology.orchestra.run.smithi184.stdout:4 2024-06-02T22:51:41.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.239+0000 7f8f05f63640 1 -- 172.21.15.184:0/2587258660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f0006e960 msgr2=0x7f8f0014ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.239+0000 7f8f05f63640 1 --2- 172.21.15.184:0/2587258660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f0006e960 0x7f8f0014ef60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0031000 tx=0x7f8ef00046c0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.239+0000 7f8f05f63640 1 -- 172.21.15.184:0/2587258660 shutdown_connections 2024-06-02T22:51:41.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.239+0000 7f8f05f63640 1 --2- 172.21.15.184:0/2587258660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f0015e950 0x7f8f000b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.239+0000 7f8f05f63640 1 --2- 172.21.15.184:0/2587258660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0015ade0 0x7f8f0014d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.239+0000 7f8f05f63640 1 --2- 172.21.15.184:0/2587258660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f0006e960 0x7f8f0014ef60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.239+0000 7f8f05f63640 1 -- 172.21.15.184:0/2587258660 >> 172.21.15.184:0/2587258660 conn(0x7f8f000b2970 msgr2=0x7f8f000ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:41.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.239+0000 7f8f05f63640 1 -- 172.21.15.184:0/2587258660 shutdown_connections 2024-06-02T22:51:41.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.239+0000 7f8f05f63640 1 -- 172.21.15.184:0/2587258660 wait complete. 2024-06-02T22:51:41.250 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 179c12c4-422f-4775-b8c3-283724413292 5 2024-06-02T22:51:41.283 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:41.283+0000 7f1b0231c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T22:51:41.343 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:41.344+0000 7f7cec013040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T22:51:41.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.349+0000 7fe8ed483640 1 Processor -- start 2024-06-02T22:51:41.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.349+0000 7fe8ed483640 1 -- start start 2024-06-02T22:51:41.352 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8ed483640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80d2a20 0x7fe8e80cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.352 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8ed483640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e80d17e0 con 0x7fe8e80d2640 2024-06-02T22:51:41.353 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8ed483640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e80cef20 con 0x7fe8e80cff40 2024-06-02T22:51:41.353 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8ed483640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e80cf200 con 0x7fe8e80d2a20 2024-06-02T22:51:41.353 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8e67fc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80d2a20 0x7fe8e80cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.353 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8e77fe640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe8e80cff40 0x7fe8e815e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:60136/0 (socket says 172.21.15.184:60136) 2024-06-02T22:51:41.353 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8e77fe640 1 -- 172.21.15.184:0/1105794641 learned_addr learned my addr 172.21.15.184:0/1105794641 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-06-02T22:51:41.353 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8e5ffb640 1 -- 172.21.15.184:0/1105794641 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1249543823 0 0) 0x7fe8e80cef20 con 0x7fe8e80cff40 2024-06-02T22:51:41.353 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8e5ffb640 1 -- 172.21.15.184:0/1105794641 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8d4003520 con 0x7fe8e80cff40 2024-06-02T22:51:41.353 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8e67fc640 1 -- 172.21.15.184:0/1105794641 >> v1:172.21.15.184:6789/0 conn(0x7fe8e80cff40 legacy=0x7fe8e815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.354 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8e67fc640 1 -- 172.21.15.184:0/1105794641 >> v1:172.21.15.82:6789/0 conn(0x7fe8e80d2640 legacy=0x7fe8e80b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.354 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.350+0000 7fe8e67fc640 1 -- 172.21.15.184:0/1105794641 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e80cf4e0 con 0x7fe8e80d2a20 2024-06-02T22:51:41.354 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.351+0000 7fe8e67fc640 1 --2- 172.21.15.184:0/1105794641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80d2a20 0x7fe8e80cfa00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80097d0 tx=0x7fe8d802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc2a87c327c81dcf server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:41.354 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.352+0000 7fe8e5ffb640 1 -- 172.21.15.184:0/1105794641 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8037070 con 0x7fe8e80d2a20 2024-06-02T22:51:41.354 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.352+0000 7fe8e5ffb640 1 -- 172.21.15.184:0/1105794641 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d8032440 con 0x7fe8e80d2a20 2024-06-02T22:51:41.354 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.352+0000 7fe8e5ffb640 1 -- 172.21.15.184:0/1105794641 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8032810 con 0x7fe8e80d2a20 2024-06-02T22:51:41.354 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.352+0000 7fe8ed483640 1 -- 172.21.15.184:0/1105794641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80d2a20 msgr2=0x7fe8e80cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.354 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.352+0000 7fe8ed483640 1 --2- 172.21.15.184:0/1105794641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80d2a20 0x7fe8e80cfa00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80097d0 tx=0x7fe8d802a210 comp rx=0 tx=0).stop 2024-06-02T22:51:41.355 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.352+0000 7fe8ed483640 1 -- 172.21.15.184:0/1105794641 shutdown_connections 2024-06-02T22:51:41.355 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.352+0000 7fe8ed483640 1 --2- 172.21.15.184:0/1105794641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80d2a20 0x7fe8e80cfa00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.355 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.352+0000 7fe8ed483640 1 -- 172.21.15.184:0/1105794641 >> 172.21.15.184:0/1105794641 conn(0x7fe8e809d3a0 msgr2=0x7fe8e80d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:41.355 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.352+0000 7fe8ed483640 1 -- 172.21.15.184:0/1105794641 shutdown_connections 2024-06-02T22:51:41.355 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.352+0000 7fe8ed483640 1 -- 172.21.15.184:0/1105794641 wait complete. 2024-06-02T22:51:41.359 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8ed483640 1 Processor -- start 2024-06-02T22:51:41.359 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8ed483640 1 -- start start 2024-06-02T22:51:41.359 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8ed483640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80cff40 0x7fe8e81f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.360 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8ed483640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e80d2640 0x7fe8e80cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.360 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8ed483640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80d2a20 0x7fe8e80c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.360 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8ed483640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e815e870 con 0x7fe8e80d2a20 2024-06-02T22:51:41.360 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8ed483640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e80b1410 con 0x7fe8e80d2640 2024-06-02T22:51:41.360 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8ed483640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e815e9f0 con 0x7fe8e80cff40 2024-06-02T22:51:41.360 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8e67fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e80d2640 0x7fe8e80cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.360 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8e6ffd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80cff40 0x7fe8e81f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.360 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8e6ffd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80cff40 0x7fe8e81f3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:34344/0 (socket says 172.21.15.184:34344) 2024-06-02T22:51:41.361 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8e67fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e80d2640 0x7fe8e80cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:44358/0 (socket says 172.21.15.184:44358) 2024-06-02T22:51:41.361 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8e6ffd640 1 -- 172.21.15.184:0/3709842717 learned_addr learned my addr 172.21.15.184:0/3709842717 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-02T22:51:41.361 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.354+0000 7fe8e77fe640 1 --2- 172.21.15.184:0/3709842717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80d2a20 0x7fe8e80c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.361 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8e6ffd640 1 -- 172.21.15.184:0/3709842717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e80d2640 msgr2=0x7fe8e80cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.361 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8e6ffd640 1 --2- 172.21.15.184:0/3709842717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e80d2640 0x7fe8e80cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.361 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8e6ffd640 1 -- 172.21.15.184:0/3709842717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80d2a20 msgr2=0x7fe8e80c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.361 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8e6ffd640 1 --2- 172.21.15.184:0/3709842717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80d2a20 0x7fe8e80c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.361 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8e6ffd640 1 -- 172.21.15.184:0/3709842717 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e80cdbe0 con 0x7fe8e80cff40 2024-06-02T22:51:41.361 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8e67fc640 1 --2- 172.21.15.184:0/3709842717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e80d2640 0x7fe8e80cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:51:41.362 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8e6ffd640 1 --2- 172.21.15.184:0/3709842717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80cff40 0x7fe8e81f3a00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c3c0 tx=0x7fe8d000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:41.362 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8df7fe640 1 -- 172.21.15.184:0/3709842717 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d00052d0 con 0x7fe8e80cff40 2024-06-02T22:51:41.362 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8df7fe640 1 -- 172.21.15.184:0/3709842717 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d0005490 con 0x7fe8e80cff40 2024-06-02T22:51:41.362 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8ed483640 1 -- 172.21.15.184:0/3709842717 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e80cdec0 con 0x7fe8e80cff40 2024-06-02T22:51:41.362 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8df7fe640 1 -- 172.21.15.184:0/3709842717 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0007260 con 0x7fe8e80cff40 2024-06-02T22:51:41.362 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8ed483640 1 -- 172.21.15.184:0/3709842717 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e80cd7f0 con 0x7fe8e80cff40 2024-06-02T22:51:41.362 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8df7fe640 1 -- 172.21.15.184:0/3709842717 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe8d0007400 con 0x7fe8e80cff40 2024-06-02T22:51:41.363 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.355+0000 7fe8df7fe640 1 -- 172.21.15.184:0/3709842717 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe8d0011590 con 0x7fe8e80cff40 2024-06-02T22:51:41.363 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.356+0000 7fe8ed483640 1 -- 172.21.15.184:0/3709842717 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e80683c0 con 0x7fe8e80cff40 2024-06-02T22:51:41.363 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.358+0000 7fe8df7fe640 1 -- 172.21.15.184:0/3709842717 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe8d0003a40 con 0x7fe8e80cff40 2024-06-02T22:51:41.391 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:41.391+0000 7f7cec013040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T22:51:41.429 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.430+0000 7fe8ed483640 1 -- 172.21.15.184:0/3709842717 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "179c12c4-422f-4775-b8c3-283724413292", "id": 5} v 0) -- 0x7fe8e809d880 con 0x7fe8e80cff40 2024-06-02T22:51:41.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.435+0000 7fe8df7fe640 1 -- 172.21.15.184:0/3709842717 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "179c12c4-422f-4775-b8c3-283724413292", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe8d0003c20 con 0x7fe8e80cff40 2024-06-02T22:51:41.435 INFO:teuthology.orchestra.run.smithi184.stdout:5 2024-06-02T22:51:41.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.436+0000 7fe8ed483640 1 -- 172.21.15.184:0/3709842717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80cff40 msgr2=0x7fe8e81f3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.436+0000 7fe8ed483640 1 --2- 172.21.15.184:0/3709842717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80cff40 0x7fe8e81f3a00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c3c0 tx=0x7fe8d000c880 comp rx=0 tx=0).stop 2024-06-02T22:51:41.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.436+0000 7fe8ed483640 1 -- 172.21.15.184:0/3709842717 shutdown_connections 2024-06-02T22:51:41.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.436+0000 7fe8ed483640 1 --2- 172.21.15.184:0/3709842717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80d2a20 0x7fe8e80c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.436+0000 7fe8ed483640 1 --2- 172.21.15.184:0/3709842717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8e80d2640 0x7fe8e80cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.437 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.436+0000 7fe8ed483640 1 --2- 172.21.15.184:0/3709842717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e80cff40 0x7fe8e81f3a00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.437 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.436+0000 7fe8ed483640 1 -- 172.21.15.184:0/3709842717 >> 172.21.15.184:0/3709842717 conn(0x7fe8e809d3a0 msgr2=0x7fe8e815d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:41.437 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.436+0000 7fe8ed483640 1 -- 172.21.15.184:0/3709842717 shutdown_connections 2024-06-02T22:51:41.437 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.436+0000 7fe8ed483640 1 -- 172.21.15.184:0/3709842717 wait complete. 2024-06-02T22:51:41.443 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:41.443+0000 7f7cec013040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T22:51:41.447 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 72ffaff6-3303-4682-887d-3d4f3a3e193d 6 2024-06-02T22:51:41.456 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:41.456+0000 7f1b0231c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T22:51:41.506 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:41.506+0000 7f1b0231c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T22:51:41.555 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:41.555+0000 7f7cec013040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:51:41.555 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.555+0000 7f65a06ca640 1 Processor -- start 2024-06-02T22:51:41.555 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.555+0000 7f65a06ca640 1 -- start start 2024-06-02T22:51:41.557 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.556+0000 7f65a06ca640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980cdc70 0x7f659806d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.557 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.556+0000 7f65a06ca640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65980cedf0 0x7f65980d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.557 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.556+0000 7f65a06ca640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f659806e140 con 0x7f65980ce050 2024-06-02T22:51:41.557 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.556+0000 7f65a06ca640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f659806e420 con 0x7f65980cedf0 2024-06-02T22:51:41.557 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.556+0000 7f65a06ca640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f659806f320 con 0x7f65980cdc70 2024-06-02T22:51:41.557 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.556+0000 7f659dc65640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f65980ce050 0x7f65980ce6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:60152/0 (socket says 172.21.15.184:60152) 2024-06-02T22:51:41.557 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.557+0000 7f659dc65640 1 -- 172.21.15.184:0/3419932195 learned_addr learned my addr 172.21.15.184:0/3419932195 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-06-02T22:51:41.557 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.557+0000 7f659e466640 1 --2- 172.21.15.184:0/3419932195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980cdc70 0x7f659806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.557+0000 7f659ec67640 1 --2- 172.21.15.184:0/3419932195 >> v2:172.21.15.82:3300/0 conn(0x7f65980cedf0 0x7f65980d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.557+0000 7f659d464640 1 -- 172.21.15.184:0/3419932195 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2340351041 0 0) 0x7f659806e140 con 0x7f65980ce050 2024-06-02T22:51:41.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.557+0000 7f659d464640 1 -- 172.21.15.184:0/3419932195 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6584003520 con 0x7f65980ce050 2024-06-02T22:51:41.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.557+0000 7f659e466640 1 -- 172.21.15.184:0/3419932195 >> v2:172.21.15.82:3300/0 conn(0x7f65980cedf0 msgr2=0x7f65980d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:41.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.557+0000 7f659e466640 1 --2- 172.21.15.184:0/3419932195 >> v2:172.21.15.82:3300/0 conn(0x7f65980cedf0 0x7f65980d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.557+0000 7f659e466640 1 -- 172.21.15.184:0/3419932195 >> v1:172.21.15.184:6789/0 conn(0x7f65980ce050 legacy=0x7f65980ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.557+0000 7f659e466640 1 -- 172.21.15.184:0/3419932195 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659806f600 con 0x7f65980cdc70 2024-06-02T22:51:41.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.558+0000 7f659e466640 1 --2- 172.21.15.184:0/3419932195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980cdc70 0x7f659806d570 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f65940097a0 tx=0x7f659402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b7db5b5c6540d0e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:41.559 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.558+0000 7f659d464640 1 -- 172.21.15.184:0/3419932195 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594037070 con 0x7f65980cdc70 2024-06-02T22:51:41.559 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.558+0000 7f659d464640 1 -- 172.21.15.184:0/3419932195 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6594032440 con 0x7f65980cdc70 2024-06-02T22:51:41.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.558+0000 7f659d464640 1 -- 172.21.15.184:0/3419932195 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594032810 con 0x7f65980cdc70 2024-06-02T22:51:41.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.558+0000 7f65a06ca640 1 -- 172.21.15.184:0/3419932195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980cdc70 msgr2=0x7f659806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.558+0000 7f65a06ca640 1 --2- 172.21.15.184:0/3419932195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980cdc70 0x7f659806d570 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f65940097a0 tx=0x7f659402a180 comp rx=0 tx=0).stop 2024-06-02T22:51:41.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.558+0000 7f65a06ca640 1 -- 172.21.15.184:0/3419932195 shutdown_connections 2024-06-02T22:51:41.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.558+0000 7f65a06ca640 1 --2- 172.21.15.184:0/3419932195 >> v2:172.21.15.82:3300/0 conn(0x7f65980cedf0 0x7f65980d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.558+0000 7f65a06ca640 1 --2- 172.21.15.184:0/3419932195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980cdc70 0x7f659806d570 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.559+0000 7f65a06ca640 1 -- 172.21.15.184:0/3419932195 >> 172.21.15.184:0/3419932195 conn(0x7f659809aa10 msgr2=0x7f659809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:41.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.559+0000 7f65a06ca640 1 -- 172.21.15.184:0/3419932195 shutdown_connections 2024-06-02T22:51:41.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.559+0000 7f65a06ca640 1 -- 172.21.15.184:0/3419932195 wait complete. 2024-06-02T22:51:41.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.560+0000 7f65a06ca640 1 Processor -- start 2024-06-02T22:51:41.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.560+0000 7f65a06ca640 1 -- start start 2024-06-02T22:51:41.562 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.560+0000 7f65a06ca640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65980cdc70 0x7f6598151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.562 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.560+0000 7f65a06ca640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980ce050 0x7f6598151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.562 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.560+0000 7f65a06ca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65980cedf0 0x7f65980affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.560+0000 7f65a06ca640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f659806db30 con 0x7f65980cdc70 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.560+0000 7f65a06ca640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6598067b60 con 0x7f65980cedf0 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.560+0000 7f65a06ca640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f659806dcb0 con 0x7f65980ce050 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659ec67640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65980cedf0 0x7f65980affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659dc65640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980ce050 0x7f6598151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659ec67640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65980cedf0 0x7f65980affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:44372/0 (socket says 172.21.15.184:44372) 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659ec67640 1 -- 172.21.15.184:0/1619336613 learned_addr learned my addr 172.21.15.184:0/1619336613 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659e466640 1 --2- 172.21.15.184:0/1619336613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65980cdc70 0x7f6598151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659dc65640 1 -- 172.21.15.184:0/1619336613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65980cedf0 msgr2=0x7f65980affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659dc65640 1 --2- 172.21.15.184:0/1619336613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65980cedf0 0x7f65980affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659dc65640 1 -- 172.21.15.184:0/1619336613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65980cdc70 msgr2=0x7f6598151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659dc65640 1 --2- 172.21.15.184:0/1619336613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65980cdc70 0x7f6598151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659dc65640 1 -- 172.21.15.184:0/1619336613 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65980b4d70 con 0x7f65980ce050 2024-06-02T22:51:41.563 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659e466640 1 --2- 172.21.15.184:0/1619336613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65980cdc70 0x7f6598151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:51:41.564 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f659dc65640 1 --2- 172.21.15.184:0/1619336613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980ce050 0x7f6598151e60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f658800c390 tx=0x7f6588001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:41.564 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f658effd640 1 -- 172.21.15.184:0/1619336613 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588017070 con 0x7f65980ce050 2024-06-02T22:51:41.564 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f658effd640 1 -- 172.21.15.184:0/1619336613 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6588005ce0 con 0x7f65980ce050 2024-06-02T22:51:41.564 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f65a06ca640 1 -- 172.21.15.184:0/1619336613 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65980b5050 con 0x7f65980ce050 2024-06-02T22:51:41.564 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f658effd640 1 -- 172.21.15.184:0/1619336613 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65880072f0 con 0x7f65980ce050 2024-06-02T22:51:41.564 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f65a06ca640 1 -- 172.21.15.184:0/1619336613 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65980b5610 con 0x7f65980ce050 2024-06-02T22:51:41.564 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f658effd640 1 -- 172.21.15.184:0/1619336613 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f658801a070 con 0x7f65980ce050 2024-06-02T22:51:41.564 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.561+0000 7f658effd640 1 -- 172.21.15.184:0/1619336613 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f65880129f0 con 0x7f65980ce050 2024-06-02T22:51:41.564 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.562+0000 7f65a06ca640 1 -- 172.21.15.184:0/1619336613 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6598068ad0 con 0x7f65980ce050 2024-06-02T22:51:41.564 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:41.563+0000 7f1b0231c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T22:51:41.565 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.564+0000 7f658effd640 1 -- 172.21.15.184:0/1619336613 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6588021020 con 0x7f65980ce050 2024-06-02T22:51:41.636 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.637+0000 7f65a06ca640 1 -- 172.21.15.184:0/1619336613 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "72ffaff6-3303-4682-887d-3d4f3a3e193d", "id": 6} v 0) -- 0x7f65980d1ef0 con 0x7f65980ce050 2024-06-02T22:51:41.641 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.642+0000 7f658effd640 1 -- 172.21.15.184:0/1619336613 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72ffaff6-3303-4682-887d-3d4f3a3e193d", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f6588007660 con 0x7f65980ce050 2024-06-02T22:51:41.642 INFO:teuthology.orchestra.run.smithi184.stdout:6 2024-06-02T22:51:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.643+0000 7f65a06ca640 1 -- 172.21.15.184:0/1619336613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980ce050 msgr2=0x7f6598151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.643+0000 7f65a06ca640 1 --2- 172.21.15.184:0/1619336613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980ce050 0x7f6598151e60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f658800c390 tx=0x7f6588001e70 comp rx=0 tx=0).stop 2024-06-02T22:51:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.643+0000 7f65a06ca640 1 -- 172.21.15.184:0/1619336613 shutdown_connections 2024-06-02T22:51:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.643+0000 7f65a06ca640 1 --2- 172.21.15.184:0/1619336613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65980cedf0 0x7f65980affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.643+0000 7f65a06ca640 1 --2- 172.21.15.184:0/1619336613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65980ce050 0x7f6598151e60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.643+0000 7f65a06ca640 1 --2- 172.21.15.184:0/1619336613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65980cdc70 0x7f6598151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.643+0000 7f65a06ca640 1 -- 172.21.15.184:0/1619336613 >> 172.21.15.184:0/1619336613 conn(0x7f659809aa10 msgr2=0x7f659806fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.643+0000 7f65a06ca640 1 -- 172.21.15.184:0/1619336613 shutdown_connections 2024-06-02T22:51:41.643 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.643+0000 7f65a06ca640 1 -- 172.21.15.184:0/1619336613 wait complete. 2024-06-02T22:51:41.653 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 9c30ffd8-4b1f-43a9-be04-1e54036f46bd 7 2024-06-02T22:51:41.680 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:41.681+0000 7f1b0231c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:51:41.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.753+0000 7fbadbbc1640 1 Processor -- start 2024-06-02T22:51:41.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.753+0000 7fbadbbc1640 1 -- start start 2024-06-02T22:51:41.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.754+0000 7fbadbbc1640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbad406f450 0x7fbad415f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.754+0000 7fbadbbc1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad40702a0 0x7fbad415e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.754+0000 7fbadbbc1640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad4160c80 con 0x7fbad406fec0 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.754+0000 7fbadbbc1640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fbad415f870 con 0x7fbad406f450 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.754+0000 7fbadbbc1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbad40d0330 con 0x7fbad40702a0 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.754+0000 7fbada15e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad40702a0 0x7fbad415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.754+0000 7fbad915c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbad406f450 0x7fbad415f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.754+0000 7fbad995d640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fbad406fec0 0x7fbad415da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:60162/0 (socket says 172.21.15.184:60162) 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.754+0000 7fbad915c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbad406f450 0x7fbad415f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:44380/0 (socket says 172.21.15.184:44380) 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.754+0000 7fbad995d640 1 -- 172.21.15.184:0/2805082778 learned_addr learned my addr 172.21.15.184:0/2805082778 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.754+0000 7fbada15e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad40702a0 0x7fbad415e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:34378/0 (socket says 172.21.15.184:34378) 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.755+0000 7fbad915c640 1 -- 172.21.15.184:0/2805082778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad40702a0 msgr2=0x7fbad415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.755+0000 7fbad915c640 1 --2- 172.21.15.184:0/2805082778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad40702a0 0x7fbad415e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.755+0000 7fbad915c640 1 -- 172.21.15.184:0/2805082778 >> v1:172.21.15.184:6789/0 conn(0x7fbad406fec0 legacy=0x7fbad415da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.755+0000 7fbad915c640 1 -- 172.21.15.184:0/2805082778 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad40d0610 con 0x7fbad406f450 2024-06-02T22:51:41.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.755+0000 7fbad895b640 1 -- 172.21.15.184:0/2805082778 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2106041879 0 0) 0x7fbad4160c80 con 0x7fbad406fec0 2024-06-02T22:51:41.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.755+0000 7fbada15e640 1 --2- 172.21.15.184:0/2805082778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad40702a0 0x7fbad415e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:51:41.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.756+0000 7fbad915c640 1 --2- 172.21.15.184:0/2805082778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbad406f450 0x7fbad415f330 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbad00097a0 tx=0x7fbad002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8cb5320d6542ed server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:41.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.756+0000 7fbad895b640 1 -- 172.21.15.184:0/2805082778 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad0037070 con 0x7fbad406f450 2024-06-02T22:51:41.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.756+0000 7fbad895b640 1 -- 172.21.15.184:0/2805082778 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad0032440 con 0x7fbad406f450 2024-06-02T22:51:41.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.756+0000 7fbad895b640 1 -- 172.21.15.184:0/2805082778 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad0032810 con 0x7fbad406f450 2024-06-02T22:51:41.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.756+0000 7fbadbbc1640 1 -- 172.21.15.184:0/2805082778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbad406f450 msgr2=0x7fbad415f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.756+0000 7fbadbbc1640 1 --2- 172.21.15.184:0/2805082778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbad406f450 0x7fbad415f330 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbad00097a0 tx=0x7fbad002a210 comp rx=0 tx=0).stop 2024-06-02T22:51:41.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.756+0000 7fbadbbc1640 1 -- 172.21.15.184:0/2805082778 shutdown_connections 2024-06-02T22:51:41.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.756+0000 7fbadbbc1640 1 --2- 172.21.15.184:0/2805082778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad40702a0 0x7fbad415e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.756+0000 7fbadbbc1640 1 --2- 172.21.15.184:0/2805082778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbad406f450 0x7fbad415f330 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.756+0000 7fbadbbc1640 1 -- 172.21.15.184:0/2805082778 >> 172.21.15.184:0/2805082778 conn(0x7fbad40b3900 msgr2=0x7fbad40b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:41.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.757+0000 7fbadbbc1640 1 -- 172.21.15.184:0/2805082778 shutdown_connections 2024-06-02T22:51:41.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.757+0000 7fbadbbc1640 1 -- 172.21.15.184:0/2805082778 wait complete. 2024-06-02T22:51:41.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbadbbc1640 1 Processor -- start 2024-06-02T22:51:41.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbadbbc1640 1 -- start start 2024-06-02T22:51:41.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbadbbc1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad406f450 0x7fbad40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbadbbc1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbad406fec0 0x7fbad40c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbadbbc1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbad40702a0 0x7fbad40c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:41.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbadbbc1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbad40d0eb0 con 0x7fbad406fec0 2024-06-02T22:51:41.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbadbbc1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbad40d0bd0 con 0x7fbad40702a0 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbadbbc1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbad40d13d0 con 0x7fbad406f450 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbad995d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad406f450 0x7fbad40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbada15e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbad40702a0 0x7fbad40c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbad995d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad406f450 0x7fbad40c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:34392/0 (socket says 172.21.15.184:34392) 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.758+0000 7fbad995d640 1 -- 172.21.15.184:0/4123918141 learned_addr learned my addr 172.21.15.184:0/4123918141 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbad915c640 1 --2- 172.21.15.184:0/4123918141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbad406fec0 0x7fbad40c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbad995d640 1 -- 172.21.15.184:0/4123918141 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbad40702a0 msgr2=0x7fbad40c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbad995d640 1 --2- 172.21.15.184:0/4123918141 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbad40702a0 0x7fbad40c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbad995d640 1 -- 172.21.15.184:0/4123918141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbad406fec0 msgr2=0x7fbad40c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbad995d640 1 --2- 172.21.15.184:0/4123918141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbad406fec0 0x7fbad40c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbad995d640 1 -- 172.21.15.184:0/4123918141 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad40c8b70 con 0x7fbad406f450 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbada15e640 1 --2- 172.21.15.184:0/4123918141 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbad40702a0 0x7fbad40c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbad915c640 1 --2- 172.21.15.184:0/4123918141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbad406fec0 0x7fbad40c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:51:41.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbad995d640 1 --2- 172.21.15.184:0/4123918141 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad406f450 0x7fbad40c7bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c4d0 tx=0x7fbac400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:41.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbaca7fc640 1 -- 172.21.15.184:0/4123918141 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac40074e0 con 0x7fbad406f450 2024-06-02T22:51:41.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbaca7fc640 1 -- 172.21.15.184:0/4123918141 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac40047e0 con 0x7fbad406f450 2024-06-02T22:51:41.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbadbbc1640 1 -- 172.21.15.184:0/4123918141 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad40b6da0 con 0x7fbad406f450 2024-06-02T22:51:41.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbaca7fc640 1 -- 172.21.15.184:0/4123918141 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4004bd0 con 0x7fbad406f450 2024-06-02T22:51:41.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbadbbc1640 1 -- 172.21.15.184:0/4123918141 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad40c70d0 con 0x7fbad406f450 2024-06-02T22:51:41.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbaca7fc640 1 -- 172.21.15.184:0/4123918141 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbac4011070 con 0x7fbad406f450 2024-06-02T22:51:41.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.759+0000 7fbaca7fc640 1 -- 172.21.15.184:0/4123918141 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fbac4013a20 con 0x7fbad406f450 2024-06-02T22:51:41.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.760+0000 7fbadbbc1640 1 -- 172.21.15.184:0/4123918141 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad4068ad0 con 0x7fbad406f450 2024-06-02T22:51:41.763 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.762+0000 7fbaca7fc640 1 -- 172.21.15.184:0/4123918141 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbac4004d70 con 0x7fbad406f450 2024-06-02T22:51:41.834 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.834+0000 7fbadbbc1640 1 -- 172.21.15.184:0/4123918141 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9c30ffd8-4b1f-43a9-be04-1e54036f46bd", "id": 7} v 0) -- 0x7fbad40b36e0 con 0x7fbad406f450 2024-06-02T22:51:41.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.843+0000 7fbaca7fc640 1 -- 172.21.15.184:0/4123918141 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c30ffd8-4b1f-43a9-be04-1e54036f46bd", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fbac4013d90 con 0x7fbad406f450 2024-06-02T22:51:41.842 INFO:teuthology.orchestra.run.smithi184.stdout:7 2024-06-02T22:51:41.843 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.844+0000 7fbadbbc1640 1 -- 172.21.15.184:0/4123918141 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad406f450 msgr2=0x7fbad40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:41.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.844+0000 7fbadbbc1640 1 --2- 172.21.15.184:0/4123918141 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad406f450 0x7fbad40c7bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c4d0 tx=0x7fbac400c8d0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.844+0000 7fbadbbc1640 1 -- 172.21.15.184:0/4123918141 shutdown_connections 2024-06-02T22:51:41.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.844+0000 7fbadbbc1640 1 --2- 172.21.15.184:0/4123918141 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbad40702a0 0x7fbad40c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.844+0000 7fbadbbc1640 1 --2- 172.21.15.184:0/4123918141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbad406fec0 0x7fbad40c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.844+0000 7fbadbbc1640 1 --2- 172.21.15.184:0/4123918141 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbad406f450 0x7fbad40c7bb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:41.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.844+0000 7fbadbbc1640 1 -- 172.21.15.184:0/4123918141 >> 172.21.15.184:0/4123918141 conn(0x7fbad40b3900 msgr2=0x7fbad40c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:41.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.844+0000 7fbadbbc1640 1 -- 172.21.15.184:0/4123918141 shutdown_connections 2024-06-02T22:51:41.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:51:41.844+0000 7fbadbbc1640 1 -- 172.21.15.184:0/4123918141 wait complete. 2024-06-02T22:51:41.854 INFO:tasks.ceph.osd.0:Restarting daemon 2024-06-02T22:51:41.854 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-06-02T22:51:41.856 INFO:tasks.ceph.osd.0:Started 2024-06-02T22:51:41.856 INFO:tasks.ceph.osd.1:Restarting daemon 2024-06-02T22:51:41.856 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-06-02T22:51:41.858 INFO:tasks.ceph.osd.1:Started 2024-06-02T22:51:41.858 INFO:tasks.ceph.osd.2:Restarting daemon 2024-06-02T22:51:41.858 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-06-02T22:51:41.860 INFO:tasks.ceph.osd.2:Started 2024-06-02T22:51:41.860 INFO:tasks.ceph.osd.3:Restarting daemon 2024-06-02T22:51:41.861 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-06-02T22:51:41.863 INFO:tasks.ceph.osd.3:Started 2024-06-02T22:51:41.863 INFO:tasks.ceph.osd.4:Restarting daemon 2024-06-02T22:51:41.863 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-06-02T22:51:41.896 INFO:tasks.ceph.osd.4:Started 2024-06-02T22:51:41.896 INFO:tasks.ceph.osd.5:Restarting daemon 2024-06-02T22:51:41.896 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-06-02T22:51:41.898 INFO:tasks.ceph.osd.5:Started 2024-06-02T22:51:41.899 INFO:tasks.ceph.osd.6:Restarting daemon 2024-06-02T22:51:41.899 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-06-02T22:51:41.901 INFO:tasks.ceph.osd.6:Started 2024-06-02T22:51:41.901 INFO:tasks.ceph.osd.7:Restarting daemon 2024-06-02T22:51:41.901 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-06-02T22:51:41.903 INFO:tasks.ceph.osd.7:Started 2024-06-02T22:51:41.905 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:51:41.992 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:41.992+0000 7f7cec013040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T22:51:42.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.031+0000 7f68cf7c8640 1 Processor -- start 2024-06-02T22:51:42.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.031+0000 7f68cf7c8640 1 -- start start 2024-06-02T22:51:42.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68cf7c8640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f68c80b7940 0x7f68c80d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:42.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68cf7c8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68c80b4c80 0x7f68c80ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:42.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68cf7c8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c80b7d20 con 0x7f68c80cec10 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68cf7c8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f68c80cc620 con 0x7f68c80b4c80 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68cf7c8640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f68c80cc900 con 0x7f68c80b7940 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68ccd63640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68c80b4c80 0x7f68c80ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68ccd63640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68c80b4c80 0x7f68c80ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48864/0 (socket says 172.21.15.82:48864) 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68cdd65640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f68c80cec10 0x7f68c806c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55090/0 (socket says 172.21.15.82:55090) 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68ccd63640 1 -- 172.21.15.82:0/4049444047 learned_addr learned my addr 172.21.15.82:0/4049444047 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68cd564640 1 --2- 172.21.15.82:0/4049444047 >> v2:172.21.15.184:3300/0 conn(0x7f68c80b7940 0x7f68c80d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68ccd63640 1 -- 172.21.15.82:0/4049444047 >> v2:172.21.15.184:3300/0 conn(0x7f68c80b7940 msgr2=0x7f68c80d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68ccd63640 1 --2- 172.21.15.82:0/4049444047 >> v2:172.21.15.184:3300/0 conn(0x7f68c80b7940 0x7f68c80d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68ccd63640 1 -- 172.21.15.82:0/4049444047 >> v1:172.21.15.82:6789/0 conn(0x7f68c80cec10 legacy=0x7f68c806c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.033+0000 7f68ccd63640 1 -- 172.21.15.82:0/4049444047 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c80ccbe0 con 0x7f68c80b4c80 2024-06-02T22:51:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.032+0000 7f68bbfff640 1 -- 172.21.15.82:0/4049444047 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128908890 0 0) 0x7f68c80b7d20 con 0x7f68c80cec10 2024-06-02T22:51:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.033+0000 7f68ccd63640 1 --2- 172.21.15.82:0/4049444047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c80b4c80 0x7f68c80ce6d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f68c80cf520 tx=0x7f68c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c907c2011633b4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.033+0000 7f68bbfff640 1 -- 172.21.15.82:0/4049444047 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4037070 con 0x7f68c80b4c80 2024-06-02T22:51:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.033+0000 7f68bbfff640 1 -- 172.21.15.82:0/4049444047 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c4032440 con 0x7f68c80b4c80 2024-06-02T22:51:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.033+0000 7f68bbfff640 1 -- 172.21.15.82:0/4049444047 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4032810 con 0x7f68c80b4c80 2024-06-02T22:51:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.034+0000 7f68cf7c8640 1 -- 172.21.15.82:0/4049444047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c80b4c80 msgr2=0x7f68c80ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.034+0000 7f68cf7c8640 1 --2- 172.21.15.82:0/4049444047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c80b4c80 0x7f68c80ce6d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f68c80cf520 tx=0x7f68c402a270 comp rx=0 tx=0).stop 2024-06-02T22:51:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.034+0000 7f68cf7c8640 1 -- 172.21.15.82:0/4049444047 shutdown_connections 2024-06-02T22:51:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.034+0000 7f68cf7c8640 1 --2- 172.21.15.82:0/4049444047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c80b4c80 0x7f68c80ce6d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.034+0000 7f68cf7c8640 1 --2- 172.21.15.82:0/4049444047 >> v2:172.21.15.184:3300/0 conn(0x7f68c80b7940 0x7f68c80d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.034+0000 7f68cf7c8640 1 -- 172.21.15.82:0/4049444047 >> 172.21.15.82:0/4049444047 conn(0x7f68c80d1e50 msgr2=0x7f68c80d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:42.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.034+0000 7f68cf7c8640 1 -- 172.21.15.82:0/4049444047 shutdown_connections 2024-06-02T22:51:42.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.034+0000 7f68cf7c8640 1 -- 172.21.15.82:0/4049444047 wait complete. 2024-06-02T22:51:42.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.035+0000 7f68cf7c8640 1 Processor -- start 2024-06-02T22:51:42.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.035+0000 7f68cf7c8640 1 -- start start 2024-06-02T22:51:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68cf7c8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68c80b4c80 0x7f68c81573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68cf7c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c80b7940 0x7f68c806d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68cf7c8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c80cec10 0x7f68c815d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68cf7c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68c80d2c10 con 0x7f68c80b7940 2024-06-02T22:51:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68cf7c8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f68c80d2a90 con 0x7f68c80cec10 2024-06-02T22:51:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68cf7c8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f68c80d1030 con 0x7f68c80b4c80 2024-06-02T22:51:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68ccd63640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c80b7940 0x7f68c806d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68ccd63640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c80b7940 0x7f68c806d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48872/0 (socket says 172.21.15.82:48872) 2024-06-02T22:51:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68ccd63640 1 -- 172.21.15.82:0/2112771240 learned_addr learned my addr 172.21.15.82:0/2112771240 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68cdd65640 1 --2- 172.21.15.82:0/2112771240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c80cec10 0x7f68c815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68cd564640 1 --2- 172.21.15.82:0/2112771240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68c80b4c80 0x7f68c81573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68ccd63640 1 -- 172.21.15.82:0/2112771240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68c80b4c80 msgr2=0x7f68c81573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68ccd63640 1 --2- 172.21.15.82:0/2112771240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68c80b4c80 0x7f68c81573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68ccd63640 1 -- 172.21.15.82:0/2112771240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c80cec10 msgr2=0x7f68c815d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68ccd63640 1 --2- 172.21.15.82:0/2112771240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c80cec10 0x7f68c815d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68ccd63640 1 -- 172.21.15.82:0/2112771240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c815bdd0 con 0x7f68c80b7940 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.036+0000 7f68ccd63640 1 --2- 172.21.15.82:0/2112771240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c80b7940 0x7f68c806d730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f68c402a2b0 tx=0x7f68c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.037+0000 7f68b9ffb640 1 -- 172.21.15.82:0/2112771240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4037040 con 0x7f68c80b7940 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.037+0000 7f68b9ffb640 1 -- 172.21.15.82:0/2112771240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c4042070 con 0x7f68c80b7940 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.037+0000 7f68cf7c8640 1 -- 172.21.15.82:0/2112771240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c815c0b0 con 0x7f68c80b7940 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.037+0000 7f68b9ffb640 1 -- 172.21.15.82:0/2112771240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4030880 con 0x7f68c80b7940 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.037+0000 7f68cf7c8640 1 -- 172.21.15.82:0/2112771240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c815c670 con 0x7f68c80b7940 2024-06-02T22:51:42.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.037+0000 7f68b9ffb640 1 -- 172.21.15.82:0/2112771240 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f68c4030a20 con 0x7f68c80b7940 2024-06-02T22:51:42.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.037+0000 7f68b9ffb640 1 -- 172.21.15.82:0/2112771240 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f68c4047b40 con 0x7f68c80b7940 2024-06-02T22:51:42.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.038+0000 7f68cf7c8640 1 -- 172.21.15.82:0/2112771240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c8068430 con 0x7f68c80b7940 2024-06-02T22:51:42.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.040+0000 7f68b9ffb640 1 -- 172.21.15.82:0/2112771240 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f68c4047460 con 0x7f68c80b7940 2024-06-02T22:51:42.097 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:42.098+0000 7f1b0231c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T22:51:42.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.101+0000 7f68cf7c8640 1 -- 172.21.15.82:0/2112771240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68c806cbc0 con 0x7f68c80b7940 2024-06-02T22:51:42.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.102+0000 7f68b9ffb640 1 -- 172.21.15.82:0/2112771240 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f68c4047640 con 0x7f68c80b7940 2024-06-02T22:51:42.101 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:42.102 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":10,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:51:41.836731+0000","last_up_change":"0.000000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:51:42.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.103+0000 7f68cf7c8640 1 -- 172.21.15.82:0/2112771240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c80b7940 msgr2=0x7f68c806d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:42.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.103+0000 7f68cf7c8640 1 --2- 172.21.15.82:0/2112771240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c80b7940 0x7f68c806d730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f68c402a2b0 tx=0x7f68c40046c0 comp rx=0 tx=0).stop 2024-06-02T22:51:42.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.103+0000 7f68cf7c8640 1 -- 172.21.15.82:0/2112771240 shutdown_connections 2024-06-02T22:51:42.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.103+0000 7f68cf7c8640 1 --2- 172.21.15.82:0/2112771240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c80cec10 0x7f68c815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:42.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.103+0000 7f68cf7c8640 1 --2- 172.21.15.82:0/2112771240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c80b7940 0x7f68c806d730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:42.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.103+0000 7f68cf7c8640 1 --2- 172.21.15.82:0/2112771240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f68c80b4c80 0x7f68c81573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:42.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.103+0000 7f68cf7c8640 1 -- 172.21.15.82:0/2112771240 >> 172.21.15.82:0/2112771240 conn(0x7f68c80d1e50 msgr2=0x7f68c80cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:42.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.103+0000 7f68cf7c8640 1 -- 172.21.15.82:0/2112771240 shutdown_connections 2024-06-02T22:51:42.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:42.103+0000 7f68cf7c8640 1 -- 172.21.15.82:0/2112771240 wait complete. 2024-06-02T22:51:42.113 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-06-02T22:51:42.113 INFO:tasks.ceph:Waiting for OSDs to come up 2024-06-02T22:51:42.258 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:42.259+0000 7f7cec013040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T22:51:42.309 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:42.310+0000 7f7cec013040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T22:51:42.355 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:42.355+0000 7f1b0231c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T22:51:42.406 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:42.406+0000 7f1b0231c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T22:51:42.423 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:42.424+0000 7f7cec013040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T22:51:42.464 INFO:tasks.ceph.osd.2.smithi082.stderr:2024-06-02T22:51:42.464+0000 7fab042fd640 -1 Falling back to public interface 2024-06-02T22:51:42.470 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-06-02T22:51:42.470+0000 7f1a6e968640 -1 Falling back to public interface 2024-06-02T22:51:42.473 INFO:tasks.ceph.osd.3.smithi082.stderr:2024-06-02T22:51:42.473+0000 7f4ea47cb640 -1 Falling back to public interface 2024-06-02T22:51:42.473 INFO:tasks.ceph.osd.0.smithi082.stderr:2024-06-02T22:51:42.473+0000 7f5a63a0d640 -1 Falling back to public interface 2024-06-02T22:51:42.476 INFO:tasks.ceph.osd.0.smithi082.stderr:2024-06-02T22:51:42.476+0000 7f5a6243b640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6827/0: (98) Address already in use 2024-06-02T22:51:42.511 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-06-02T22:51:42.511+0000 7f2753217640 -1 Falling back to public interface 2024-06-02T22:51:42.512 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-06-02T22:51:42.513+0000 7f70e5a23640 -1 Falling back to public interface 2024-06-02T22:51:42.521 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-06-02T22:51:42.521+0000 7f555a622640 -1 Falling back to public interface 2024-06-02T22:51:42.522 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:42.522+0000 7f1b0231c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T22:51:42.526 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-06-02T22:51:42.526+0000 7f5f80aaf640 -1 Falling back to public interface 2024-06-02T22:51:42.712 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:42.712+0000 7f7cec013040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T22:51:42.760 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:42.761+0000 7f7cec013040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T22:51:42.825 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:42.826+0000 7f1b0231c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T22:51:42.872 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:42.873+0000 7f1b0231c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T22:51:42.914 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:42.914+0000 7f7cec013040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T22:51:42.918 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-02T22:51:43.010 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.010+0000 7f65a5942640 1 Processor -- start 2024-06-02T22:51:43.011 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.011+0000 7f65a5942640 1 -- start start 2024-06-02T22:51:43.012 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.011+0000 7f65a5942640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a015e150 0x7f65a00d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:43.012 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.011+0000 7f65a5942640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f65a015e530 0x7f65a00ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:43.012 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.011+0000 7f65a5942640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65a00d3c80 0x7f65a00d40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:43.012 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.011+0000 7f65a5942640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f65a00d0020 con 0x7f65a00d3c80 2024-06-02T22:51:43.012 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.011+0000 7f65a5942640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f65a00d4630 con 0x7f65a015e530 2024-06-02T22:51:43.012 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.011+0000 7f65a5942640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f65a00cf4a0 con 0x7f65a015e150 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.011+0000 7f659f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65a00d3c80 0x7f65a00d40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.011+0000 7f659f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65a00d3c80 0x7f65a00d40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48874/0 (socket says 172.21.15.82:48874) 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.011+0000 7f659f7fe640 1 -- 172.21.15.82:0/2400406687 learned_addr learned my addr 172.21.15.82:0/2400406687 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.012+0000 7f659e7fc640 1 --2- 172.21.15.82:0/2400406687 >> v2:172.21.15.184:3300/0 conn(0x7f65a015e530 0x7f65a00ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.012+0000 7f659effd640 1 --2- 172.21.15.82:0/2400406687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a015e150 0x7f65a00d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.012+0000 7f659f7fe640 1 -- 172.21.15.82:0/2400406687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a015e150 msgr2=0x7f65a00d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.012+0000 7f659f7fe640 1 --2- 172.21.15.82:0/2400406687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a015e150 0x7f65a00d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.012+0000 7f659f7fe640 1 -- 172.21.15.82:0/2400406687 >> v2:172.21.15.184:3300/0 conn(0x7f65a015e530 msgr2=0x7f65a00ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.012+0000 7f659f7fe640 1 --2- 172.21.15.82:0/2400406687 >> v2:172.21.15.184:3300/0 conn(0x7f65a015e530 0x7f65a00ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.012+0000 7f659f7fe640 1 -- 172.21.15.82:0/2400406687 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a00cf780 con 0x7f65a00d3c80 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.012+0000 7f659effd640 1 --2- 172.21.15.82:0/2400406687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a015e150 0x7f65a00d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.012+0000 7f659e7fc640 1 --2- 172.21.15.82:0/2400406687 >> v2:172.21.15.184:3300/0 conn(0x7f65a015e530 0x7f65a00ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:51:43.013 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.012+0000 7f659f7fe640 1 --2- 172.21.15.82:0/2400406687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a00d3c80 0x7f65a00d40f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f65a00b6b90 tx=0x7f659802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e666b8ad2a35a77a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:43.014 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f659dffb640 1 -- 172.21.15.82:0/2400406687 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598036070 con 0x7f65a00d3c80 2024-06-02T22:51:43.014 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f659dffb640 1 -- 172.21.15.82:0/2400406687 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6598031600 con 0x7f65a00d3c80 2024-06-02T22:51:43.014 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f659dffb640 1 -- 172.21.15.82:0/2400406687 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65980319d0 con 0x7f65a00d3c80 2024-06-02T22:51:43.016 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f65a5942640 1 -- 172.21.15.82:0/2400406687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a00d3c80 msgr2=0x7f65a00d40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f65a5942640 1 --2- 172.21.15.82:0/2400406687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a00d3c80 0x7f65a00d40f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f65a00b6b90 tx=0x7f659802a610 comp rx=0 tx=0).stop 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f65a5942640 1 -- 172.21.15.82:0/2400406687 shutdown_connections 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f65a5942640 1 --2- 172.21.15.82:0/2400406687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a00d3c80 0x7f65a00d40f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f65a5942640 1 --2- 172.21.15.82:0/2400406687 >> v2:172.21.15.184:3300/0 conn(0x7f65a015e530 0x7f65a00ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f65a5942640 1 --2- 172.21.15.82:0/2400406687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a015e150 0x7f65a00d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f65a5942640 1 -- 172.21.15.82:0/2400406687 >> 172.21.15.82:0/2400406687 conn(0x7f65a0067c30 msgr2=0x7f65a009d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f65a5942640 1 -- 172.21.15.82:0/2400406687 shutdown_connections 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.013+0000 7f65a5942640 1 -- 172.21.15.82:0/2400406687 wait complete. 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.014+0000 7f65a5942640 1 Processor -- start 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.015+0000 7f65a5942640 1 -- start start 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.015+0000 7f65a5942640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a00d3c80 0x7f65a015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.015+0000 7f65a5942640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a015e150 0x7f65a00b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.015+0000 7f65a5942640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65a015e530 0x7f65a00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:43.017 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.015+0000 7f65a5942640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65a00cf0b0 con 0x7f65a015e150 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.015+0000 7f65a5942640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f65a00cfd40 con 0x7f65a015e530 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.015+0000 7f65a5942640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f65a00cf230 con 0x7f65a00d3c80 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f659e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a015e150 0x7f65a00b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f659e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a015e150 0x7f65a00b5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48882/0 (socket says 172.21.15.82:48882) 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f659e7fc640 1 -- 172.21.15.82:0/1708682839 learned_addr learned my addr 172.21.15.82:0/1708682839 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f659f7fe640 1 --2- 172.21.15.82:0/1708682839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65a015e530 0x7f65a00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f659effd640 1 --2- 172.21.15.82:0/1708682839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a00d3c80 0x7f65a015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f659e7fc640 1 -- 172.21.15.82:0/1708682839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a00d3c80 msgr2=0x7f65a015a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f659e7fc640 1 --2- 172.21.15.82:0/1708682839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a00d3c80 0x7f65a015a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f659e7fc640 1 -- 172.21.15.82:0/1708682839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65a015e530 msgr2=0x7f65a00b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f659e7fc640 1 --2- 172.21.15.82:0/1708682839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65a015e530 0x7f65a00b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f659e7fc640 1 -- 172.21.15.82:0/1708682839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a00c8d40 con 0x7f65a015e150 2024-06-02T22:51:43.018 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f659e7fc640 1 --2- 172.21.15.82:0/1708682839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a015e150 0x7f65a00b5b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f658800d800 tx=0x7f658800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:43.019 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f6597fff640 1 -- 172.21.15.82:0/1708682839 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658800b660 con 0x7f65a015e150 2024-06-02T22:51:43.019 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f6597fff640 1 -- 172.21.15.82:0/1708682839 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6588019070 con 0x7f65a015e150 2024-06-02T22:51:43.019 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f6597fff640 1 -- 172.21.15.82:0/1708682839 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658800ba20 con 0x7f65a015e150 2024-06-02T22:51:43.019 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f65a5942640 1 -- 172.21.15.82:0/1708682839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a00c9000 con 0x7f65a015e150 2024-06-02T22:51:43.019 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.016+0000 7f65a5942640 1 -- 172.21.15.82:0/1708682839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a015a750 con 0x7f65a015e150 2024-06-02T22:51:43.019 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.017+0000 7f6597fff640 1 -- 172.21.15.82:0/1708682839 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f658800bbc0 con 0x7f65a015e150 2024-06-02T22:51:43.019 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.017+0000 7f6597fff640 1 -- 172.21.15.82:0/1708682839 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6588014bd0 con 0x7f65a015e150 2024-06-02T22:51:43.019 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.017+0000 7f65a5942640 1 -- 172.21.15.82:0/1708682839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a0068cf0 con 0x7f65a015e150 2024-06-02T22:51:43.020 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.019+0000 7f6597fff640 1 -- 172.21.15.82:0/1708682839 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6588014e20 con 0x7f65a015e150 2024-06-02T22:51:43.027 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:43.027+0000 7f1b0231c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T22:51:43.057 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:43.057+0000 7f7cec013040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T22:51:43.080 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.081+0000 7f65a5942640 1 -- 172.21.15.82:0/1708682839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65a00b5690 con 0x7f65a015e150 2024-06-02T22:51:43.081 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.081+0000 7f6597fff640 1 -- 172.21.15.82:0/1708682839 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f65880144c0 con 0x7f65a015e150 2024-06-02T22:51:43.081 INFO:teuthology.misc.health.smithi082.stdout: 2024-06-02T22:51:43.081 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":10,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:51:41.836731+0000","last_up_change":"0.000000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:51:43.082 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.082+0000 7f65a5942640 1 -- 172.21.15.82:0/1708682839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a015e150 msgr2=0x7f65a00b5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:43.082 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.082+0000 7f65a5942640 1 --2- 172.21.15.82:0/1708682839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a015e150 0x7f65a00b5b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f658800d800 tx=0x7f658800dcc0 comp rx=0 tx=0).stop 2024-06-02T22:51:43.082 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.082+0000 7f65a5942640 1 -- 172.21.15.82:0/1708682839 shutdown_connections 2024-06-02T22:51:43.082 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.082+0000 7f65a5942640 1 --2- 172.21.15.82:0/1708682839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65a015e530 0x7f65a00b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:43.083 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.082+0000 7f65a5942640 1 --2- 172.21.15.82:0/1708682839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65a015e150 0x7f65a00b5b50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:43.083 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.082+0000 7f65a5942640 1 --2- 172.21.15.82:0/1708682839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a00d3c80 0x7f65a015a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:43.083 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.082+0000 7f65a5942640 1 -- 172.21.15.82:0/1708682839 >> 172.21.15.82:0/1708682839 conn(0x7f65a0067c30 msgr2=0x7f65a006cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:43.083 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.082+0000 7f65a5942640 1 -- 172.21.15.82:0/1708682839 shutdown_connections 2024-06-02T22:51:43.083 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:43.082+0000 7f65a5942640 1 -- 172.21.15.82:0/1708682839 wait complete. 2024-06-02T22:51:43.092 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-06-02T22:51:43.108 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:43.109+0000 7f7cec013040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T22:51:43.165 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:43.165+0000 7f1b0231c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T22:51:43.178 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:43.179+0000 7f7cec013040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T22:51:43.214 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:43.215+0000 7f1b0231c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T22:51:43.223 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:43.223+0000 7f7cec013040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T22:51:43.284 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:43.285+0000 7f1b0231c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T22:51:43.329 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:43.330+0000 7f1b0231c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T22:51:43.697 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:43.697+0000 7f7cec013040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T22:51:43.806 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:43.806+0000 7f1b0231c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T22:51:43.813 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:43.813+0000 7f7cec013040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T22:51:43.929 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-06-02T22:51:43.929+0000 7f1b0231c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T22:51:44.828 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:44.828+0000 7f7c8c82d640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-02T22:51:44.828 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-06-02T22:51:44.829+0000 7f7c8c82d640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-02T22:51:45.966 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-06-02T22:51:45.966+0000 7f1a6e968640 -1 osd.1 0 log_to_monitors true 2024-06-02T22:51:45.994 INFO:tasks.ceph.osd.3.smithi082.stderr:2024-06-02T22:51:45.995+0000 7f4ea47cb640 -1 osd.3 0 log_to_monitors true 2024-06-02T22:51:46.000 INFO:tasks.ceph.osd.0.smithi082.stderr:2024-06-02T22:51:46.000+0000 7f5a63a0d640 -1 osd.0 0 log_to_monitors true 2024-06-02T22:51:46.000 INFO:tasks.ceph.osd.2.smithi082.stderr:2024-06-02T22:51:46.000+0000 7fab042fd640 -1 osd.2 0 log_to_monitors true 2024-06-02T22:51:46.008 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-06-02T22:51:46.008+0000 7f70e5a23640 -1 osd.6 0 log_to_monitors true 2024-06-02T22:51:46.051 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-06-02T22:51:46.051+0000 7f2753217640 -1 osd.5 0 log_to_monitors true 2024-06-02T22:51:46.057 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-06-02T22:51:46.058+0000 7f5f80aaf640 -1 osd.7 0 log_to_monitors true 2024-06-02T22:51:46.065 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-06-02T22:51:46.066+0000 7f555a622640 -1 osd.4 0 log_to_monitors true 2024-06-02T22:51:49.855 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-06-02T22:51:49.855+0000 7f555672e640 -1 osd.4 0 waiting for initial osdmap 2024-06-02T22:51:49.875 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-06-02T22:51:49.875+0000 7f554dd3a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:51:49.898 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-02T22:51:49.904 INFO:tasks.ceph.osd.2.smithi082.stderr:2024-06-02T22:51:49.903+0000 7fab00293640 -1 osd.2 0 waiting for initial osdmap 2024-06-02T22:51:49.926 INFO:tasks.ceph.osd.2.smithi082.stderr:2024-06-02T22:51:49.925+0000 7faaf80b3640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:51:49.941 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-06-02T22:51:49.941+0000 7f274ec07640 -1 osd.5 0 waiting for initial osdmap 2024-06-02T22:51:49.956 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-06-02T22:51:49.957+0000 7f2746a27640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:51:49.959 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-06-02T22:51:49.958+0000 7f1a6a8fe640 -1 osd.1 0 waiting for initial osdmap 2024-06-02T22:51:49.965 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-06-02T22:51:49.965+0000 7f70e1467640 -1 osd.6 0 waiting for initial osdmap 2024-06-02T22:51:49.965 INFO:tasks.ceph.osd.0.smithi082.stderr:2024-06-02T22:51:49.964+0000 7f5a5f422640 -1 osd.0 0 waiting for initial osdmap 2024-06-02T22:51:49.968 INFO:tasks.ceph.osd.3.smithi082.stderr:2024-06-02T22:51:49.968+0000 7f4ea0761640 -1 osd.3 0 waiting for initial osdmap 2024-06-02T22:51:49.970 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-06-02T22:51:49.970+0000 7f5f7d259640 -1 osd.7 0 waiting for initial osdmap 2024-06-02T22:51:49.972 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-06-02T22:51:49.972+0000 7f1a6271e640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:51:49.974 INFO:tasks.ceph.osd.0.smithi082.stderr:2024-06-02T22:51:49.974+0000 7f5a57242640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:51:49.980 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-06-02T22:51:49.981+0000 7f70d9287640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:51:49.982 INFO:tasks.ceph.osd.3.smithi082.stderr:2024-06-02T22:51:49.982+0000 7f4e98581640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:51:49.990 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-06-02T22:51:49.991+0000 7f5f74865640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:51:50.022 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.018+0000 7feb010a5640 1 Processor -- start 2024-06-02T22:51:50.023 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.018+0000 7feb010a5640 1 -- start start 2024-06-02T22:51:50.023 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.018+0000 7feb010a5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feafc15e150 0x7feafc0d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:50.023 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.018+0000 7feb010a5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feafc0d3c80 0x7feafc0d40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:50.023 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.018+0000 7feb010a5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feafc0d0020 con 0x7feafc15e530 2024-06-02T22:51:50.023 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.019+0000 7feb010a5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7feafc0cf280 con 0x7feafc0d3c80 2024-06-02T22:51:50.023 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.019+0000 7feb010a5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7feafc0d4630 con 0x7feafc15e150 2024-06-02T22:51:50.023 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.019+0000 7feafb59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feafc0d3c80 0x7feafc0d40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:50.023 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.019+0000 7feafa59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7feafc15e530 0x7feafc0ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55094/0 (socket says 172.21.15.82:55094) 2024-06-02T22:51:50.023 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.019+0000 7feafb59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feafc0d3c80 0x7feafc0d40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48994/0 (socket says 172.21.15.82:48994) 2024-06-02T22:51:50.024 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.019+0000 7feafa59c640 1 -- 172.21.15.82:0/649219905 learned_addr learned my addr 172.21.15.82:0/649219905 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:51:50.024 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.019+0000 7feafb59e640 1 -- 172.21.15.82:0/649219905 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feafc15e150 msgr2=0x7feafc0d2a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:51:50.024 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.019+0000 7feafb59e640 1 --2- 172.21.15.82:0/649219905 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feafc15e150 0x7feafc0d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:50.024 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.019+0000 7feaf9d9b640 1 -- 172.21.15.82:0/649219905 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067454828 0 0) 0x7feafc0d0020 con 0x7feafc15e530 2024-06-02T22:51:50.024 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.019+0000 7feafb59e640 1 -- 172.21.15.82:0/649219905 >> v1:172.21.15.82:6789/0 conn(0x7feafc15e530 legacy=0x7feafc0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:50.024 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.019+0000 7feafb59e640 1 -- 172.21.15.82:0/649219905 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc0cf4a0 con 0x7feafc0d3c80 2024-06-02T22:51:50.024 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feafb59e640 1 --2- 172.21.15.82:0/649219905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc0d3c80 0x7feafc0d40f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009d90 tx=0x7feaf402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cda9d93f5fdd0a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:50.024 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feaf9d9b640 1 -- 172.21.15.82:0/649219905 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4031600 con 0x7feafc0d3c80 2024-06-02T22:51:50.024 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feaf9d9b640 1 -- 172.21.15.82:0/649219905 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf40317a0 con 0x7feafc0d3c80 2024-06-02T22:51:50.024 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feaf9d9b640 1 -- 172.21.15.82:0/649219905 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4031b70 con 0x7feafc0d3c80 2024-06-02T22:51:50.024 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feb010a5640 1 -- 172.21.15.82:0/649219905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc0d3c80 msgr2=0x7feafc0d40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:50.025 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feb010a5640 1 --2- 172.21.15.82:0/649219905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc0d3c80 0x7feafc0d40f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009d90 tx=0x7feaf402a5d0 comp rx=0 tx=0).stop 2024-06-02T22:51:50.025 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feb010a5640 1 -- 172.21.15.82:0/649219905 shutdown_connections 2024-06-02T22:51:50.025 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feb010a5640 1 --2- 172.21.15.82:0/649219905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc0d3c80 0x7feafc0d40f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:50.025 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feb010a5640 1 --2- 172.21.15.82:0/649219905 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feafc15e150 0x7feafc0d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:50.025 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feb010a5640 1 -- 172.21.15.82:0/649219905 >> 172.21.15.82:0/649219905 conn(0x7feafc067c30 msgr2=0x7feafc09d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:50.025 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feb010a5640 1 -- 172.21.15.82:0/649219905 shutdown_connections 2024-06-02T22:51:50.025 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.020+0000 7feb010a5640 1 -- 172.21.15.82:0/649219905 wait complete. 2024-06-02T22:51:50.025 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.022+0000 7feb010a5640 1 Processor -- start 2024-06-02T22:51:50.025 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.022+0000 7feb010a5640 1 -- start start 2024-06-02T22:51:50.028 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.022+0000 7feb010a5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feafc0d3c80 0x7feafc1f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:50.028 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.022+0000 7feb010a5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc15e150 0x7feafc0b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:50.028 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.022+0000 7feb010a5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feafc15e530 0x7feafc0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:50.028 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.022+0000 7feb010a5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feafc0cfd40 con 0x7feafc15e150 2024-06-02T22:51:50.028 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.022+0000 7feb010a5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7feafc0cfa60 con 0x7feafc15e530 2024-06-02T22:51:50.028 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.022+0000 7feb010a5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7feafc0cb410 con 0x7feafc0d3c80 2024-06-02T22:51:50.028 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feafa59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc15e150 0x7feafc0b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:50.028 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feafa59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc15e150 0x7feafc0b6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48998/0 (socket says 172.21.15.82:48998) 2024-06-02T22:51:50.028 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feafa59c640 1 -- 172.21.15.82:0/2060128162 learned_addr learned my addr 172.21.15.82:0/2060128162 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feafad9d640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feafc0d3c80 0x7feafc1f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feafb59e640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feafc15e530 0x7feafc0b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feafa59c640 1 -- 172.21.15.82:0/2060128162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feafc0d3c80 msgr2=0x7feafc1f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feafa59c640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feafc0d3c80 0x7feafc1f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feafa59c640 1 -- 172.21.15.82:0/2060128162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feafc15e530 msgr2=0x7feafc0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feafa59c640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feafc15e530 0x7feafc0b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feafa59c640 1 -- 172.21.15.82:0/2060128162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc0b7100 con 0x7feafc15e150 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feafa59c640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc15e150 0x7feafc0b6bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feaf000c3e0 tx=0x7feaf000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feae37fe640 1 -- 172.21.15.82:0/2060128162 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf00074e0 con 0x7feafc15e150 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feae37fe640 1 -- 172.21.15.82:0/2060128162 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf00047e0 con 0x7feafc15e150 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feb010a5640 1 -- 172.21.15.82:0/2060128162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feafc0b73a0 con 0x7feafc15e150 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feae37fe640 1 -- 172.21.15.82:0/2060128162 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0004bd0 con 0x7feafc15e150 2024-06-02T22:51:50.029 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.023+0000 7feb010a5640 1 -- 172.21.15.82:0/2060128162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feafc0b7c40 con 0x7feafc15e150 2024-06-02T22:51:50.030 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.024+0000 7feb010a5640 1 -- 172.21.15.82:0/2060128162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feafc0b7790 con 0x7feafc15e150 2024-06-02T22:51:50.030 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.025+0000 7feae37fe640 1 -- 172.21.15.82:0/2060128162 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7feaf0011070 con 0x7feafc15e150 2024-06-02T22:51:50.030 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.025+0000 7feae37fe640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feae806bda0 0x7feae806e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:50.030 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.026+0000 7feafad9d640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feae806bda0 0x7feae806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:50.030 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.026+0000 7feae37fe640 1 -- 172.21.15.82:0/2060128162 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7feaf0089a90 con 0x7feafc15e150 2024-06-02T22:51:50.030 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.026+0000 7feafad9d640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feae806bda0 0x7feae806e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feaec009990 tx=0x7feaec009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:50.031 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.030+0000 7feae37fe640 1 -- 172.21.15.82:0/2060128162 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7feaf0059220 con 0x7feafc15e150 2024-06-02T22:51:50.207 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.206+0000 7feb010a5640 1 -- 172.21.15.82:0/2060128162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feafc0ca650 con 0x7feafc15e150 2024-06-02T22:51:50.208 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.207+0000 7feae37fe640 1 -- 172.21.15.82:0/2060128162 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7feaf0058b20 con 0x7feafc15e150 2024-06-02T22:51:50.208 INFO:teuthology.misc.health.smithi082.stdout: 2024-06-02T22:51:50.208 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":12,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:51:47.830078+0000","last_up_change":"0.000000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:51:50.210 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 -- 172.21.15.82:0/2060128162 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feae806bda0 msgr2=0x7feae806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:50.210 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feae806bda0 0x7feae806e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feaec009990 tx=0x7feaec009110 comp rx=0 tx=0).stop 2024-06-02T22:51:50.210 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 -- 172.21.15.82:0/2060128162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc15e150 msgr2=0x7feafc0b6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:50.210 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc15e150 0x7feafc0b6bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feaf000c3e0 tx=0x7feaf000c7e0 comp rx=0 tx=0).stop 2024-06-02T22:51:50.210 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 -- 172.21.15.82:0/2060128162 shutdown_connections 2024-06-02T22:51:50.210 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feae806bda0 0x7feae806e260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:50.210 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feafc15e530 0x7feafc0b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:50.210 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feafc15e150 0x7feafc0b6bc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:50.210 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 --2- 172.21.15.82:0/2060128162 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feafc0d3c80 0x7feafc1f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:50.211 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 -- 172.21.15.82:0/2060128162 >> 172.21.15.82:0/2060128162 conn(0x7feafc067c30 msgr2=0x7feafc09d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:50.211 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 -- 172.21.15.82:0/2060128162 shutdown_connections 2024-06-02T22:51:50.211 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:50.209+0000 7feb010a5640 1 -- 172.21.15.82:0/2060128162 wait complete. 2024-06-02T22:51:50.219 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-06-02T22:51:57.026 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-02T22:51:57.127 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.127+0000 7fdef4c7d640 1 Processor -- start 2024-06-02T22:51:57.127 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.127+0000 7fdef4c7d640 1 -- start start 2024-06-02T22:51:57.128 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.128+0000 7fdef4c7d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef00ccfc0 0x7fdef00cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.128 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.128+0000 7fdef4c7d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdef00cfb60 0x7fdef00cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.129 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.128+0000 7fdef4c7d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef00d0530 con 0x7fdef015bec0 2024-06-02T22:51:57.129 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.128+0000 7fdef4c7d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fdef00cf110 con 0x7fdef00cfb60 2024-06-02T22:51:57.129 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.128+0000 7fdef4c7d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdef00d0800 con 0x7fdef00ccfc0 2024-06-02T22:51:57.129 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.128+0000 7fdeeed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdef00cfb60 0x7fdef00cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.129 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.128+0000 7fdeeed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdef00cfb60 0x7fdef00cfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48596/0 (socket says 172.21.15.82:48596) 2024-06-02T22:51:57.129 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.128+0000 7fdeeed9d640 1 -- 172.21.15.82:0/2232256834 learned_addr learned my addr 172.21.15.82:0/2232256834 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:57.129 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.129+0000 7fdee5d9b640 1 --2- 172.21.15.82:0/2232256834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef00ccfc0 0x7fdef00cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.129 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.129+0000 7fdeeed9d640 1 -- 172.21.15.82:0/2232256834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef00ccfc0 msgr2=0x7fdef00cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:57.129 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.129+0000 7fdeeed9d640 1 --2- 172.21.15.82:0/2232256834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef00ccfc0 0x7fdef00cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.129 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.129+0000 7fdeeed9d640 1 -- 172.21.15.82:0/2232256834 >> v1:172.21.15.184:6789/0 conn(0x7fdef015bec0 legacy=0x7fdef00cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:57.129 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.129+0000 7fdeeed9d640 1 -- 172.21.15.82:0/2232256834 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef00ceac0 con 0x7fdef00cfb60 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.129+0000 7fdeeed9d640 1 --2- 172.21.15.82:0/2232256834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00cfb60 0x7fdef00cfff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009e50 tx=0x7fdee802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e107a9bbf81b5ff server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.129+0000 7fdeedd9b640 1 -- 172.21.15.82:0/2232256834 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8036070 con 0x7fdef00cfb60 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.129+0000 7fdeedd9b640 1 -- 172.21.15.82:0/2232256834 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee8031600 con 0x7fdef00cfb60 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.130+0000 7fdeedd9b640 1 -- 172.21.15.82:0/2232256834 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee80319d0 con 0x7fdef00cfb60 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.130+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2232256834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00cfb60 msgr2=0x7fdef00cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.130+0000 7fdef4c7d640 1 --2- 172.21.15.82:0/2232256834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00cfb60 0x7fdef00cfff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009e50 tx=0x7fdee802a680 comp rx=0 tx=0).stop 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.130+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2232256834 shutdown_connections 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.130+0000 7fdef4c7d640 1 --2- 172.21.15.82:0/2232256834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00cfb60 0x7fdef00cfff0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.130+0000 7fdef4c7d640 1 --2- 172.21.15.82:0/2232256834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef00ccfc0 0x7fdef00cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.130+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2232256834 >> 172.21.15.82:0/2232256834 conn(0x7fdef006b5a0 msgr2=0x7fdef006b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.130+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2232256834 shutdown_connections 2024-06-02T22:51:57.131 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.130+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2232256834 wait complete. 2024-06-02T22:51:57.133 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.132+0000 7fdef4c7d640 1 Processor -- start 2024-06-02T22:51:57.133 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.132+0000 7fdef4c7d640 1 -- start start 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.132+0000 7fdef4c7d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdef00ccfc0 0x7fdef009d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.132+0000 7fdef4c7d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef00cfb60 0x7fdef009af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.132+0000 7fdef4c7d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef015bec0 0x7fdef01e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.132+0000 7fdef4c7d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdef015c420 con 0x7fdef015bec0 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.132+0000 7fdef4c7d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdef015c2a0 con 0x7fdef00ccfc0 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.132+0000 7fdef4c7d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdef0071c10 con 0x7fdef00cfb60 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdeeed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef015bec0 0x7fdef01e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdeeed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef015bec0 0x7fdef01e7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48602/0 (socket says 172.21.15.82:48602) 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdeeed9d640 1 -- 172.21.15.82:0/2828113224 learned_addr learned my addr 172.21.15.82:0/2828113224 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdee5d9b640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef00cfb60 0x7fdef009af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdeee59c640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdef00ccfc0 0x7fdef009d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdeeed9d640 1 -- 172.21.15.82:0/2828113224 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef00cfb60 msgr2=0x7fdef009af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:57.134 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdeeed9d640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef00cfb60 0x7fdef009af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.135 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdeeed9d640 1 -- 172.21.15.82:0/2828113224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdef00ccfc0 msgr2=0x7fdef009d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:57.135 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdeeed9d640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdef00ccfc0 0x7fdef009d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.135 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdeeed9d640 1 -- 172.21.15.82:0/2828113224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef01483a0 con 0x7fdef015bec0 2024-06-02T22:51:57.135 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdeeed9d640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef015bec0 0x7fdef01e7be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdee8034040 tx=0x7fdee8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:57.135 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdee77fe640 1 -- 172.21.15.82:0/2828113224 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8036050 con 0x7fdef015bec0 2024-06-02T22:51:57.135 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdee77fe640 1 -- 172.21.15.82:0/2828113224 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee8042070 con 0x7fdef015bec0 2024-06-02T22:51:57.135 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdee77fe640 1 -- 172.21.15.82:0/2828113224 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8009510 con 0x7fdef015bec0 2024-06-02T22:51:57.135 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2828113224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef009cd10 con 0x7fdef015bec0 2024-06-02T22:51:57.135 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.133+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2828113224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef009dd30 con 0x7fdef015bec0 2024-06-02T22:51:57.136 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.134+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2828113224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef0068cf0 con 0x7fdef015bec0 2024-06-02T22:51:57.136 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.135+0000 7fdee77fe640 1 -- 172.21.15.82:0/2828113224 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdee8007c50 con 0x7fdef015bec0 2024-06-02T22:51:57.136 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.135+0000 7fdee77fe640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fded006be30 0x7fded006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.136 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.135+0000 7fdee77fe640 1 -- 172.21.15.82:0/2828113224 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fdee80ab7f0 con 0x7fdef015bec0 2024-06-02T22:51:57.136 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.135+0000 7fdeee59c640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fded006be30 0x7fded006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.136 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.136+0000 7fdeee59c640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fded006be30 0x7fded006e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdee0001780 tx=0x7fdee0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:57.139 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.140+0000 7fdee77fe640 1 -- 172.21.15.82:0/2828113224 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdee8079f30 con 0x7fdef015bec0 2024-06-02T22:51:57.313 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.313+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2828113224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdef0068840 con 0x7fdef015bec0 2024-06-02T22:51:57.313 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.314+0000 7fdee77fe640 1 -- 172.21.15.82:0/2828113224 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7fdee807e230 con 0x7fdef015bec0 2024-06-02T22:51:57.314 INFO:teuthology.misc.health.smithi082.stdout: 2024-06-02T22:51:57.314 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":16,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:51:53.865062+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:51:57.316 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2828113224 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fded006be30 msgr2=0x7fded006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:57.316 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fded006be30 0x7fded006e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdee0001780 tx=0x7fdee0009040 comp rx=0 tx=0).stop 2024-06-02T22:51:57.316 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2828113224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef015bec0 msgr2=0x7fdef01e7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:57.316 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef015bec0 0x7fdef01e7be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdee8034040 tx=0x7fdee8004a40 comp rx=0 tx=0).stop 2024-06-02T22:51:57.316 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2828113224 shutdown_connections 2024-06-02T22:51:57.316 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fded006be30 0x7fded006e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.316 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef015bec0 0x7fdef01e7be0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.316 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef00cfb60 0x7fdef009af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.316 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 --2- 172.21.15.82:0/2828113224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdef00ccfc0 0x7fdef009d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.316 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2828113224 >> 172.21.15.82:0/2828113224 conn(0x7fdef006b5a0 msgr2=0x7fdef00ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:57.317 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2828113224 shutdown_connections 2024-06-02T22:51:57.317 INFO:teuthology.misc.health.smithi082.stderr:2024-06-02T22:51:57.316+0000 7fdef4c7d640 1 -- 172.21.15.82:0/2828113224 wait complete. 2024-06-02T22:51:57.325 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-06-02T22:51:57.325 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-06-02T22:51:57.326 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-02T22:51:57.326 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-02T22:51:57.328 INFO:tasks.ceph.mds.a:Started 2024-06-02T22:51:57.328 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-02T22:51:57.328 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-02T22:51:57.330 INFO:tasks.ceph.mds.c:Started 2024-06-02T22:51:57.330 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-02T22:51:57.330 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-02T22:51:57.333 INFO:tasks.ceph.mds.b:Started 2024-06-02T22:51:57.333 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-02T22:51:57.334 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-02T22:51:57.336 INFO:tasks.ceph.mds.d:Started 2024-06-02T22:51:57.336 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-06-02T22:51:57.336 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:51:57.418 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2024-06-02T22:51:57.418 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2024-06-02T22:51:57.427 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2024-06-02T22:51:57.427 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2024-06-02T22:51:57.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.440+0000 7f5eda58b640 1 Processor -- start 2024-06-02T22:51:57.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.440+0000 7f5eda58b640 1 -- start start 2024-06-02T22:51:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.441+0000 7f5eda58b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5ed40d2680 0x7f5ed415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.441+0000 7f5eda58b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ed40d1fc0 0x7f5ed40d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.441+0000 7f5eda58b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ed4161fa0 0x7f5ed4162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.441+0000 7f5eda58b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5ed40d13e0 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.441+0000 7f5eda58b640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f5ed40d2fa0 con 0x7f5ed40d2680 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.441+0000 7f5eda58b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed40d0ad0 con 0x7f5ed4161fa0 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.441+0000 7f5ed37fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ed40d1fc0 0x7f5ed40d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.441+0000 7f5ed37fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ed40d1fc0 0x7f5ed40d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48648/0 (socket says 172.21.15.82:48648) 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.441+0000 7f5ed37fe640 1 -- 172.21.15.82:0/1342929249 learned_addr learned my addr 172.21.15.82:0/1342929249 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.442+0000 7f5ed8b28640 1 --2- 172.21.15.82:0/1342929249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ed4161fa0 0x7f5ed4162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.442+0000 7f5ed3fff640 1 --2- 172.21.15.82:0/1342929249 >> v2:172.21.15.184:3300/0 conn(0x7f5ed40d2680 0x7f5ed415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.442+0000 7f5ed37fe640 1 -- 172.21.15.82:0/1342929249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ed4161fa0 msgr2=0x7f5ed4162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.442+0000 7f5ed37fe640 1 --2- 172.21.15.82:0/1342929249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ed4161fa0 0x7f5ed4162410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.442+0000 7f5ed37fe640 1 -- 172.21.15.82:0/1342929249 >> v2:172.21.15.184:3300/0 conn(0x7f5ed40d2680 msgr2=0x7f5ed415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.442+0000 7f5ed37fe640 1 --2- 172.21.15.82:0/1342929249 >> v2:172.21.15.184:3300/0 conn(0x7f5ed40d2680 0x7f5ed415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.442+0000 7f5ed37fe640 1 -- 172.21.15.82:0/1342929249 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed415f890 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.442+0000 7f5ed37fe640 1 --2- 172.21.15.82:0/1342929249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ed40d1fc0 0x7f5ed40d2a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ed408ca40 tx=0x7f5ec802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf9dac4bb2d71ea server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.442+0000 7f5ed2ffd640 1 -- 172.21.15.82:0/1342929249 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8037070 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.442+0000 7f5ed2ffd640 1 -- 172.21.15.82:0/1342929249 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec8032440 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.442+0000 7f5ed2ffd640 1 -- 172.21.15.82:0/1342929249 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8032810 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.443+0000 7f5eda58b640 1 -- 172.21.15.82:0/1342929249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ed40d1fc0 msgr2=0x7f5ed40d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.443+0000 7f5eda58b640 1 --2- 172.21.15.82:0/1342929249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ed40d1fc0 0x7f5ed40d2a60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ed408ca40 tx=0x7f5ec802a1e0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.443+0000 7f5eda58b640 1 -- 172.21.15.82:0/1342929249 shutdown_connections 2024-06-02T22:51:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.443+0000 7f5eda58b640 1 --2- 172.21.15.82:0/1342929249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ed4161fa0 0x7f5ed4162410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.443+0000 7f5eda58b640 1 --2- 172.21.15.82:0/1342929249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ed40d1fc0 0x7f5ed40d2a60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.443+0000 7f5eda58b640 1 --2- 172.21.15.82:0/1342929249 >> v2:172.21.15.184:3300/0 conn(0x7f5ed40d2680 0x7f5ed415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.443+0000 7f5eda58b640 1 -- 172.21.15.82:0/1342929249 >> 172.21.15.82:0/1342929249 conn(0x7f5ed409d3f0 msgr2=0x7f5ed40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.443+0000 7f5eda58b640 1 -- 172.21.15.82:0/1342929249 shutdown_connections 2024-06-02T22:51:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.443+0000 7f5eda58b640 1 -- 172.21.15.82:0/1342929249 wait complete. 2024-06-02T22:51:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.444+0000 7f5eda58b640 1 Processor -- start 2024-06-02T22:51:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.444+0000 7f5eda58b640 1 -- start start 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5eda58b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ed40d1fc0 0x7f5ed40b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5eda58b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ed40d2680 0x7f5ed414ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5eda58b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ed4161fa0 0x7f5ed414e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5eda58b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed40d2400 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5eda58b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed40d1070 con 0x7f5ed40d2680 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5eda58b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed40d4f00 con 0x7f5ed4161fa0 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5ed3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ed40d1fc0 0x7f5ed40b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5ed3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ed40d1fc0 0x7f5ed40b7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48650/0 (socket says 172.21.15.82:48650) 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5ed3fff640 1 -- 172.21.15.82:0/3407072467 learned_addr learned my addr 172.21.15.82:0/3407072467 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5ed8b28640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ed4161fa0 0x7f5ed414e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5ed3fff640 1 -- 172.21.15.82:0/3407072467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ed4161fa0 msgr2=0x7f5ed414e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5ed3fff640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ed4161fa0 0x7f5ed414e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5ed3fff640 1 -- 172.21.15.82:0/3407072467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ed40d2680 msgr2=0x7f5ed414ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5ed3fff640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ed40d2680 0x7f5ed414ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.445+0000 7f5ed3fff640 1 -- 172.21.15.82:0/3407072467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed414e5b0 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.446+0000 7f5ed3fff640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ed40d1fc0 0x7f5ed40b7d30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400d830 tx=0x7f5ec400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.446+0000 7f5ed0ff9640 1 -- 172.21.15.82:0/3407072467 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4018020 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.446+0000 7f5ed0ff9640 1 -- 172.21.15.82:0/3407072467 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec40096a0 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.446+0000 7f5ed0ff9640 1 -- 172.21.15.82:0/3407072467 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4009a70 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.446+0000 7f5eda58b640 1 -- 172.21.15.82:0/3407072467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed40b8310 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.446+0000 7f5eda58b640 1 -- 172.21.15.82:0/3407072467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed40b88d0 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.447+0000 7f5eda58b640 1 -- 172.21.15.82:0/3407072467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed4068430 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.447+0000 7f5ed0ff9640 1 -- 172.21.15.82:0/3407072467 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ec401b020 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.448+0000 7f5ed0ff9640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5ec006be30 0x7f5ec006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.448+0000 7f5ed0ff9640 1 -- 172.21.15.82:0/3407072467 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5ec408aee0 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.448+0000 7f5ed37fe640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5ec006be30 0x7f5ec006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.448+0000 7f5ed37fe640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5ec006be30 0x7f5ec006e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8034000 tx=0x7f5ec802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:57.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.452+0000 7f5ed0ff9640 1 -- 172.21.15.82:0/3407072467 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5ec4022030 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.664+0000 7f5eda58b640 1 -- 172.21.15.82:0/3407072467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ed40d04e0 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.664+0000 7f5ed0ff9640 1 -- 172.21.15.82:0/3407072467 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f5ec40102e0 con 0x7f5ed40d1fc0 2024-06-02T22:51:57.664 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:51:57.664 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-02T22:51:57.665 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 2 2024-06-02T22:51:57.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 -- 172.21.15.82:0/3407072467 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5ec006be30 msgr2=0x7f5ec006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:57.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5ec006be30 0x7f5ec006e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8034000 tx=0x7f5ec802c000 comp rx=0 tx=0).stop 2024-06-02T22:51:57.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 -- 172.21.15.82:0/3407072467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ed40d1fc0 msgr2=0x7f5ed40b7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ed40d1fc0 0x7f5ed40b7d30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400d830 tx=0x7f5ec400dcf0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 -- 172.21.15.82:0/3407072467 shutdown_connections 2024-06-02T22:51:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5ec006be30 0x7f5ec006e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ed4161fa0 0x7f5ed414e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ed40d2680 0x7f5ed414ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 --2- 172.21.15.82:0/3407072467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ed40d1fc0 0x7f5ed40b7d30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 -- 172.21.15.82:0/3407072467 >> 172.21.15.82:0/3407072467 conn(0x7f5ed409d3f0 msgr2=0x7f5ed40b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 -- 172.21.15.82:0/3407072467 shutdown_connections 2024-06-02T22:51:57.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:57.666+0000 7f5eda58b640 1 -- 172.21.15.82:0/3407072467 wait complete. 2024-06-02T22:51:59.677 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:51:59.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.790+0000 7efd669e2640 1 Processor -- start 2024-06-02T22:51:59.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.790+0000 7efd669e2640 1 -- start start 2024-06-02T22:51:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.791+0000 7efd669e2640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efd60161cc0 0x7efd600d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.791+0000 7efd669e2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd600d4cd0 0x7efd600d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.791+0000 7efd669e2640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd600d03e0 con 0x7efd601618e0 2024-06-02T22:51:59.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.791+0000 7efd669e2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7efd600b4130 con 0x7efd600d4cd0 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.791+0000 7efd669e2640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7efd600d0100 con 0x7efd60161cc0 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.791+0000 7efd64f7f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd600d4cd0 0x7efd600d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.791+0000 7efd64f7f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efd600d4cd0 0x7efd600d2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48654/0 (socket says 172.21.15.82:48654) 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.791+0000 7efd64f7f640 1 -- 172.21.15.82:0/1906995629 learned_addr learned my addr 172.21.15.82:0/1906995629 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.791+0000 7efd5f7fe640 1 --2- 172.21.15.82:0/1906995629 >> v2:172.21.15.184:3300/0 conn(0x7efd60161cc0 0x7efd600d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.792+0000 7efd64f7f640 1 -- 172.21.15.82:0/1906995629 >> v2:172.21.15.184:3300/0 conn(0x7efd60161cc0 msgr2=0x7efd600d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.792+0000 7efd64f7f640 1 --2- 172.21.15.82:0/1906995629 >> v2:172.21.15.184:3300/0 conn(0x7efd60161cc0 0x7efd600d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.792+0000 7efd64f7f640 1 -- 172.21.15.82:0/1906995629 >> v1:172.21.15.184:6789/0 conn(0x7efd601618e0 legacy=0x7efd600cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.792+0000 7efd64f7f640 1 -- 172.21.15.82:0/1906995629 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd600b3ae0 con 0x7efd600d4cd0 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.792+0000 7efd64f7f640 1 --2- 172.21.15.82:0/1906995629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd600d4cd0 0x7efd600d2a50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd600cb160 tx=0x7efd5802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e9aa6171beb28 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.792+0000 7efd5effd640 1 -- 172.21.15.82:0/1906995629 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd58036070 con 0x7efd600d4cd0 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.792+0000 7efd5effd640 1 -- 172.21.15.82:0/1906995629 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd58031600 con 0x7efd600d4cd0 2024-06-02T22:51:59.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.793+0000 7efd5effd640 1 -- 172.21.15.82:0/1906995629 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd580319d0 con 0x7efd600d4cd0 2024-06-02T22:51:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.793+0000 7efd669e2640 1 -- 172.21.15.82:0/1906995629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd600d4cd0 msgr2=0x7efd600d2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.793+0000 7efd669e2640 1 --2- 172.21.15.82:0/1906995629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd600d4cd0 0x7efd600d2a50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd600cb160 tx=0x7efd5802a730 comp rx=0 tx=0).stop 2024-06-02T22:51:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.793+0000 7efd669e2640 1 -- 172.21.15.82:0/1906995629 shutdown_connections 2024-06-02T22:51:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.793+0000 7efd669e2640 1 --2- 172.21.15.82:0/1906995629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd600d4cd0 0x7efd600d2a50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.793+0000 7efd669e2640 1 --2- 172.21.15.82:0/1906995629 >> v2:172.21.15.184:3300/0 conn(0x7efd60161cc0 0x7efd600d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.793+0000 7efd669e2640 1 -- 172.21.15.82:0/1906995629 >> 172.21.15.82:0/1906995629 conn(0x7efd6009d410 msgr2=0x7efd600d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.793+0000 7efd669e2640 1 -- 172.21.15.82:0/1906995629 shutdown_connections 2024-06-02T22:51:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.793+0000 7efd669e2640 1 -- 172.21.15.82:0/1906995629 wait complete. 2024-06-02T22:51:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.794+0000 7efd669e2640 1 Processor -- start 2024-06-02T22:51:59.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.794+0000 7efd669e2640 1 -- start start 2024-06-02T22:51:59.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.795+0000 7efd669e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd600d4cd0 0x7efd600b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:59.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.795+0000 7efd669e2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd601618e0 0x7efd600c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:59.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.795+0000 7efd669e2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd60161cc0 0x7efd600ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:59.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.795+0000 7efd669e2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd600b4740 con 0x7efd600d4cd0 2024-06-02T22:51:59.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.795+0000 7efd669e2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efd600b45c0 con 0x7efd601618e0 2024-06-02T22:51:59.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.795+0000 7efd669e2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7efd600b48c0 con 0x7efd60161cc0 2024-06-02T22:51:59.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.795+0000 7efd5ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd600d4cd0 0x7efd600b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:59.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.795+0000 7efd5ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd600d4cd0 0x7efd600b92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48658/0 (socket says 172.21.15.82:48658) 2024-06-02T22:51:59.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.795+0000 7efd5ffff640 1 -- 172.21.15.82:0/2451208955 learned_addr learned my addr 172.21.15.82:0/2451208955 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:51:59.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd5f7fe640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd601618e0 0x7efd600c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd64f7f640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd60161cc0 0x7efd600ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd5ffff640 1 -- 172.21.15.82:0/2451208955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd60161cc0 msgr2=0x7efd600ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd5ffff640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd60161cc0 0x7efd600ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd5ffff640 1 -- 172.21.15.82:0/2451208955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd601618e0 msgr2=0x7efd600c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd5ffff640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd601618e0 0x7efd600c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd5ffff640 1 -- 172.21.15.82:0/2451208955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd600b9800 con 0x7efd600d4cd0 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd5ffff640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd600d4cd0 0x7efd600b92c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c400 tx=0x7efd5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd5cff9640 1 -- 172.21.15.82:0/2451208955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500052d0 con 0x7efd600d4cd0 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd5cff9640 1 -- 172.21.15.82:0/2451208955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd50005490 con 0x7efd600d4cd0 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd669e2640 1 -- 172.21.15.82:0/2451208955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd600cab90 con 0x7efd600d4cd0 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd5cff9640 1 -- 172.21.15.82:0/2451208955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50007260 con 0x7efd600d4cd0 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.796+0000 7efd669e2640 1 -- 172.21.15.82:0/2451208955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd600ca8b0 con 0x7efd600d4cd0 2024-06-02T22:51:59.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.797+0000 7efd669e2640 1 -- 172.21.15.82:0/2451208955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd60068430 con 0x7efd600d4cd0 2024-06-02T22:51:59.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.797+0000 7efd5cff9640 1 -- 172.21.15.82:0/2451208955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd50007400 con 0x7efd600d4cd0 2024-06-02T22:51:59.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.798+0000 7efd5cff9640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd4c06be30 0x7efd4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:59.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.798+0000 7efd5cff9640 1 -- 172.21.15.82:0/2451208955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7efd50089f90 con 0x7efd600d4cd0 2024-06-02T22:51:59.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.798+0000 7efd5f7fe640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd4c06be30 0x7efd4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:59.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.798+0000 7efd5f7fe640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd4c06be30 0x7efd4c06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efd54006fd0 tx=0x7efd54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:51:59.802+0000 7efd5cff9640 1 -- 172.21.15.82:0/2451208955 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efd600b9800 con 0x7efd600d4cd0 2024-06-02T22:52:00.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.015+0000 7efd669e2640 1 -- 172.21.15.82:0/2451208955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd600b61b0 con 0x7efd600d4cd0 2024-06-02T22:52:00.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.015+0000 7efd5cff9640 1 -- 172.21.15.82:0/2451208955 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3867 (secure 0 0 0) 0x7efd50058d20 con 0x7efd600d4cd0 2024-06-02T22:52:00.015 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:00.016 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/598338197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":598338197},{"type":"v1","addr":"172.21.15.184:6835","nonce":598338197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2379089503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2379089503},{"type":"v1","addr":"172.21.15.82:6836","nonce":2379089503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1449064574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1449064574},{"type":"v1","addr":"172.21.15.82:6837","nonce":1449064574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-06-02T22:52:00.016 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2024-06-02T22:52:00.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.017+0000 7efd669e2640 1 -- 172.21.15.82:0/2451208955 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd4c06be30 msgr2=0x7efd4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.018+0000 7efd669e2640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd4c06be30 0x7efd4c06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efd54006fd0 tx=0x7efd54008040 comp rx=0 tx=0).stop 2024-06-02T22:52:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.018+0000 7efd669e2640 1 -- 172.21.15.82:0/2451208955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd600d4cd0 msgr2=0x7efd600b92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.018+0000 7efd669e2640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd600d4cd0 0x7efd600b92c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c400 tx=0x7efd5000c8c0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.018+0000 7efd669e2640 1 -- 172.21.15.82:0/2451208955 shutdown_connections 2024-06-02T22:52:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.018+0000 7efd669e2640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd4c06be30 0x7efd4c06e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.018+0000 7efd669e2640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd60161cc0 0x7efd600ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.018+0000 7efd669e2640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd601618e0 0x7efd600c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.018+0000 7efd669e2640 1 --2- 172.21.15.82:0/2451208955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd600d4cd0 0x7efd600b92c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.018+0000 7efd669e2640 1 -- 172.21.15.82:0/2451208955 >> 172.21.15.82:0/2451208955 conn(0x7efd6009d410 msgr2=0x7efd600cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.018+0000 7efd669e2640 1 -- 172.21.15.82:0/2451208955 shutdown_connections 2024-06-02T22:52:00.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.018+0000 7efd669e2640 1 -- 172.21.15.82:0/2451208955 wait complete. 2024-06-02T22:52:00.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-02T22:52:00.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.127+0000 7ff5bee9a640 1 Processor -- start 2024-06-02T22:52:00.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.127+0000 7ff5bee9a640 1 -- start start 2024-06-02T22:52:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.127+0000 7ff5bee9a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5b80aef70 0x7ff5b80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.127+0000 7ff5bee9a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b815ac50 con 0x7ff5b80af3b0 2024-06-02T22:52:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.127+0000 7ff5bee9a640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b806cdb0 con 0x7ff5b815a870 2024-06-02T22:52:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.127+0000 7ff5bee9a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b806d090 con 0x7ff5b80aef70 2024-06-02T22:52:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5bd437640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff5b80af3b0 0x7ff5b80cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57638/0 (socket says 172.21.15.82:57638) 2024-06-02T22:52:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5bd437640 1 -- 172.21.15.82:0/47344668 learned_addr learned my addr 172.21.15.82:0/47344668 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837090148 0 0) 0x7ff5b815ac50 con 0x7ff5b80af3b0 2024-06-02T22:52:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a8003520 con 0x7ff5b80af3b0 2024-06-02T22:52:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b7fff640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5b80aef70 0x7ff5b80b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1274949035 0 0) 0x7ff5a8003520 con 0x7ff5b80af3b0 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5b80aef70 msgr2=0x7ff5b80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5b80aef70 0x7ff5b80b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 >> v1:172.21.15.184:6789/0 conn(0x7ff5b815a870 legacy=0x7ff5b806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b806d370 con 0x7ff5b80af3b0 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7ff5b00019f0 con 0x7ff5b80af3b0 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b7fff640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5b80aef70 0x7ff5b80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 >> v1:172.21.15.82:6789/0 conn(0x7ff5b80af3b0 legacy=0x7ff5b80cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5b80aef70 0x7ff5a80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003fd0 0x7ff5a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5a8004d40 0x7ff5a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b806d090 con 0x7ff5a8003fd0 2024-06-02T22:52:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a800bbb0 con 0x7ff5a8004d40 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a800bdb0 con 0x7ff5b80aef70 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b7fff640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003fd0 0x7ff5a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5bcc36640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5b80aef70 0x7ff5a80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5bd437640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5a8004d40 0x7ff5a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b7fff640 1 -- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5b80aef70 msgr2=0x7ff5a80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b7fff640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5b80aef70 0x7ff5a80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b7fff640 1 -- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5a8004d40 msgr2=0x7ff5a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b7fff640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5a8004d40 0x7ff5a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5b7fff640 1 -- 172.21.15.82:0/47344668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a8003520 con 0x7ff5a8003fd0 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.128+0000 7ff5bd437640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5a8004d40 0x7ff5a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.129+0000 7ff5b7fff640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003fd0 0x7ff5a8004800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40098a0 tx=0x7ff5a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe392994bcfae7b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.129+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400f040 con 0x7ff5a8003fd0 2024-06-02T22:52:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.129+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a402ace0 con 0x7ff5a8003fd0 2024-06-02T22:52:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.129+0000 7ff5b77fe640 1 -- 172.21.15.82:0/47344668 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4004250 con 0x7ff5a8003fd0 2024-06-02T22:52:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.130+0000 7ff5bee9a640 1 -- 172.21.15.82:0/47344668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003fd0 msgr2=0x7ff5a8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.130+0000 7ff5bee9a640 1 --2- 172.21.15.82:0/47344668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003fd0 0x7ff5a8004800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40098a0 tx=0x7ff5a8005830 comp rx=0 tx=0).stop 2024-06-02T22:52:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.130+0000 7ff5bd437640 1 -- 172.21.15.82:0/47344668 reap_dead start 2024-06-02T22:52:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.130+0000 7ff5bee9a640 1 -- 172.21.15.82:0/47344668 shutdown_connections 2024-06-02T22:52:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.130+0000 7ff5bee9a640 1 -- 172.21.15.82:0/47344668 >> 172.21.15.82:0/47344668 conn(0x7ff5b80b19f0 msgr2=0x7ff5b80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.130+0000 7ff5bee9a640 1 -- 172.21.15.82:0/47344668 shutdown_connections 2024-06-02T22:52:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.130+0000 7ff5bee9a640 1 -- 172.21.15.82:0/47344668 wait complete. 2024-06-02T22:52:00.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.131+0000 7ff5bee9a640 1 Processor -- start 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.131+0000 7ff5bee9a640 1 -- start start 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5bee9a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5a8003fd0 0x7ff5b814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5bee9a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b8146270 0x7ff5b80729b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5bee9a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5b815ba40 0x7ff5b815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5bee9a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b80b2e40 con 0x7ff5b8146270 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5bee9a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b806d930 con 0x7ff5b815ba40 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5bee9a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b80b2fc0 con 0x7ff5a8003fd0 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b8146270 0x7ff5b80729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b8146270 0x7ff5b80729b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48674/0 (socket says 172.21.15.82:48674) 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5b7fff640 1 -- 172.21.15.82:0/2878337343 learned_addr learned my addr 172.21.15.82:0/2878337343 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5bd437640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5b815ba40 0x7ff5b815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5bcc36640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5a8003fd0 0x7ff5b814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5b7fff640 1 -- 172.21.15.82:0/2878337343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5a8003fd0 msgr2=0x7ff5b814c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5b7fff640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5a8003fd0 0x7ff5b814c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5b7fff640 1 -- 172.21.15.82:0/2878337343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5b815ba40 msgr2=0x7ff5b815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5b7fff640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5b815ba40 0x7ff5b815bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5b7fff640 1 -- 172.21.15.82:0/2878337343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b81466f0 con 0x7ff5b8146270 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.132+0000 7ff5b7fff640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b8146270 0x7ff5b80729b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5a402a7d0 tx=0x7ff5a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.133+0000 7ff5b57fa640 1 -- 172.21.15.82:0/2878337343 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4041070 con 0x7ff5b8146270 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.133+0000 7ff5b57fa640 1 -- 172.21.15.82:0/2878337343 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a400f000 con 0x7ff5b8146270 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.133+0000 7ff5bee9a640 1 -- 172.21.15.82:0/2878337343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b8072ef0 con 0x7ff5b8146270 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.133+0000 7ff5b57fa640 1 -- 172.21.15.82:0/2878337343 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4003c50 con 0x7ff5b8146270 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.133+0000 7ff5bee9a640 1 -- 172.21.15.82:0/2878337343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b814d140 con 0x7ff5b8146270 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.134+0000 7ff5bee9a640 1 -- 172.21.15.82:0/2878337343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b80b2650 con 0x7ff5b8146270 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.134+0000 7ff5b57fa640 1 -- 172.21.15.82:0/2878337343 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5a4044070 con 0x7ff5b8146270 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.134+0000 7ff5b57fa640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff59c06be30 0x7ff59c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.134+0000 7ff5b57fa640 1 -- 172.21.15.82:0/2878337343 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff5a40ab220 con 0x7ff5b8146270 2024-06-02T22:52:00.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.134+0000 7ff5bcc36640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff59c06be30 0x7ff59c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.135+0000 7ff5bcc36640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff59c06be30 0x7ff59c06e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0035f0 tx=0x7ff5ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:00.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.139+0000 7ff5b57fa640 1 -- 172.21.15.82:0/2878337343 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff5a4079f20 con 0x7ff5b8146270 2024-06-02T22:52:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.314+0000 7ff5bee9a640 1 -- 172.21.15.82:0/2878337343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff5b8068410 con 0x7ff5b8146270 2024-06-02T22:52:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.314+0000 7ff5b57fa640 1 -- 172.21.15.82:0/2878337343 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7ff5a4079820 con 0x7ff5b8146270 2024-06-02T22:52:00.314 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:00.314 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-06-02T22:52:00.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:00.315 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2024-06-02T22:52:00.315 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2024-06-02T22:52:00.315 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-06-02T22:52:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 -- 172.21.15.82:0/2878337343 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff59c06be30 msgr2=0x7ff59c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff59c06be30 0x7ff59c06e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0035f0 tx=0x7ff5ac009040 comp rx=0 tx=0).stop 2024-06-02T22:52:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 -- 172.21.15.82:0/2878337343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b8146270 msgr2=0x7ff5b80729b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b8146270 0x7ff5b80729b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5a402a7d0 tx=0x7ff5a4004730 comp rx=0 tx=0).stop 2024-06-02T22:52:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 -- 172.21.15.82:0/2878337343 shutdown_connections 2024-06-02T22:52:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff59c06be30 0x7ff59c06e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5b815ba40 0x7ff5b815bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5b8146270 0x7ff5b80729b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 --2- 172.21.15.82:0/2878337343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5a8003fd0 0x7ff5b814c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 -- 172.21.15.82:0/2878337343 >> 172.21.15.82:0/2878337343 conn(0x7ff5b80b19f0 msgr2=0x7ff5b80b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 -- 172.21.15.82:0/2878337343 shutdown_connections 2024-06-02T22:52:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.316+0000 7ff5bee9a640 1 -- 172.21.15.82:0/2878337343 wait complete. 2024-06-02T22:52:00.326 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T22:52:00.327 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T22:52:00.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.430+0000 7fe9b541c640 1 Processor -- start 2024-06-02T22:52:00.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.430+0000 7fe9b541c640 1 -- start start 2024-06-02T22:52:00.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.430+0000 7fe9b541c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe9b00af420 0x7fe9b0071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9b541c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9b0073270 con 0x7fe9b00cd170 2024-06-02T22:52:00.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9b541c640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9b015abf0 con 0x7fe9b015a810 2024-06-02T22:52:00.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9b541c640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fe9b00ce560 con 0x7fe9b00af420 2024-06-02T22:52:00.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9af7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe9b00cd170 0x7fe9b0071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57650/0 (socket says 172.21.15.82:57650) 2024-06-02T22:52:00.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9af7fe640 1 -- 172.21.15.82:0/3812890 learned_addr learned my addr 172.21.15.82:0/3812890 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:00.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604769796 0 0) 0x7fe9b0073270 con 0x7fe9b00cd170 2024-06-02T22:52:00.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9ae7fc640 1 --2- 172.21.15.82:0/3812890 >> v2:172.21.15.184:3300/0 conn(0x7fe9b00af420 0x7fe9b0071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe998003440 con 0x7fe9b00cd170 2024-06-02T22:52:00.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3944761299 0 0) 0x7fe998003440 con 0x7fe9b00cd170 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 >> v2:172.21.15.184:3300/0 conn(0x7fe9b00af420 msgr2=0x7fe9b0071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 --2- 172.21.15.82:0/3812890 >> v2:172.21.15.184:3300/0 conn(0x7fe9b00af420 0x7fe9b0071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 >> v1:172.21.15.184:6789/0 conn(0x7fe9b015a810 legacy=0x7fe9b00b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b00ce7b0 con 0x7fe9b00cd170 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fe9a80019f0 con 0x7fe9b00cd170 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 >> v1:172.21.15.82:6789/0 conn(0x7fe9b00cd170 legacy=0x7fe9b0071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 --2- 172.21.15.82:0/3812890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe998003aa0 0x7fe998003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 --2- 172.21.15.82:0/3812890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe998008900 0x7fe99800ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 --2- 172.21.15.82:0/3812890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe99800b570 0x7fe99800da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b00ce560 con 0x7fe998003aa0 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe99800e310 con 0x7fe998008900 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe99800e510 con 0x7fe99800b570 2024-06-02T22:52:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9ae7fc640 1 --2- 172.21.15.82:0/3812890 >> v2:172.21.15.184:3300/0 conn(0x7fe9b00af420 0x7fe9b0071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9aeffd640 1 --2- 172.21.15.82:0/3812890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe998003aa0 0x7fe998003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9af7fe640 1 --2- 172.21.15.82:0/3812890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe99800b570 0x7fe99800da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.431+0000 7fe9ae7fc640 1 --2- 172.21.15.82:0/3812890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe998008900 0x7fe99800ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.432+0000 7fe9aeffd640 1 -- 172.21.15.82:0/3812890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe99800b570 msgr2=0x7fe99800da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.432+0000 7fe9aeffd640 1 --2- 172.21.15.82:0/3812890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe99800b570 0x7fe99800da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.432+0000 7fe9aeffd640 1 -- 172.21.15.82:0/3812890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe998008900 msgr2=0x7fe99800ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.432+0000 7fe9aeffd640 1 --2- 172.21.15.82:0/3812890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe998008900 0x7fe99800ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.432+0000 7fe9aeffd640 1 -- 172.21.15.82:0/3812890 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe998003440 con 0x7fe998003aa0 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.432+0000 7fe9af7fe640 1 -- 172.21.15.82:0/3812890 reap_dead start 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.432+0000 7fe9aeffd640 1 --2- 172.21.15.82:0/3812890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe998003aa0 0x7fe998003ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0001750 tx=0x7fe998003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993766e923afa4b4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.432+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0001370 con 0x7fe998003aa0 2024-06-02T22:52:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.432+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a00052d0 con 0x7fe998003aa0 2024-06-02T22:52:00.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.432+0000 7fe9adffb640 1 -- 172.21.15.82:0/3812890 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a002abe0 con 0x7fe998003aa0 2024-06-02T22:52:00.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.433+0000 7fe9b541c640 1 -- 172.21.15.82:0/3812890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe998003aa0 msgr2=0x7fe998003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.433+0000 7fe9b541c640 1 --2- 172.21.15.82:0/3812890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe998003aa0 0x7fe998003ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0001750 tx=0x7fe998003730 comp rx=0 tx=0).stop 2024-06-02T22:52:00.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.433+0000 7fe9b541c640 1 -- 172.21.15.82:0/3812890 shutdown_connections 2024-06-02T22:52:00.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.433+0000 7fe9b541c640 1 --2- 172.21.15.82:0/3812890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe998003aa0 0x7fe998003ec0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.433+0000 7fe9b541c640 1 -- 172.21.15.82:0/3812890 >> 172.21.15.82:0/3812890 conn(0x7fe9b00b1980 msgr2=0x7fe9b00b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:00.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.433+0000 7fe9b541c640 1 -- 172.21.15.82:0/3812890 shutdown_connections 2024-06-02T22:52:00.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.433+0000 7fe9b541c640 1 -- 172.21.15.82:0/3812890 wait complete. 2024-06-02T22:52:00.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.434+0000 7fe9b541c640 1 Processor -- start 2024-06-02T22:52:00.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.434+0000 7fe9b541c640 1 -- start start 2024-06-02T22:52:00.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9b541c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe998003aa0 0x7fe9b009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9b541c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b015b6e0 0x7fe9b0156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9b541c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b0071280 0x7fe9b009c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9b541c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b00cf050 con 0x7fe9b015b6e0 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9b541c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b00ced70 con 0x7fe998003aa0 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9b541c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b00cc6d0 con 0x7fe9b0071280 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9ae7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b015b6e0 0x7fe9b0156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9ae7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b015b6e0 0x7fe9b0156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48688/0 (socket says 172.21.15.82:48688) 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9ae7fc640 1 -- 172.21.15.82:0/475321677 learned_addr learned my addr 172.21.15.82:0/475321677 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9ae7fc640 1 -- 172.21.15.82:0/475321677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b0071280 msgr2=0x7fe9b009c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9ae7fc640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b0071280 0x7fe9b009c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9ae7fc640 1 -- 172.21.15.82:0/475321677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe998003aa0 msgr2=0x7fe9b009aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9aeffd640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe998003aa0 0x7fe9b009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9ae7fc640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe998003aa0 0x7fe9b009aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:00.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9ae7fc640 1 -- 172.21.15.82:0/475321677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b0156fe0 con 0x7fe9b015b6e0 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.435+0000 7fe9ae7fc640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b015b6e0 0x7fe9b0156aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4010730 tx=0x7fe9a4010bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.436+0000 7fe9977fe640 1 -- 172.21.15.82:0/475321677 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a401a020 con 0x7fe9b015b6e0 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.436+0000 7fe9977fe640 1 -- 172.21.15.82:0/475321677 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a400e960 con 0x7fe9b015b6e0 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.436+0000 7fe9977fe640 1 -- 172.21.15.82:0/475321677 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a400f040 con 0x7fe9b015b6e0 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.436+0000 7fe9b541c640 1 -- 172.21.15.82:0/475321677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b009b060 con 0x7fe9b015b6e0 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.436+0000 7fe9b541c640 1 -- 172.21.15.82:0/475321677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b009b620 con 0x7fe9b015b6e0 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.437+0000 7fe9b541c640 1 -- 172.21.15.82:0/475321677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b009bde0 con 0x7fe9b015b6e0 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.437+0000 7fe9977fe640 1 -- 172.21.15.82:0/475321677 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9a401d020 con 0x7fe9b015b6e0 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.437+0000 7fe9977fe640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe99c06be30 0x7fe99c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.438+0000 7fe9977fe640 1 -- 172.21.15.82:0/475321677 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe9a408b3d0 con 0x7fe9b015b6e0 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.438+0000 7fe9aeffd640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe99c06be30 0x7fe99c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:00.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.438+0000 7fe9aeffd640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe99c06be30 0x7fe99c06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0032000 tx=0x7fe9a002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:00.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.442+0000 7fe9977fe640 1 -- 172.21.15.82:0/475321677 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe9b009bde0 con 0x7fe9b015b6e0 2024-06-02T22:52:00.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:00.616+0000 7fe9b541c640 1 -- 172.21.15.82:0/475321677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe9b00b25e0 con 0x7fe9b015b6e0 2024-06-02T22:52:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.545+0000 7fe9977fe640 1 -- 172.21.15.82:0/475321677 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fe9a4024020 con 0x7fe9b015b6e0 2024-06-02T22:52:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2024-06-02T22:52:01.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.549+0000 7fe9b541c640 1 -- 172.21.15.82:0/475321677 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe99c06be30 msgr2=0x7fe99c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:01.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.549+0000 7fe9b541c640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe99c06be30 0x7fe99c06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0032000 tx=0x7fe9a002e000 comp rx=0 tx=0).stop 2024-06-02T22:52:01.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.549+0000 7fe9b541c640 1 -- 172.21.15.82:0/475321677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b015b6e0 msgr2=0x7fe9b0156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:01.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.549+0000 7fe9b541c640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b015b6e0 0x7fe9b0156aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4010730 tx=0x7fe9a4010bf0 comp rx=0 tx=0).stop 2024-06-02T22:52:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.549+0000 7fe9b541c640 1 -- 172.21.15.82:0/475321677 shutdown_connections 2024-06-02T22:52:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.549+0000 7fe9b541c640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe99c06be30 0x7fe99c06e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.549+0000 7fe9b541c640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b0071280 0x7fe9b009c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.549+0000 7fe9b541c640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b015b6e0 0x7fe9b0156aa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.549+0000 7fe9b541c640 1 --2- 172.21.15.82:0/475321677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe998003aa0 0x7fe9b009aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.549+0000 7fe9b541c640 1 -- 172.21.15.82:0/475321677 >> 172.21.15.82:0/475321677 conn(0x7fe9b00b1980 msgr2=0x7fe9b0159b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.549+0000 7fe9b541c640 1 -- 172.21.15.82:0/475321677 shutdown_connections 2024-06-02T22:52:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.550+0000 7fe9b541c640 1 -- 172.21.15.82:0/475321677 wait complete. 2024-06-02T22:52:01.565 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-06-02T22:52:01.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.677+0000 7fd8debb7640 1 Processor -- start 2024-06-02T22:52:01.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.677+0000 7fd8debb7640 1 -- start start 2024-06-02T22:52:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.678+0000 7fd8debb7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80d15f0 0x7fd8d80cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.678+0000 7fd8debb7640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd8d80d0430 0x7fd8d815c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.678+0000 7fd8debb7640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d80d0ad0 con 0x7fd8d80cf6f0 2024-06-02T22:52:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.678+0000 7fd8debb7640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d80b0730 con 0x7fd8d80d0430 2024-06-02T22:52:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.678+0000 7fd8debb7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d80cfad0 con 0x7fd8d80d15f0 2024-06-02T22:52:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.678+0000 7fd8dc953640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd8d80cf6f0 0x7fd8d80d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60566/0 (socket says 172.21.15.82:60566) 2024-06-02T22:52:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.678+0000 7fd8dc953640 1 -- 172.21.15.82:0/4186867186 learned_addr learned my addr 172.21.15.82:0/4186867186 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.678+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275141727 0 0) 0x7fd8d80d0ad0 con 0x7fd8d80cf6f0 2024-06-02T22:52:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.678+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8c0003520 con 0x7fd8d80cf6f0 2024-06-02T22:52:01.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8dd154640 1 --2- 172.21.15.82:0/4186867186 >> v2:172.21.15.184:3300/0 conn(0x7fd8d80d0430 0x7fd8d815c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d7fff640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80d15f0 0x7fd8d80cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1251986351 0 0) 0x7fd8c0003520 con 0x7fd8d80cf6f0 2024-06-02T22:52:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80d15f0 msgr2=0x7fd8d80cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80d15f0 0x7fd8d80cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 >> v2:172.21.15.184:3300/0 conn(0x7fd8d80d0430 msgr2=0x7fd8d815c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 --2- 172.21.15.82:0/4186867186 >> v2:172.21.15.184:3300/0 conn(0x7fd8d80d0430 0x7fd8d815c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d815fac0 con 0x7fd8d80cf6f0 2024-06-02T22:52:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fd8c8001670 con 0x7fd8d80cf6f0 2024-06-02T22:52:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8dd154640 1 --2- 172.21.15.82:0/4186867186 >> v2:172.21.15.184:3300/0 conn(0x7fd8d80d0430 0x7fd8d815c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 >> v1:172.21.15.82:6789/0 conn(0x7fd8d80cf6f0 legacy=0x7fd8d80d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80d15f0 0x7fd8c00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c0003fe0 0x7fd8c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c0004d40 0x7fd8c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d80b0730 con 0x7fd8c0003fe0 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d80cfad0 con 0x7fd8c0004d40 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c000bac0 con 0x7fd8d80d15f0 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d7fff640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c0003fe0 0x7fd8c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8dc953640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80d15f0 0x7fd8c00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8dd154640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c0004d40 0x7fd8c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d7fff640 1 -- 172.21.15.82:0/4186867186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80d15f0 msgr2=0x7fd8c00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d7fff640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80d15f0 0x7fd8c00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d7fff640 1 -- 172.21.15.82:0/4186867186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c0004d40 msgr2=0x7fd8c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d7fff640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c0004d40 0x7fd8c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.679+0000 7fd8d7fff640 1 -- 172.21.15.82:0/4186867186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c0003520 con 0x7fd8c0003fe0 2024-06-02T22:52:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.680+0000 7fd8d7fff640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c0003fe0 0x7fd8c0004800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00ba30 tx=0x7fd8c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b045573670e14e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.680+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc030070 con 0x7fd8c0003fe0 2024-06-02T22:52:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.680+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8cc02ade0 con 0x7fd8c0003fe0 2024-06-02T22:52:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.680+0000 7fd8d77fe640 1 -- 172.21.15.82:0/4186867186 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00b600 con 0x7fd8c0003fe0 2024-06-02T22:52:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.681+0000 7fd8debb7640 1 -- 172.21.15.82:0/4186867186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c0003fe0 msgr2=0x7fd8c0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.681+0000 7fd8debb7640 1 --2- 172.21.15.82:0/4186867186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c0003fe0 0x7fd8c0004800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00ba30 tx=0x7fd8c0005830 comp rx=0 tx=0).stop 2024-06-02T22:52:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.681+0000 7fd8dd154640 1 -- 172.21.15.82:0/4186867186 reap_dead start 2024-06-02T22:52:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.681+0000 7fd8debb7640 1 -- 172.21.15.82:0/4186867186 shutdown_connections 2024-06-02T22:52:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.681+0000 7fd8debb7640 1 -- 172.21.15.82:0/4186867186 >> 172.21.15.82:0/4186867186 conn(0x7fd8d806c6b0 msgr2=0x7fd8d806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.681+0000 7fd8debb7640 1 -- 172.21.15.82:0/4186867186 shutdown_connections 2024-06-02T22:52:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.681+0000 7fd8debb7640 1 -- 172.21.15.82:0/4186867186 wait complete. 2024-06-02T22:52:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.682+0000 7fd8debb7640 1 Processor -- start 2024-06-02T22:52:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.682+0000 7fd8debb7640 1 -- start start 2024-06-02T22:52:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8debb7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c0003fe0 0x7fd8d815ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8debb7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d815d6d0 0x7fd8d815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8debb7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80b1a50 0x7fd8d8141290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8debb7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d80aff30 con 0x7fd8d815d6d0 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8debb7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d80afc50 con 0x7fd8c0003fe0 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8debb7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d80b0210 con 0x7fd8d80b1a50 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d815d6d0 0x7fd8d815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d815d6d0 0x7fd8d815cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36316/0 (socket says 172.21.15.82:36316) 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d7fff640 1 -- 172.21.15.82:0/3862305500 learned_addr learned my addr 172.21.15.82:0/3862305500 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8dc953640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c0003fe0 0x7fd8d815ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8dd154640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80b1a50 0x7fd8d8141290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d7fff640 1 -- 172.21.15.82:0/3862305500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80b1a50 msgr2=0x7fd8d8141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d7fff640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80b1a50 0x7fd8d8141290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d7fff640 1 -- 172.21.15.82:0/3862305500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c0003fe0 msgr2=0x7fd8d815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d7fff640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c0003fe0 0x7fd8d815ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d7fff640 1 -- 172.21.15.82:0/3862305500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d815dd60 con 0x7fd8d815d6d0 2024-06-02T22:52:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d7fff640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d815d6d0 0x7fd8d815cd90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00bb50 tx=0x7fd8cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d57fa640 1 -- 172.21.15.82:0/3862305500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc043030 con 0x7fd8d815d6d0 2024-06-02T22:52:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d57fa640 1 -- 172.21.15.82:0/3862305500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8cc035e90 con 0x7fd8d815d6d0 2024-06-02T22:52:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8debb7640 1 -- 172.21.15.82:0/3862305500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d815e040 con 0x7fd8d815d6d0 2024-06-02T22:52:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.683+0000 7fd8d57fa640 1 -- 172.21.15.82:0/3862305500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00b600 con 0x7fd8d815d6d0 2024-06-02T22:52:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.684+0000 7fd8debb7640 1 -- 172.21.15.82:0/3862305500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d815e600 con 0x7fd8d815d6d0 2024-06-02T22:52:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.684+0000 7fd8debb7640 1 -- 172.21.15.82:0/3862305500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d80683c0 con 0x7fd8d815d6d0 2024-06-02T22:52:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.685+0000 7fd8d57fa640 1 -- 172.21.15.82:0/3862305500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8cc046070 con 0x7fd8d815d6d0 2024-06-02T22:52:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.685+0000 7fd8d57fa640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd8c406be60 0x7fd8c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.685+0000 7fd8d57fa640 1 -- 172.21.15.82:0/3862305500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fd8cc0ab350 con 0x7fd8d815d6d0 2024-06-02T22:52:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.685+0000 7fd8dc953640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd8c406be60 0x7fd8c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.686+0000 7fd8dc953640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd8c406be60 0x7fd8c406e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8007fd0 tx=0x7fd8c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:01.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.690+0000 7fd8d57fa640 1 -- 172.21.15.82:0/3862305500 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd8cc04d070 con 0x7fd8d815d6d0 2024-06-02T22:52:01.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:01.864+0000 7fd8debb7640 1 -- 172.21.15.82:0/3862305500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fd8d8072c70 con 0x7fd8d815d6d0 2024-06-02T22:52:02.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.550+0000 7fd8d57fa640 1 -- 172.21.15.82:0/3862305500 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7fd8cc079e50 con 0x7fd8d815d6d0 2024-06-02T22:52:02.550 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2024-06-02T22:52:02.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 -- 172.21.15.82:0/3862305500 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd8c406be60 msgr2=0x7fd8c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:02.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd8c406be60 0x7fd8c406e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8007fd0 tx=0x7fd8c8009040 comp rx=0 tx=0).stop 2024-06-02T22:52:02.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 -- 172.21.15.82:0/3862305500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d815d6d0 msgr2=0x7fd8d815cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:02.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d815d6d0 0x7fd8d815cd90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00bb50 tx=0x7fd8cc0046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 -- 172.21.15.82:0/3862305500 shutdown_connections 2024-06-02T22:52:02.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd8c406be60 0x7fd8c406e320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8d80b1a50 0x7fd8d8141290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d815d6d0 0x7fd8d815cd90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 --2- 172.21.15.82:0/3862305500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c0003fe0 0x7fd8d815ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 -- 172.21.15.82:0/3862305500 >> 172.21.15.82:0/3862305500 conn(0x7fd8d806c6b0 msgr2=0x7fd8d8158270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:02.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 -- 172.21.15.82:0/3862305500 shutdown_connections 2024-06-02T22:52:02.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.553+0000 7fd8debb7640 1 -- 172.21.15.82:0/3862305500 wait complete. 2024-06-02T22:52:02.575 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T22:52:02.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.682+0000 7fb569142640 1 Processor -- start 2024-06-02T22:52:02.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.683+0000 7fb569142640 1 -- start start 2024-06-02T22:52:02.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.683+0000 7fb569142640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb56415bbc0 0x7fb56406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:02.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.683+0000 7fb569142640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb56415e670 0x7fb56415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:02.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.683+0000 7fb569142640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb5640d0020 0x7fb5640d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:02.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.683+0000 7fb569142640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb5640d09d0 con 0x7fb56415e670 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.683+0000 7fb569142640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fb56415f0f0 con 0x7fb5640d0020 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.683+0000 7fb569142640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb56415f3d0 con 0x7fb56415bbc0 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.683+0000 7fb56259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb56415e670 0x7fb56415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.684+0000 7fb56259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb56415e670 0x7fb56415eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36324/0 (socket says 172.21.15.82:36324) 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.684+0000 7fb56259c640 1 -- 172.21.15.82:0/3829273900 learned_addr learned my addr 172.21.15.82:0/3829273900 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.684+0000 7fb562d9d640 1 --2- 172.21.15.82:0/3829273900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb56415bbc0 0x7fb56406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.684+0000 7fb56359e640 1 --2- 172.21.15.82:0/3829273900 >> v2:172.21.15.184:3300/0 conn(0x7fb5640d0020 0x7fb5640d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.684+0000 7fb56259c640 1 -- 172.21.15.82:0/3829273900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb56415bbc0 msgr2=0x7fb56406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.684+0000 7fb56259c640 1 --2- 172.21.15.82:0/3829273900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb56415bbc0 0x7fb56406d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.684+0000 7fb56259c640 1 -- 172.21.15.82:0/3829273900 >> v2:172.21.15.184:3300/0 conn(0x7fb5640d0020 msgr2=0x7fb5640d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.684+0000 7fb56259c640 1 --2- 172.21.15.82:0/3829273900 >> v2:172.21.15.184:3300/0 conn(0x7fb5640d0020 0x7fb5640d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.684+0000 7fb56259c640 1 -- 172.21.15.82:0/3829273900 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56406cfa0 con 0x7fb56415e670 2024-06-02T22:52:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.684+0000 7fb56359e640 1 --2- 172.21.15.82:0/3829273900 >> v2:172.21.15.184:3300/0 conn(0x7fb5640d0020 0x7fb5640d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:02.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb56259c640 1 --2- 172.21.15.82:0/3829273900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb56415e670 0x7fb56415eab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5640af7d0 tx=0x7fb54c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f48e5d458b6c37 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:02.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb561d9b640 1 -- 172.21.15.82:0/3829273900 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c037070 con 0x7fb56415e670 2024-06-02T22:52:02.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb561d9b640 1 -- 172.21.15.82:0/3829273900 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c032440 con 0x7fb56415e670 2024-06-02T22:52:02.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb561d9b640 1 -- 172.21.15.82:0/3829273900 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c032810 con 0x7fb56415e670 2024-06-02T22:52:02.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb569142640 1 -- 172.21.15.82:0/3829273900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb56415e670 msgr2=0x7fb56415eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:02.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb569142640 1 --2- 172.21.15.82:0/3829273900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb56415e670 0x7fb56415eab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5640af7d0 tx=0x7fb54c02a1e0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb569142640 1 -- 172.21.15.82:0/3829273900 shutdown_connections 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb569142640 1 --2- 172.21.15.82:0/3829273900 >> v2:172.21.15.184:3300/0 conn(0x7fb5640d0020 0x7fb5640d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb569142640 1 --2- 172.21.15.82:0/3829273900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb56415e670 0x7fb56415eab0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb569142640 1 --2- 172.21.15.82:0/3829273900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb56415bbc0 0x7fb56406d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb569142640 1 -- 172.21.15.82:0/3829273900 >> 172.21.15.82:0/3829273900 conn(0x7fb5640b1d10 msgr2=0x7fb5640b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb569142640 1 -- 172.21.15.82:0/3829273900 shutdown_connections 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.685+0000 7fb569142640 1 -- 172.21.15.82:0/3829273900 wait complete. 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.687+0000 7fb569142640 1 Processor -- start 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.687+0000 7fb569142640 1 -- start start 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.687+0000 7fb569142640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5640d0020 0x7fb564143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.687+0000 7fb569142640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb56415bbc0 0x7fb56415cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.687+0000 7fb569142640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb56415e670 0x7fb56415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:02.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.687+0000 7fb569142640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb56406dce0 con 0x7fb56415e670 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.687+0000 7fb569142640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb56415bfa0 con 0x7fb5640d0020 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.687+0000 7fb569142640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb5640b4d90 con 0x7fb56415bbc0 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb56359e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb56415e670 0x7fb56415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb56359e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb56415e670 0x7fb56415cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36330/0 (socket says 172.21.15.82:36330) 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb56359e640 1 -- 172.21.15.82:0/3588172238 learned_addr learned my addr 172.21.15.82:0/3588172238 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb562d9d640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5640d0020 0x7fb564143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb56259c640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb56415bbc0 0x7fb56415cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb56359e640 1 -- 172.21.15.82:0/3588172238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb56415bbc0 msgr2=0x7fb56415cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb56359e640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb56415bbc0 0x7fb56415cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb56359e640 1 -- 172.21.15.82:0/3588172238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5640d0020 msgr2=0x7fb564143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb56359e640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5640d0020 0x7fb564143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb56359e640 1 -- 172.21.15.82:0/3588172238 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb564142110 con 0x7fb56415e670 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb562d9d640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5640d0020 0x7fb564143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:02.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb56259c640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb56415bbc0 0x7fb56415cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb56359e640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb56415e670 0x7fb56415cff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb55c007e10 tx=0x7fb55c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb55b7fe640 1 -- 172.21.15.82:0/3588172238 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c01a070 con 0x7fb56415e670 2024-06-02T22:52:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb55b7fe640 1 -- 172.21.15.82:0/3588172238 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb55c003b90 con 0x7fb56415e670 2024-06-02T22:52:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb55b7fe640 1 -- 172.21.15.82:0/3588172238 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c004030 con 0x7fb56415e670 2024-06-02T22:52:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb569142640 1 -- 172.21.15.82:0/3588172238 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5641423f0 con 0x7fb56415e670 2024-06-02T22:52:02.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.688+0000 7fb569142640 1 -- 172.21.15.82:0/3588172238 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb564131040 con 0x7fb56415e670 2024-06-02T22:52:02.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.689+0000 7fb569142640 1 -- 172.21.15.82:0/3588172238 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5640683c0 con 0x7fb56415e670 2024-06-02T22:52:02.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.690+0000 7fb55b7fe640 1 -- 172.21.15.82:0/3588172238 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb55c01d070 con 0x7fb56415e670 2024-06-02T22:52:02.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.690+0000 7fb55b7fe640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb54406be30 0x7fb54406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:02.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.690+0000 7fb55b7fe640 1 -- 172.21.15.82:0/3588172238 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fb55c08b030 con 0x7fb56415e670 2024-06-02T22:52:02.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.690+0000 7fb562d9d640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb54406be30 0x7fb54406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:02.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.690+0000 7fb562d9d640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb54406be30 0x7fb54406e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb554009b90 tx=0x7fb554008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:02.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.694+0000 7fb55b7fe640 1 -- 172.21.15.82:0/3588172238 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb55c010070 con 0x7fb56415e670 2024-06-02T22:52:02.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:02.903+0000 7fb569142640 1 -- 172.21.15.82:0/3588172238 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb56406eae0 con 0x7fb56415e670 2024-06-02T22:52:03.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.551+0000 7fb55b7fe640 1 -- 172.21.15.82:0/3588172238 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fb55c059ad0 con 0x7fb56415e670 2024-06-02T22:52:03.551 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 2 and data pool 3 2024-06-02T22:52:03.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 -- 172.21.15.82:0/3588172238 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb54406be30 msgr2=0x7fb54406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb54406be30 0x7fb54406e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb554009b90 tx=0x7fb554008040 comp rx=0 tx=0).stop 2024-06-02T22:52:03.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 -- 172.21.15.82:0/3588172238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb56415e670 msgr2=0x7fb56415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb56415e670 0x7fb56415cff0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb55c007e10 tx=0x7fb55c00d4a0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 -- 172.21.15.82:0/3588172238 shutdown_connections 2024-06-02T22:52:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb54406be30 0x7fb54406e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb56415e670 0x7fb56415cff0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb56415bbc0 0x7fb56415cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 --2- 172.21.15.82:0/3588172238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5640d0020 0x7fb564143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 -- 172.21.15.82:0/3588172238 >> 172.21.15.82:0/3588172238 conn(0x7fb5640b1d10 msgr2=0x7fb5640b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 -- 172.21.15.82:0/3588172238 shutdown_connections 2024-06-02T22:52:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.554+0000 7fb569142640 1 -- 172.21.15.82:0/3588172238 wait complete. 2024-06-02T22:52:03.585 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-06-02T22:52:03.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-06-02T22:52:03.607 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:52:03.630 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:52:03.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.695+0000 7f8d6d742640 1 Processor -- start 2024-06-02T22:52:03.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.695+0000 7f8d6d742640 1 -- start start 2024-06-02T22:52:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.695+0000 7f8d6d742640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8d6815e670 0x7f8d680d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.695+0000 7f8d6d742640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d680d1f30 0x7f8d680d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.695+0000 7f8d6d742640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d680d0c30 0x7f8d68162010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.695+0000 7f8d6d742640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6815fa50 con 0x7f8d680d1f30 2024-06-02T22:52:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.695+0000 7f8d6d742640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6815ea50 con 0x7f8d6815e670 2024-06-02T22:52:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.695+0000 7f8d6d742640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6815ec90 con 0x7f8d680d0c30 2024-06-02T22:52:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.696+0000 7f8d667fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d680d1f30 0x7f8d680d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.696+0000 7f8d667fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d680d1f30 0x7f8d680d06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36342/0 (socket says 172.21.15.82:36342) 2024-06-02T22:52:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.696+0000 7f8d667fc640 1 -- 172.21.15.82:0/657212293 learned_addr learned my addr 172.21.15.82:0/657212293 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:03.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.696+0000 7f8d677fe640 1 --2- 172.21.15.82:0/657212293 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d680d0c30 0x7f8d68162010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.696+0000 7f8d66ffd640 1 --2- 172.21.15.82:0/657212293 >> v2:172.21.15.184:3300/0 conn(0x7f8d6815e670 0x7f8d680d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.696+0000 7f8d667fc640 1 -- 172.21.15.82:0/657212293 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d680d0c30 msgr2=0x7f8d68162010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.696+0000 7f8d667fc640 1 --2- 172.21.15.82:0/657212293 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d680d0c30 0x7f8d68162010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.696+0000 7f8d667fc640 1 -- 172.21.15.82:0/657212293 >> v2:172.21.15.184:3300/0 conn(0x7f8d6815e670 msgr2=0x7f8d680d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.696+0000 7f8d667fc640 1 --2- 172.21.15.82:0/657212293 >> v2:172.21.15.184:3300/0 conn(0x7f8d6815e670 0x7f8d680d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.696+0000 7f8d667fc640 1 -- 172.21.15.82:0/657212293 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6815ef70 con 0x7f8d680d1f30 2024-06-02T22:52:03.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d667fc640 1 --2- 172.21.15.82:0/657212293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d680d1f30 0x7f8d680d06f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d6808cc40 tx=0x7f8d5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dad7523971cb5e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:03.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d65ffb640 1 -- 172.21.15.82:0/657212293 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c037070 con 0x7f8d680d1f30 2024-06-02T22:52:03.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d65ffb640 1 -- 172.21.15.82:0/657212293 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5c032440 con 0x7f8d680d1f30 2024-06-02T22:52:03.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d65ffb640 1 -- 172.21.15.82:0/657212293 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c032810 con 0x7f8d680d1f30 2024-06-02T22:52:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d6d742640 1 -- 172.21.15.82:0/657212293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d680d1f30 msgr2=0x7f8d680d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d6d742640 1 --2- 172.21.15.82:0/657212293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d680d1f30 0x7f8d680d06f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d6808cc40 tx=0x7f8d5c02a270 comp rx=0 tx=0).stop 2024-06-02T22:52:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d6d742640 1 -- 172.21.15.82:0/657212293 shutdown_connections 2024-06-02T22:52:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d6d742640 1 --2- 172.21.15.82:0/657212293 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d680d0c30 0x7f8d68162010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d6d742640 1 --2- 172.21.15.82:0/657212293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d680d1f30 0x7f8d680d06f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d6d742640 1 --2- 172.21.15.82:0/657212293 >> v2:172.21.15.184:3300/0 conn(0x7f8d6815e670 0x7f8d680d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d6d742640 1 -- 172.21.15.82:0/657212293 >> 172.21.15.82:0/657212293 conn(0x7f8d6809d400 msgr2=0x7f8d680d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d6d742640 1 -- 172.21.15.82:0/657212293 shutdown_connections 2024-06-02T22:52:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.697+0000 7f8d6d742640 1 -- 172.21.15.82:0/657212293 wait complete. 2024-06-02T22:52:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.699+0000 7f8d6d742640 1 Processor -- start 2024-06-02T22:52:03.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.699+0000 7f8d6d742640 1 -- start start 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.699+0000 7f8d6d742640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d680d0c30 0x7f8d6815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.699+0000 7f8d6d742640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d680d1f30 0x7f8d680b9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.699+0000 7f8d6d742640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d6815e670 0x7f8d680b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.699+0000 7f8d6d742640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d680d2370 con 0x7f8d6815e670 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.699+0000 7f8d6d742640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6815f530 con 0x7f8d680d1f30 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.699+0000 7f8d6d742640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8d68162550 con 0x7f8d680d0c30 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.699+0000 7f8d677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d6815e670 0x7f8d680b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.699+0000 7f8d677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d6815e670 0x7f8d680b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36344/0 (socket says 172.21.15.82:36344) 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d677fe640 1 -- 172.21.15.82:0/1341694044 learned_addr learned my addr 172.21.15.82:0/1341694044 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d667fc640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d680d1f30 0x7f8d680b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d66ffd640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d680d0c30 0x7f8d6815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d677fe640 1 -- 172.21.15.82:0/1341694044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d680d0c30 msgr2=0x7f8d6815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d677fe640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d680d0c30 0x7f8d6815cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d677fe640 1 -- 172.21.15.82:0/1341694044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d680d1f30 msgr2=0x7f8d680b9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d677fe640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d680d1f30 0x7f8d680b9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d677fe640 1 -- 172.21.15.82:0/1341694044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d680b7cf0 con 0x7f8d6815e670 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d677fe640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d6815e670 0x7f8d680b5ee0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000eed0 tx=0x7f8d6000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d4f7fe640 1 -- 172.21.15.82:0/1341694044 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60018020 con 0x7f8d6815e670 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d4f7fe640 1 -- 172.21.15.82:0/1341694044 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d60014400 con 0x7f8d6815e670 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d6d742640 1 -- 172.21.15.82:0/1341694044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d680b7fd0 con 0x7f8d6815e670 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d4f7fe640 1 -- 172.21.15.82:0/1341694044 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d600147f0 con 0x7f8d6815e670 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.700+0000 7f8d6d742640 1 -- 172.21.15.82:0/1341694044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d680b8590 con 0x7f8d6815e670 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.701+0000 7f8d6d742640 1 -- 172.21.15.82:0/1341694044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d68068540 con 0x7f8d6815e670 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.701+0000 7f8d4f7fe640 1 -- 172.21.15.82:0/1341694044 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d60005d10 con 0x7f8d6815e670 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.702+0000 7f8d4f7fe640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8d5406be60 0x7f8d5406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.702+0000 7f8d66ffd640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8d5406be60 0x7f8d5406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.702+0000 7f8d4f7fe640 1 -- 172.21.15.82:0/1341694044 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f8d6008b330 con 0x7f8d6815e670 2024-06-02T22:52:03.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.702+0000 7f8d66ffd640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8d5406be60 0x7f8d5406e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009aa0 tx=0x7f8d58009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:03.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.707+0000 7f8d4f7fe640 1 -- 172.21.15.82:0/1341694044 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8d60022070 con 0x7f8d6815e670 2024-06-02T22:52:03.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:03.890+0000 7f8d6d742640 1 -- 172.21.15.82:0/1341694044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f8d680d47d0 con 0x7f8d6815e670 2024-06-02T22:52:04.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.571+0000 7f8d4f7fe640 1 -- 172.21.15.82:0/1341694044 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f8d60059720 con 0x7f8d6815e670 2024-06-02T22:52:04.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 -- 172.21.15.82:0/1341694044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8d5406be60 msgr2=0x7f8d5406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:04.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8d5406be60 0x7f8d5406e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009aa0 tx=0x7f8d58009190 comp rx=0 tx=0).stop 2024-06-02T22:52:04.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 -- 172.21.15.82:0/1341694044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d6815e670 msgr2=0x7f8d680b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:04.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d6815e670 0x7f8d680b5ee0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000eed0 tx=0x7f8d6000b480 comp rx=0 tx=0).stop 2024-06-02T22:52:04.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 -- 172.21.15.82:0/1341694044 shutdown_connections 2024-06-02T22:52:04.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8d5406be60 0x7f8d5406e320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d6815e670 0x7f8d680b5ee0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d680d1f30 0x7f8d680b9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 --2- 172.21.15.82:0/1341694044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d680d0c30 0x7f8d6815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 -- 172.21.15.82:0/1341694044 >> 172.21.15.82:0/1341694044 conn(0x7f8d6809d400 msgr2=0x7f8d6806c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:04.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 -- 172.21.15.82:0/1341694044 shutdown_connections 2024-06-02T22:52:04.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.575+0000 7f8d6d742640 1 -- 172.21.15.82:0/1341694044 wait complete. 2024-06-02T22:52:04.588 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T22:52:04.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.743+0000 7fe85e95a640 1 Processor -- start 2024-06-02T22:52:04.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.743+0000 7fe85e95a640 1 -- start start 2024-06-02T22:52:04.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe85e95a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe85809aa10 0x7fe8580cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:04.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe85e95a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe85815f2d0 0x7fe85809adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe85e95a640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe858161e40 0x7fe8581622d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe85e95a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe85809b330 con 0x7fe85809aa10 2024-06-02T22:52:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe85e95a640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fe85815f710 con 0x7fe858161e40 2024-06-02T22:52:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe85e95a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe85815c1a0 con 0x7fe85815f2d0 2024-06-02T22:52:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe857fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe85809aa10 0x7fe8580cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe857fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe85809aa10 0x7fe8580cfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36350/0 (socket says 172.21.15.82:36350) 2024-06-02T22:52:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe857fff640 1 -- 172.21.15.82:0/3307920821 learned_addr learned my addr 172.21.15.82:0/3307920821 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe8577fe640 1 --2- 172.21.15.82:0/3307920821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe85815f2d0 0x7fe85809adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe85cef7640 1 --2- 172.21.15.82:0/3307920821 >> v2:172.21.15.184:3300/0 conn(0x7fe858161e40 0x7fe8581622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe857fff640 1 -- 172.21.15.82:0/3307920821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe85815f2d0 msgr2=0x7fe85809adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:04.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe857fff640 1 --2- 172.21.15.82:0/3307920821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe85815f2d0 0x7fe85809adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe857fff640 1 -- 172.21.15.82:0/3307920821 >> v2:172.21.15.184:3300/0 conn(0x7fe858161e40 msgr2=0x7fe8581622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:04.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe857fff640 1 --2- 172.21.15.82:0/3307920821 >> v2:172.21.15.184:3300/0 conn(0x7fe858161e40 0x7fe8581622d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.744+0000 7fe857fff640 1 -- 172.21.15.82:0/3307920821 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8580d0370 con 0x7fe85809aa10 2024-06-02T22:52:04.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.745+0000 7fe857fff640 1 --2- 172.21.15.82:0/3307920821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85809aa10 0x7fe8580cfd90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe858072800 tx=0x7fe84802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56224339ee4f7bb7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:04.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.745+0000 7fe856ffd640 1 -- 172.21.15.82:0/3307920821 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe848037070 con 0x7fe85809aa10 2024-06-02T22:52:04.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.745+0000 7fe856ffd640 1 -- 172.21.15.82:0/3307920821 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe848032440 con 0x7fe85809aa10 2024-06-02T22:52:04.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.745+0000 7fe856ffd640 1 -- 172.21.15.82:0/3307920821 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe848032810 con 0x7fe85809aa10 2024-06-02T22:52:04.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.746+0000 7fe85e95a640 1 -- 172.21.15.82:0/3307920821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85809aa10 msgr2=0x7fe8580cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:04.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.746+0000 7fe85e95a640 1 --2- 172.21.15.82:0/3307920821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85809aa10 0x7fe8580cfd90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe858072800 tx=0x7fe84802a1e0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.746+0000 7fe85e95a640 1 -- 172.21.15.82:0/3307920821 shutdown_connections 2024-06-02T22:52:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.746+0000 7fe85e95a640 1 --2- 172.21.15.82:0/3307920821 >> v2:172.21.15.184:3300/0 conn(0x7fe858161e40 0x7fe8581622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.746+0000 7fe85e95a640 1 --2- 172.21.15.82:0/3307920821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe85815f2d0 0x7fe85809adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.746+0000 7fe85e95a640 1 --2- 172.21.15.82:0/3307920821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85809aa10 0x7fe8580cfd90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.746+0000 7fe85e95a640 1 -- 172.21.15.82:0/3307920821 >> 172.21.15.82:0/3307920821 conn(0x7fe8580d1e90 msgr2=0x7fe8580d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.746+0000 7fe85e95a640 1 -- 172.21.15.82:0/3307920821 shutdown_connections 2024-06-02T22:52:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.746+0000 7fe85e95a640 1 -- 172.21.15.82:0/3307920821 wait complete. 2024-06-02T22:52:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.747+0000 7fe85e95a640 1 Processor -- start 2024-06-02T22:52:04.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.747+0000 7fe85e95a640 1 -- start start 2024-06-02T22:52:04.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe85e95a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe85809aa10 0x7fe85814d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:04.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe85e95a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85815f2d0 0x7fe858161320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe85e95a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe858161e40 0x7fe858161860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe85e95a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe85806c9a0 con 0x7fe85815f2d0 2024-06-02T22:52:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe85e95a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe8580d0930 con 0x7fe85809aa10 2024-06-02T22:52:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe85e95a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe8580d0c10 con 0x7fe858161e40 2024-06-02T22:52:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe8577fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85815f2d0 0x7fe858161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe8577fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85815f2d0 0x7fe858161320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36358/0 (socket says 172.21.15.82:36358) 2024-06-02T22:52:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe8577fe640 1 -- 172.21.15.82:0/3083153641 learned_addr learned my addr 172.21.15.82:0/3083153641 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe857fff640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe85809aa10 0x7fe85814d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe85cef7640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe858161e40 0x7fe858161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:04.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe8577fe640 1 -- 172.21.15.82:0/3083153641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe858161e40 msgr2=0x7fe858161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe8577fe640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe858161e40 0x7fe858161860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe8577fe640 1 -- 172.21.15.82:0/3083153641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe85809aa10 msgr2=0x7fe85814d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe8577fe640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe85809aa10 0x7fe85814d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe8577fe640 1 -- 172.21.15.82:0/3083153641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8580b37b0 con 0x7fe85815f2d0 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe8577fe640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85815f2d0 0x7fe858161320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe84000c820 tx=0x7fe84000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe854ff9640 1 -- 172.21.15.82:0/3083153641 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840015070 con 0x7fe85815f2d0 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe854ff9640 1 -- 172.21.15.82:0/3083153641 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe840004240 con 0x7fe85815f2d0 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe85e95a640 1 -- 172.21.15.82:0/3083153641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8580b2710 con 0x7fe85815f2d0 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.748+0000 7fe854ff9640 1 -- 172.21.15.82:0/3083153641 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84000ce10 con 0x7fe85815f2d0 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.749+0000 7fe85e95a640 1 -- 172.21.15.82:0/3083153641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8580b2cd0 con 0x7fe85815f2d0 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.750+0000 7fe85e95a640 1 -- 172.21.15.82:0/3083153641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8580683c0 con 0x7fe85815f2d0 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.750+0000 7fe854ff9640 1 -- 172.21.15.82:0/3083153641 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe840007830 con 0x7fe85815f2d0 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.751+0000 7fe854ff9640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe83806be30 0x7fe83806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:04.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.751+0000 7fe857fff640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe83806be30 0x7fe83806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:04.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.751+0000 7fe854ff9640 1 -- 172.21.15.82:0/3083153641 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7fe84008ad40 con 0x7fe85815f2d0 2024-06-02T22:52:04.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.751+0000 7fe857fff640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe83806be30 0x7fe83806e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe848034000 tx=0x7fe84802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:04.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.755+0000 7fe854ff9640 1 -- 172.21.15.82:0/3083153641 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe840059000 con 0x7fe85815f2d0 2024-06-02T22:52:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:04.928+0000 7fe85e95a640 1 -- 172.21.15.82:0/3083153641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe8580b7db0 con 0x7fe85815f2d0 2024-06-02T22:52:06.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.575+0000 7fe854ff9640 1 -- 172.21.15.82:0/3083153641 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7fe84005d300 con 0x7fe85815f2d0 2024-06-02T22:52:06.575 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data_ec' created 2024-06-02T22:52:06.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.578+0000 7fe85e95a640 1 -- 172.21.15.82:0/3083153641 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe83806be30 msgr2=0x7fe83806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:06.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.578+0000 7fe85e95a640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe83806be30 0x7fe83806e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe848034000 tx=0x7fe84802e000 comp rx=0 tx=0).stop 2024-06-02T22:52:06.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.578+0000 7fe85e95a640 1 -- 172.21.15.82:0/3083153641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85815f2d0 msgr2=0x7fe858161320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:06.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.578+0000 7fe85e95a640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85815f2d0 0x7fe858161320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe84000c820 tx=0x7fe84000cce0 comp rx=0 tx=0).stop 2024-06-02T22:52:06.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.578+0000 7fe85e95a640 1 -- 172.21.15.82:0/3083153641 shutdown_connections 2024-06-02T22:52:06.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.578+0000 7fe85e95a640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe83806be30 0x7fe83806e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:06.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.578+0000 7fe85e95a640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe858161e40 0x7fe858161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:06.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.578+0000 7fe85e95a640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe85815f2d0 0x7fe858161320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:06.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.578+0000 7fe85e95a640 1 --2- 172.21.15.82:0/3083153641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe85809aa10 0x7fe85814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:06.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.578+0000 7fe85e95a640 1 -- 172.21.15.82:0/3083153641 >> 172.21.15.82:0/3083153641 conn(0x7fe8580d1e90 msgr2=0x7fe8580cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:06.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.579+0000 7fe85e95a640 1 -- 172.21.15.82:0/3083153641 shutdown_connections 2024-06-02T22:52:06.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.579+0000 7fe85e95a640 1 -- 172.21.15.82:0/3083153641 wait complete. 2024-06-02T22:52:06.597 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-06-02T22:52:06.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.705+0000 7fc84b71b640 1 Processor -- start 2024-06-02T22:52:06.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.706+0000 7fc84b71b640 1 -- start start 2024-06-02T22:52:06.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.706+0000 7fc84b71b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84415e670 0x7fc8440d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:06.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.706+0000 7fc84b71b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc8440d0e00 0x7fc8440cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:06.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.706+0000 7fc84b71b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc84415ec90 con 0x7fc8440d1f30 2024-06-02T22:52:06.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.706+0000 7fc84b71b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc84415fa50 con 0x7fc8440d0e00 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.706+0000 7fc84b71b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc84415ea50 con 0x7fc84415e670 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.707+0000 7fc849cb8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc8440d0e00 0x7fc8440cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.707+0000 7fc849cb8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc8440d0e00 0x7fc8440cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36368/0 (socket says 172.21.15.82:36368) 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.707+0000 7fc849cb8640 1 -- 172.21.15.82:0/989035691 learned_addr learned my addr 172.21.15.82:0/989035691 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.707+0000 7fc8494b7640 1 --2- 172.21.15.82:0/989035691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84415e670 0x7fc8440d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.707+0000 7fc849cb8640 1 -- 172.21.15.82:0/989035691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84415e670 msgr2=0x7fc8440d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.707+0000 7fc849cb8640 1 --2- 172.21.15.82:0/989035691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84415e670 0x7fc8440d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.707+0000 7fc849cb8640 1 -- 172.21.15.82:0/989035691 >> v1:172.21.15.184:6789/0 conn(0x7fc8440d1f30 legacy=0x7fc8440d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.707+0000 7fc849cb8640 1 -- 172.21.15.82:0/989035691 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84415ef70 con 0x7fc8440d0e00 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc849cb8640 1 --2- 172.21.15.82:0/989035691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8440d0e00 0x7fc8440cebd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009e50 tx=0x7fc83c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98277d98b0b200d8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc83bfff640 1 -- 172.21.15.82:0/989035691 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c036070 con 0x7fc8440d0e00 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc83bfff640 1 -- 172.21.15.82:0/989035691 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c031600 con 0x7fc8440d0e00 2024-06-02T22:52:06.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc83bfff640 1 -- 172.21.15.82:0/989035691 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0319d0 con 0x7fc8440d0e00 2024-06-02T22:52:06.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc84b71b640 1 -- 172.21.15.82:0/989035691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8440d0e00 msgr2=0x7fc8440cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:06.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc84b71b640 1 --2- 172.21.15.82:0/989035691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8440d0e00 0x7fc8440cebd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009e50 tx=0x7fc83c02a7a0 comp rx=0 tx=0).stop 2024-06-02T22:52:06.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc84b71b640 1 -- 172.21.15.82:0/989035691 shutdown_connections 2024-06-02T22:52:06.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc84b71b640 1 --2- 172.21.15.82:0/989035691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8440d0e00 0x7fc8440cebd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:06.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc84b71b640 1 --2- 172.21.15.82:0/989035691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84415e670 0x7fc8440d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:06.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc84b71b640 1 -- 172.21.15.82:0/989035691 >> 172.21.15.82:0/989035691 conn(0x7fc84409d400 msgr2=0x7fc8440d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:06.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc84b71b640 1 -- 172.21.15.82:0/989035691 shutdown_connections 2024-06-02T22:52:06.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.708+0000 7fc84b71b640 1 -- 172.21.15.82:0/989035691 wait complete. 2024-06-02T22:52:06.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.709+0000 7fc84b71b640 1 Processor -- start 2024-06-02T22:52:06.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.709+0000 7fc84b71b640 1 -- start start 2024-06-02T22:52:06.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.710+0000 7fc84b71b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8440d0e00 0x7fc84415d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:06.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.710+0000 7fc84b71b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8440d1f30 0x7fc844161be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:06.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.710+0000 7fc84b71b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84415e670 0x7fc844162120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:06.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.710+0000 7fc84b71b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8440d2370 con 0x7fc8440d1f30 2024-06-02T22:52:06.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.710+0000 7fc84b71b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc84415f530 con 0x7fc84415e670 2024-06-02T22:52:06.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.710+0000 7fc84b71b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc8440cf110 con 0x7fc8440d0e00 2024-06-02T22:52:06.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.710+0000 7fc848cb6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8440d1f30 0x7fc844161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.710+0000 7fc848cb6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8440d1f30 0x7fc844161be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36378/0 (socket says 172.21.15.82:36378) 2024-06-02T22:52:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.710+0000 7fc848cb6640 1 -- 172.21.15.82:0/1345103218 learned_addr learned my addr 172.21.15.82:0/1345103218 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.710+0000 7fc848cb6640 1 -- 172.21.15.82:0/1345103218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8440d0e00 msgr2=0x7fc84415d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc8494b7640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8440d0e00 0x7fc84415d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc848cb6640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8440d0e00 0x7fc84415d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc849cb8640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84415e670 0x7fc844162120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc848cb6640 1 -- 172.21.15.82:0/1345103218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84415e670 msgr2=0x7fc844162120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc848cb6640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84415e670 0x7fc844162120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc848cb6640 1 -- 172.21.15.82:0/1345103218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84415d770 con 0x7fc8440d1f30 2024-06-02T22:52:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc848cb6640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8440d1f30 0x7fc844161be0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c480 tx=0x7fc83400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc839ffb640 1 -- 172.21.15.82:0/1345103218 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8340052d0 con 0x7fc8440d1f30 2024-06-02T22:52:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc839ffb640 1 -- 172.21.15.82:0/1345103218 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc834005470 con 0x7fc8440d1f30 2024-06-02T22:52:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc84b71b640 1 -- 172.21.15.82:0/1345103218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8441e7e10 con 0x7fc8440d1f30 2024-06-02T22:52:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc839ffb640 1 -- 172.21.15.82:0/1345103218 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834012870 con 0x7fc8440d1f30 2024-06-02T22:52:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.711+0000 7fc84b71b640 1 -- 172.21.15.82:0/1345103218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8441e83d0 con 0x7fc8440d1f30 2024-06-02T22:52:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.712+0000 7fc84b71b640 1 -- 172.21.15.82:0/1345103218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc844068540 con 0x7fc8440d1f30 2024-06-02T22:52:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.712+0000 7fc839ffb640 1 -- 172.21.15.82:0/1345103218 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc834012a10 con 0x7fc8440d1f30 2024-06-02T22:52:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.713+0000 7fc839ffb640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc82806be30 0x7fc82806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.713+0000 7fc839ffb640 1 -- 172.21.15.82:0/1345103218 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7fc83408ada0 con 0x7fc8440d1f30 2024-06-02T22:52:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.713+0000 7fc8494b7640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc82806be30 0x7fc82806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.713+0000 7fc8494b7640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc82806be30 0x7fc82806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc840006fd0 tx=0x7fc840008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.717+0000 7fc839ffb640 1 -- 172.21.15.82:0/1345103218 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc8340594c0 con 0x7fc8440d1f30 2024-06-02T22:52:06.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:06.893+0000 7fc84b71b640 1 -- 172.21.15.82:0/1345103218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fc8440b9f40 con 0x7fc8440d1f30 2024-06-02T22:52:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.576+0000 7fc839ffb640 1 -- 172.21.15.82:0/1345103218 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7fc834058dc0 con 0x7fc8440d1f30 2024-06-02T22:52:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:set pool 4 allow_ec_overwrites to true 2024-06-02T22:52:07.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.580+0000 7fc84b71b640 1 -- 172.21.15.82:0/1345103218 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc82806be30 msgr2=0x7fc82806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:07.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.580+0000 7fc84b71b640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc82806be30 0x7fc82806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc840006fd0 tx=0x7fc840008040 comp rx=0 tx=0).stop 2024-06-02T22:52:07.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.580+0000 7fc84b71b640 1 -- 172.21.15.82:0/1345103218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8440d1f30 msgr2=0x7fc844161be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:07.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.580+0000 7fc84b71b640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8440d1f30 0x7fc844161be0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c480 tx=0x7fc83400c940 comp rx=0 tx=0).stop 2024-06-02T22:52:07.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.581+0000 7fc84b71b640 1 -- 172.21.15.82:0/1345103218 shutdown_connections 2024-06-02T22:52:07.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.581+0000 7fc84b71b640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc82806be30 0x7fc82806e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:07.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.581+0000 7fc84b71b640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84415e670 0x7fc844162120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:07.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.581+0000 7fc84b71b640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8440d1f30 0x7fc844161be0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:07.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.581+0000 7fc84b71b640 1 --2- 172.21.15.82:0/1345103218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8440d0e00 0x7fc84415d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:07.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.581+0000 7fc84b71b640 1 -- 172.21.15.82:0/1345103218 >> 172.21.15.82:0/1345103218 conn(0x7fc84409d400 msgr2=0x7fc8440d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:07.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.581+0000 7fc84b71b640 1 -- 172.21.15.82:0/1345103218 shutdown_connections 2024-06-02T22:52:07.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.582+0000 7fc84b71b640 1 -- 172.21.15.82:0/1345103218 wait complete. 2024-06-02T22:52:07.606 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-06-02T22:52:07.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.713+0000 7fcf7804d640 1 Processor -- start 2024-06-02T22:52:07.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.713+0000 7fcf7804d640 1 -- start start 2024-06-02T22:52:07.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf7804d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7006e900 0x7fcf700d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:07.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf7804d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf70155700 con 0x7fcf70155320 2024-06-02T22:52:07.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf7804d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf7015b6b0 con 0x7fcf700d0020 2024-06-02T22:52:07.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf7804d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fcf700d09c0 con 0x7fcf7006e900 2024-06-02T22:52:07.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf75de9640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcf70155320 0x7fcf700b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60576/0 (socket says 172.21.15.82:60576) 2024-06-02T22:52:07.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf75de9640 1 -- 172.21.15.82:0/2102946058 learned_addr learned my addr 172.21.15.82:0/2102946058 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:07.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2773370829 0 0) 0x7fcf70155700 con 0x7fcf70155320 2024-06-02T22:52:07.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf58003520 con 0x7fcf70155320 2024-06-02T22:52:07.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf765ea640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7006e900 0x7fcf700d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:07.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3175949140 0 0) 0x7fcf58003520 con 0x7fcf70155320 2024-06-02T22:52:07.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7006e900 msgr2=0x7fcf700d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:07.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7006e900 0x7fcf700d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:07.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 >> v1:172.21.15.184:6789/0 conn(0x7fcf700d0020 legacy=0x7fcf7006e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:07.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7015b990 con 0x7fcf70155320 2024-06-02T22:52:07.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fcf68001a10 con 0x7fcf70155320 2024-06-02T22:52:07.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 >> v1:172.21.15.82:6789/0 conn(0x7fcf70155320 legacy=0x7fcf700b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:07.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf580039e0 0x7fcf58003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:07.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7006e900 0x7fcf58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:07.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf58004d40 0x7fcf580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:07.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5800bb50 con 0x7fcf58004d40 2024-06-02T22:52:07.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5800bcd0 con 0x7fcf580039e0 2024-06-02T22:52:07.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5800bea0 con 0x7fcf7006e900 2024-06-02T22:52:07.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf765ea640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf58004d40 0x7fcf580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:07.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf755e8640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7006e900 0x7fcf58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:07.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.714+0000 7fcf75de9640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf580039e0 0x7fcf58003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:07.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.715+0000 7fcf765ea640 1 -- 172.21.15.82:0/2102946058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7006e900 msgr2=0x7fcf58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:07.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.715+0000 7fcf765ea640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7006e900 0x7fcf58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:07.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.715+0000 7fcf765ea640 1 -- 172.21.15.82:0/2102946058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf580039e0 msgr2=0x7fcf58003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:07.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.715+0000 7fcf765ea640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf580039e0 0x7fcf58003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:07.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.715+0000 7fcf765ea640 1 -- 172.21.15.82:0/2102946058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf58003520 con 0x7fcf58004d40 2024-06-02T22:52:07.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.715+0000 7fcf765ea640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf58004d40 0x7fcf580051c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000ba60 tx=0x7fcf58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c37768709f3ee server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:07.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.715+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60030070 con 0x7fcf58004d40 2024-06-02T22:52:07.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.715+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6002ae10 con 0x7fcf58004d40 2024-06-02T22:52:07.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.715+0000 7fcf74de7640 1 -- 172.21.15.82:0/2102946058 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6000b600 con 0x7fcf58004d40 2024-06-02T22:52:07.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.716+0000 7fcf7804d640 1 -- 172.21.15.82:0/2102946058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf58004d40 msgr2=0x7fcf580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:07.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.716+0000 7fcf7804d640 1 --2- 172.21.15.82:0/2102946058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf58004d40 0x7fcf580051c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000ba60 tx=0x7fcf58005830 comp rx=0 tx=0).stop 2024-06-02T22:52:07.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.716+0000 7fcf765ea640 1 -- 172.21.15.82:0/2102946058 reap_dead start 2024-06-02T22:52:07.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.716+0000 7fcf7804d640 1 -- 172.21.15.82:0/2102946058 shutdown_connections 2024-06-02T22:52:07.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.716+0000 7fcf7804d640 1 -- 172.21.15.82:0/2102946058 >> 172.21.15.82:0/2102946058 conn(0x7fcf700b1d10 msgr2=0x7fcf700b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:07.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.716+0000 7fcf7804d640 1 -- 172.21.15.82:0/2102946058 shutdown_connections 2024-06-02T22:52:07.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.716+0000 7fcf7804d640 1 -- 172.21.15.82:0/2102946058 wait complete. 2024-06-02T22:52:07.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.717+0000 7fcf7804d640 1 Processor -- start 2024-06-02T22:52:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.717+0000 7fcf7804d640 1 -- start start 2024-06-02T22:52:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf7804d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7014b260 0x7fcf7009d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf7804d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf7014b910 0x7fcf700b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf7804d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf700b0d60 0x7fcf70157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf7804d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7015b2f0 con 0x7fcf700b0d60 2024-06-02T22:52:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf7804d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7015bf50 con 0x7fcf7014b910 2024-06-02T22:52:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf7804d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fcf7015b470 con 0x7fcf7014b260 2024-06-02T22:52:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf765ea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf700b0d60 0x7fcf70157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf765ea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf700b0d60 0x7fcf70157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36384/0 (socket says 172.21.15.82:36384) 2024-06-02T22:52:07.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf765ea640 1 -- 172.21.15.82:0/2963066167 learned_addr learned my addr 172.21.15.82:0/2963066167 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf75de9640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7014b260 0x7fcf7009d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf755e8640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf7014b910 0x7fcf700b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf765ea640 1 -- 172.21.15.82:0/2963066167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7014b260 msgr2=0x7fcf7009d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf765ea640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7014b260 0x7fcf7009d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf765ea640 1 -- 172.21.15.82:0/2963066167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf7014b910 msgr2=0x7fcf700b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf765ea640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf7014b910 0x7fcf700b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf765ea640 1 -- 172.21.15.82:0/2963066167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf701f1e10 con 0x7fcf700b0d60 2024-06-02T22:52:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.718+0000 7fcf755e8640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf7014b910 0x7fcf700b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.719+0000 7fcf765ea640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf700b0d60 0x7fcf70157900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000ba60 tx=0x7fcf60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.719+0000 7fcf6e7fc640 1 -- 172.21.15.82:0/2963066167 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6000b600 con 0x7fcf700b0d60 2024-06-02T22:52:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.719+0000 7fcf6e7fc640 1 -- 172.21.15.82:0/2963066167 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6002ac10 con 0x7fcf700b0d60 2024-06-02T22:52:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.719+0000 7fcf7804d640 1 -- 172.21.15.82:0/2963066167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf701f20d0 con 0x7fcf700b0d60 2024-06-02T22:52:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.719+0000 7fcf6e7fc640 1 -- 172.21.15.82:0/2963066167 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60004260 con 0x7fcf700b0d60 2024-06-02T22:52:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.719+0000 7fcf7804d640 1 -- 172.21.15.82:0/2963066167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf701f2690 con 0x7fcf700b0d60 2024-06-02T22:52:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.720+0000 7fcf7804d640 1 -- 172.21.15.82:0/2963066167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf700683c0 con 0x7fcf700b0d60 2024-06-02T22:52:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.720+0000 7fcf6e7fc640 1 -- 172.21.15.82:0/2963066167 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf60045030 con 0x7fcf700b0d60 2024-06-02T22:52:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.721+0000 7fcf6e7fc640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcf5c06be30 0x7fcf5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.721+0000 7fcf75de9640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcf5c06be30 0x7fcf5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.721+0000 7fcf6e7fc640 1 -- 172.21.15.82:0/2963066167 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fcf600ab220 con 0x7fcf700b0d60 2024-06-02T22:52:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.721+0000 7fcf75de9640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcf5c06be30 0x7fcf5c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf68004bc0 tx=0x7fcf68006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:07.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.725+0000 7fcf6e7fc640 1 -- 172.21.15.82:0/2963066167 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcf6004c020 con 0x7fcf700b0d60 2024-06-02T22:52:07.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:07.941+0000 7fcf7804d640 1 -- 172.21.15.82:0/2963066167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fcf700cf640 con 0x7fcf700b0d60 2024-06-02T22:52:08.431 INFO:tasks.ceph.mds.c.smithi082.stderr:2024-06-02T22:52:08.432+0000 7f00bb5d5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T22:52:08.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.611+0000 7fcf6e7fc640 1 -- 172.21.15.82:0/2963066167 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7fcf60079830 con 0x7fcf700b0d60 2024-06-02T22:52:08.611 INFO:teuthology.orchestra.run.smithi082.stderr:added data pool 4 to fsmap 2024-06-02T22:52:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 -- 172.21.15.82:0/2963066167 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcf5c06be30 msgr2=0x7fcf5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcf5c06be30 0x7fcf5c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf68004bc0 tx=0x7fcf68006040 comp rx=0 tx=0).stop 2024-06-02T22:52:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 -- 172.21.15.82:0/2963066167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf700b0d60 msgr2=0x7fcf70157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf700b0d60 0x7fcf70157900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000ba60 tx=0x7fcf60004730 comp rx=0 tx=0).stop 2024-06-02T22:52:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 -- 172.21.15.82:0/2963066167 shutdown_connections 2024-06-02T22:52:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcf5c06be30 0x7fcf5c06e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf700b0d60 0x7fcf70157900 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf7014b910 0x7fcf700b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 --2- 172.21.15.82:0/2963066167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf7014b260 0x7fcf7009d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 -- 172.21.15.82:0/2963066167 >> 172.21.15.82:0/2963066167 conn(0x7fcf700b1d10 msgr2=0x7fcf7006e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 -- 172.21.15.82:0/2963066167 shutdown_connections 2024-06-02T22:52:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.613+0000 7fcf7804d640 1 -- 172.21.15.82:0/2963066167 wait complete. 2024-06-02T22:52:08.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:52:08.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.728+0000 7fc43086b640 1 Processor -- start 2024-06-02T22:52:08.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.728+0000 7fc43086b640 1 -- start start 2024-06-02T22:52:08.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.729+0000 7fc43086b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc42c0d2680 0x7fc42c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:08.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.729+0000 7fc43086b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc42c0d1fc0 0x7fc42c0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:08.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.729+0000 7fc43086b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc42c0d2fa0 con 0x7fc42c161fa0 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.729+0000 7fc43086b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc42c0cff80 con 0x7fc42c0d2680 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.729+0000 7fc43086b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc42c0d13e0 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.730+0000 7fc42a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc42c0d2680 0x7fc42c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.730+0000 7fc42a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc42c0d2680 0x7fc42c15f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36400/0 (socket says 172.21.15.82:36400) 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.730+0000 7fc42a59c640 1 -- 172.21.15.82:0/1521064710 learned_addr learned my addr 172.21.15.82:0/1521064710 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.730+0000 7fc429d9b640 1 --2- 172.21.15.82:0/1521064710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc42c0d1fc0 0x7fc42c0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.730+0000 7fc42a59c640 1 -- 172.21.15.82:0/1521064710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc42c0d1fc0 msgr2=0x7fc42c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.730+0000 7fc42a59c640 1 --2- 172.21.15.82:0/1521064710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc42c0d1fc0 0x7fc42c0d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.730+0000 7fc42a59c640 1 -- 172.21.15.82:0/1521064710 >> v1:172.21.15.184:6789/0 conn(0x7fc42c161fa0 legacy=0x7fc42c162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.730+0000 7fc42a59c640 1 -- 172.21.15.82:0/1521064710 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42c0d0ad0 con 0x7fc42c0d2680 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc42a59c640 1 --2- 172.21.15.82:0/1521064710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42c0d2680 0x7fc42c15f1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc424009e50 tx=0x7fc42402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffceef6fd65b5ee8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc42959a640 1 -- 172.21.15.82:0/1521064710 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424036070 con 0x7fc42c0d2680 2024-06-02T22:52:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc42959a640 1 -- 172.21.15.82:0/1521064710 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc424031600 con 0x7fc42c0d2680 2024-06-02T22:52:08.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc42959a640 1 -- 172.21.15.82:0/1521064710 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4240319d0 con 0x7fc42c0d2680 2024-06-02T22:52:08.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc43086b640 1 -- 172.21.15.82:0/1521064710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42c0d2680 msgr2=0x7fc42c15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:08.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc43086b640 1 --2- 172.21.15.82:0/1521064710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42c0d2680 0x7fc42c15f1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc424009e50 tx=0x7fc42402a6c0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc43086b640 1 -- 172.21.15.82:0/1521064710 shutdown_connections 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc43086b640 1 --2- 172.21.15.82:0/1521064710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc42c0d1fc0 0x7fc42c0d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc43086b640 1 --2- 172.21.15.82:0/1521064710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42c0d2680 0x7fc42c15f1a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc43086b640 1 -- 172.21.15.82:0/1521064710 >> 172.21.15.82:0/1521064710 conn(0x7fc42c09d3f0 msgr2=0x7fc42c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc43086b640 1 -- 172.21.15.82:0/1521064710 shutdown_connections 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.731+0000 7fc43086b640 1 -- 172.21.15.82:0/1521064710 wait complete. 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.733+0000 7fc43086b640 1 Processor -- start 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.733+0000 7fc43086b640 1 -- start start 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.733+0000 7fc43086b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42c0d1fc0 0x7fc42c0b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.733+0000 7fc43086b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc42c0d2680 0x7fc42c1f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.733+0000 7fc43086b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc42c161fa0 0x7fc42c0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.733+0000 7fc43086b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c0d1070 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.733+0000 7fc43086b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c0d0d90 con 0x7fc42c0d2680 2024-06-02T22:52:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.733+0000 7fc43086b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc42c0d2400 con 0x7fc42c161fa0 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.733+0000 7fc42a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42c0d1fc0 0x7fc42c0b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc42a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42c0d1fc0 0x7fc42c0b8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36416/0 (socket says 172.21.15.82:36416) 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc42a59c640 1 -- 172.21.15.82:0/3178992562 learned_addr learned my addr 172.21.15.82:0/3178992562 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc429d9b640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc42c0d2680 0x7fc42c1f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc42ad9d640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc42c161fa0 0x7fc42c0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc42a59c640 1 -- 172.21.15.82:0/3178992562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc42c161fa0 msgr2=0x7fc42c0b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc42a59c640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc42c161fa0 0x7fc42c0b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc42a59c640 1 -- 172.21.15.82:0/3178992562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc42c0d2680 msgr2=0x7fc42c1f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc42a59c640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc42c0d2680 0x7fc42c1f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc42a59c640 1 -- 172.21.15.82:0/3178992562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42c0b9220 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc42a59c640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42c0d1fc0 0x7fc42c0b8ce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc424000f80 tx=0x7fc424004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc41affd640 1 -- 172.21.15.82:0/3178992562 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424036050 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc41affd640 1 -- 172.21.15.82:0/3178992562 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc424042070 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc43086b640 1 -- 172.21.15.82:0/3178992562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42c0b6f10 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc41affd640 1 -- 172.21.15.82:0/3178992562 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424009510 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.734+0000 7fc43086b640 1 -- 172.21.15.82:0/3178992562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42c0b74d0 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.735+0000 7fc43086b640 1 -- 172.21.15.82:0/3178992562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc42c068430 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.735+0000 7fc41affd640 1 -- 172.21.15.82:0/3178992562 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc424007c70 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.736+0000 7fc41affd640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40c06be30 0x7fc40c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:08.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.736+0000 7fc41affd640 1 -- 172.21.15.82:0/3178992562 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc4240abec0 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.736+0000 7fc429d9b640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40c06be30 0x7fc40c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:08.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.736+0000 7fc429d9b640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40c06be30 0x7fc40c06e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc420006fd0 tx=0x7fc420008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:08.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.740+0000 7fc41affd640 1 -- 172.21.15.82:0/3178992562 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc424079ee0 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.950+0000 7fc43086b640 1 -- 172.21.15.82:0/3178992562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc42c0b9450 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.951+0000 7fc41affd640 1 -- 172.21.15.82:0/3178992562 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5180 (secure 0 0 0) 0x7fc42407e1e0 con 0x7fc42c0d1fc0 2024-06-02T22:52:08.951 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:08.951 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/598338197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":598338197},{"type":"v1","addr":"172.21.15.184:6835","nonce":598338197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2379089503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2379089503},{"type":"v1","addr":"172.21.15.82:6836","nonce":2379089503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:02.905481+0000","modified":"2024-06-02T22:52:07.943138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1449064574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1449064574},{"type":"v1","addr":"172.21.15.82:6837","nonce":1449064574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-06-02T22:52:08.951 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 6 2024-06-02T22:52:08.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 -- 172.21.15.82:0/3178992562 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40c06be30 msgr2=0x7fc40c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:08.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40c06be30 0x7fc40c06e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc420006fd0 tx=0x7fc420008040 comp rx=0 tx=0).stop 2024-06-02T22:52:08.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 -- 172.21.15.82:0/3178992562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42c0d1fc0 msgr2=0x7fc42c0b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:08.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42c0d1fc0 0x7fc42c0b8ce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc424000f80 tx=0x7fc424004a40 comp rx=0 tx=0).stop 2024-06-02T22:52:08.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 -- 172.21.15.82:0/3178992562 shutdown_connections 2024-06-02T22:52:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40c06be30 0x7fc40c06e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc42c161fa0 0x7fc42c0b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc42c0d2680 0x7fc42c1f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 --2- 172.21.15.82:0/3178992562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42c0d1fc0 0x7fc42c0b8ce0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 -- 172.21.15.82:0/3178992562 >> 172.21.15.82:0/3178992562 conn(0x7fc42c09d3f0 msgr2=0x7fc42c0c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 -- 172.21.15.82:0/3178992562 shutdown_connections 2024-06-02T22:52:08.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:08.953+0000 7fc43086b640 1 -- 172.21.15.82:0/3178992562 wait complete. 2024-06-02T22:52:08.963 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.063+0000 7f8367a83640 1 Processor -- start 2024-06-02T22:52:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.063+0000 7f8367a83640 1 -- start start 2024-06-02T22:52:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f8367a83640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f836015c240 0x7f83600cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f8367a83640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f836006deb0 con 0x7f836006d9b0 2024-06-02T22:52:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f8367a83640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f836006e190 con 0x7f836015d8b0 2024-06-02T22:52:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f8367a83640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f836015d630 con 0x7f836015c240 2024-06-02T22:52:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f836501e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f836006d9b0 0x7f836006ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60586/0 (socket says 172.21.15.82:60586) 2024-06-02T22:52:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f836501e640 1 -- 172.21.15.82:0/1186750514 learned_addr learned my addr 172.21.15.82:0/1186750514 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f836581f640 1 --2- 172.21.15.82:0/1186750514 >> v2:172.21.15.184:3300/0 conn(0x7f836015c240 0x7f83600cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f836481d640 1 -- 172.21.15.82:0/1186750514 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050763945 0 0) 0x7f836006deb0 con 0x7f836006d9b0 2024-06-02T22:52:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f836481d640 1 -- 172.21.15.82:0/1186750514 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f834c003520 con 0x7f836006d9b0 2024-06-02T22:52:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f836481d640 1 -- 172.21.15.82:0/1186750514 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612630006 0 0) 0x7f836006e190 con 0x7f836015d8b0 2024-06-02T22:52:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f836481d640 1 -- 172.21.15.82:0/1186750514 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f836006deb0 con 0x7f836015d8b0 2024-06-02T22:52:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f836581f640 1 -- 172.21.15.82:0/1186750514 >> v1:172.21.15.184:6789/0 conn(0x7f836015d8b0 legacy=0x7f836006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f836581f640 1 -- 172.21.15.82:0/1186750514 >> v1:172.21.15.82:6789/0 conn(0x7f836006d9b0 legacy=0x7f836006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.064+0000 7f836581f640 1 -- 172.21.15.82:0/1186750514 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836006e470 con 0x7f836015c240 2024-06-02T22:52:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.065+0000 7f836581f640 1 --2- 172.21.15.82:0/1186750514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836015c240 0x7f83600cfef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f835c0097a0 tx=0x7f835c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9dc2d3ee4cf1d0c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.065+0000 7f836481d640 1 -- 172.21.15.82:0/1186750514 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c037070 con 0x7f836015c240 2024-06-02T22:52:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.065+0000 7f836481d640 1 -- 172.21.15.82:0/1186750514 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835c032440 con 0x7f836015c240 2024-06-02T22:52:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.065+0000 7f836481d640 1 -- 172.21.15.82:0/1186750514 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c0327f0 con 0x7f836015c240 2024-06-02T22:52:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.066+0000 7f8367a83640 1 -- 172.21.15.82:0/1186750514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836015c240 msgr2=0x7f83600cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.066+0000 7f8367a83640 1 --2- 172.21.15.82:0/1186750514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836015c240 0x7f83600cfef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f835c0097a0 tx=0x7f835c02a230 comp rx=0 tx=0).stop 2024-06-02T22:52:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.066+0000 7f8367a83640 1 -- 172.21.15.82:0/1186750514 shutdown_connections 2024-06-02T22:52:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.066+0000 7f8367a83640 1 --2- 172.21.15.82:0/1186750514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836015c240 0x7f83600cfef0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.066+0000 7f8367a83640 1 -- 172.21.15.82:0/1186750514 >> 172.21.15.82:0/1186750514 conn(0x7f8360071950 msgr2=0x7f8360071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:09.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.066+0000 7f8367a83640 1 -- 172.21.15.82:0/1186750514 shutdown_connections 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.066+0000 7f8367a83640 1 -- 172.21.15.82:0/1186750514 wait complete. 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.067+0000 7f8367a83640 1 Processor -- start 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.067+0000 7f8367a83640 1 -- start start 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f8367a83640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836006d9b0 0x7f8360145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f8367a83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836015c240 0x7f83600b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f8367a83640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f836015d8b0 0x7f836015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f8367a83640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f83600aff60 con 0x7f836015c240 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f8367a83640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f836006ea30 con 0x7f836006d9b0 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f8367a83640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f836006f660 con 0x7f836015d8b0 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f836501e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836015c240 0x7f83600b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f836501e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836015c240 0x7f83600b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36426/0 (socket says 172.21.15.82:36426) 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f836501e640 1 -- 172.21.15.82:0/4214349385 learned_addr learned my addr 172.21.15.82:0/4214349385 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f836581f640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836006d9b0 0x7f8360145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f8366020640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f836015d8b0 0x7f836015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f836501e640 1 -- 172.21.15.82:0/4214349385 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f836015d8b0 msgr2=0x7f836015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f836501e640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f836015d8b0 0x7f836015c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f836501e640 1 -- 172.21.15.82:0/4214349385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836006d9b0 msgr2=0x7f8360145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f836501e640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836006d9b0 0x7f8360145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f836501e640 1 -- 172.21.15.82:0/4214349385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83600b4490 con 0x7f836015c240 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f836581f640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836006d9b0 0x7f8360145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f836501e640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836015c240 0x7f83600b3b90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f835000c450 tx=0x7f835000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f83567fc640 1 -- 172.21.15.82:0/4214349385 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8350017070 con 0x7f836015c240 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f83567fc640 1 -- 172.21.15.82:0/4214349385 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8350005ce0 con 0x7f836015c240 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f83567fc640 1 -- 172.21.15.82:0/4214349385 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8350007270 con 0x7f836015c240 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f8367a83640 1 -- 172.21.15.82:0/4214349385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83600b4770 con 0x7f836015c240 2024-06-02T22:52:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.068+0000 7f8367a83640 1 -- 172.21.15.82:0/4214349385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83600b5010 con 0x7f836015c240 2024-06-02T22:52:09.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.069+0000 7f8367a83640 1 -- 172.21.15.82:0/4214349385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83600b4940 con 0x7f836015c240 2024-06-02T22:52:09.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.070+0000 7f83567fc640 1 -- 172.21.15.82:0/4214349385 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f835001a070 con 0x7f836015c240 2024-06-02T22:52:09.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.070+0000 7f83567fc640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f834406be30 0x7f834406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.070+0000 7f83567fc640 1 -- 172.21.15.82:0/4214349385 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f835008a3f0 con 0x7f836015c240 2024-06-02T22:52:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.070+0000 7f836581f640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f834406be30 0x7f834406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.071+0000 7f836581f640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f834406be30 0x7f834406e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f835c034000 tx=0x7f835c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:09.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.075+0000 7f83567fc640 1 -- 172.21.15.82:0/4214349385 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8350058410 con 0x7f836015c240 2024-06-02T22:52:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.248+0000 7f8367a83640 1 -- 172.21.15.82:0/4214349385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8360158960 con 0x7f836015c240 2024-06-02T22:52:09.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.249+0000 7f83567fc640 1 -- 172.21.15.82:0/4214349385 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f835005c710 con 0x7f836015c240 2024-06-02T22:52:09.249 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:09.250 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:07.942945+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 -- 172.21.15.82:0/4214349385 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f834406be30 msgr2=0x7f834406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f834406be30 0x7f834406e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f835c034000 tx=0x7f835c02e000 comp rx=0 tx=0).stop 2024-06-02T22:52:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 -- 172.21.15.82:0/4214349385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836015c240 msgr2=0x7f83600b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836015c240 0x7f83600b3b90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f835000c450 tx=0x7f835000c910 comp rx=0 tx=0).stop 2024-06-02T22:52:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 -- 172.21.15.82:0/4214349385 shutdown_connections 2024-06-02T22:52:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f834406be30 0x7f834406e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f836015d8b0 0x7f836015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836015c240 0x7f83600b3b90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 --2- 172.21.15.82:0/4214349385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f836006d9b0 0x7f8360145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 -- 172.21.15.82:0/4214349385 >> 172.21.15.82:0/4214349385 conn(0x7f8360071950 msgr2=0x7f8360152470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 -- 172.21.15.82:0/4214349385 shutdown_connections 2024-06-02T22:52:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.251+0000 7f8367a83640 1 -- 172.21.15.82:0/4214349385 wait complete. 2024-06-02T22:52:09.263 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.361+0000 7fb2db22a640 1 Processor -- start 2024-06-02T22:52:09.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.362+0000 7fb2db22a640 1 -- start start 2024-06-02T22:52:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2db22a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d4156830 0x7fb2d4071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2db22a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb2d415c7f0 0x7fb2d4165cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2db22a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d40725f0 con 0x7fb2d4072130 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2db22a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d40b3090 con 0x7fb2d415c7f0 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2db22a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d40728d0 con 0x7fb2d4156830 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2d97c7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb2d415c7f0 0x7fb2d4165cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2d97c7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb2d415c7f0 0x7fb2d4165cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36438/0 (socket says 172.21.15.82:36438) 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2d3fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb2d4072130 0x7fb2d40cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60602/0 (socket says 172.21.15.82:60602) 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2d97c7640 1 -- 172.21.15.82:0/3794623520 learned_addr learned my addr 172.21.15.82:0/3794623520 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2d8fc6640 1 --2- 172.21.15.82:0/3794623520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d4156830 0x7fb2d4071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2d97c7640 1 -- 172.21.15.82:0/3794623520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d4156830 msgr2=0x7fb2d4071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2d97c7640 1 --2- 172.21.15.82:0/3794623520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d4156830 0x7fb2d4071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2d97c7640 1 -- 172.21.15.82:0/3794623520 >> v1:172.21.15.82:6789/0 conn(0x7fb2d4072130 legacy=0x7fb2d40cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2d97c7640 1 -- 172.21.15.82:0/3794623520 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d4072bb0 con 0x7fb2d415c7f0 2024-06-02T22:52:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.363+0000 7fb2d37fe640 1 -- 172.21.15.82:0/3794623520 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157180846 0 0) 0x7fb2d40725f0 con 0x7fb2d4072130 2024-06-02T22:52:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2d97c7640 1 --2- 172.21.15.82:0/3794623520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d415c7f0 0x7fb2d4165cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009e80 tx=0x7fb2cc02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdff0f7b90aa0ffd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2d37fe640 1 -- 172.21.15.82:0/3794623520 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc036070 con 0x7fb2d415c7f0 2024-06-02T22:52:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2d37fe640 1 -- 172.21.15.82:0/3794623520 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2cc031600 con 0x7fb2d415c7f0 2024-06-02T22:52:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2d37fe640 1 -- 172.21.15.82:0/3794623520 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0319d0 con 0x7fb2d415c7f0 2024-06-02T22:52:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2db22a640 1 -- 172.21.15.82:0/3794623520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d415c7f0 msgr2=0x7fb2d4165cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2db22a640 1 --2- 172.21.15.82:0/3794623520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d415c7f0 0x7fb2d4165cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009e80 tx=0x7fb2cc02a750 comp rx=0 tx=0).stop 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2db22a640 1 -- 172.21.15.82:0/3794623520 shutdown_connections 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2db22a640 1 --2- 172.21.15.82:0/3794623520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d415c7f0 0x7fb2d4165cc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2db22a640 1 --2- 172.21.15.82:0/3794623520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d4156830 0x7fb2d4071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2db22a640 1 -- 172.21.15.82:0/3794623520 >> 172.21.15.82:0/3794623520 conn(0x7fb2d40b19f0 msgr2=0x7fb2d40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2db22a640 1 -- 172.21.15.82:0/3794623520 shutdown_connections 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.364+0000 7fb2db22a640 1 -- 172.21.15.82:0/3794623520 wait complete. 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.366+0000 7fb2db22a640 1 Processor -- start 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.366+0000 7fb2db22a640 1 -- start start 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.366+0000 7fb2db22a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4072130 0x7fb2d4156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.366+0000 7fb2db22a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d4156830 0x7fb2d40d0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.366+0000 7fb2db22a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d415c7f0 0x7fb2d415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2db22a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d40ccf00 con 0x7fb2d4072130 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2db22a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d40ccd80 con 0x7fb2d415c7f0 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2db22a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d40cd080 con 0x7fb2d4156830 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d8fc6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4072130 0x7fb2d4156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d8fc6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4072130 0x7fb2d4156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36444/0 (socket says 172.21.15.82:36444) 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d8fc6640 1 -- 172.21.15.82:0/2419768613 learned_addr learned my addr 172.21.15.82:0/2419768613 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d3fff640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d4156830 0x7fb2d40d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d97c7640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d415c7f0 0x7fb2d415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d8fc6640 1 -- 172.21.15.82:0/2419768613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d4156830 msgr2=0x7fb2d40d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d8fc6640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d4156830 0x7fb2d40d0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d8fc6640 1 -- 172.21.15.82:0/2419768613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d415c7f0 msgr2=0x7fb2d415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d8fc6640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d415c7f0 0x7fb2d415b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d8fc6640 1 -- 172.21.15.82:0/2419768613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d415aa30 con 0x7fb2d4072130 2024-06-02T22:52:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d3fff640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d4156830 0x7fb2d40d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d97c7640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d415c7f0 0x7fb2d415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d8fc6640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4072130 0x7fb2d4156ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800e9b0 tx=0x7fb2c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d17fa640 1 -- 172.21.15.82:0/2419768613 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8017070 con 0x7fb2d4072130 2024-06-02T22:52:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d17fa640 1 -- 172.21.15.82:0/2419768613 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c800c9a0 con 0x7fb2d4072130 2024-06-02T22:52:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2d17fa640 1 -- 172.21.15.82:0/2419768613 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800cd90 con 0x7fb2d4072130 2024-06-02T22:52:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2db22a640 1 -- 172.21.15.82:0/2419768613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d41f2890 con 0x7fb2d4072130 2024-06-02T22:52:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.367+0000 7fb2db22a640 1 -- 172.21.15.82:0/2419768613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d415acb0 con 0x7fb2d4072130 2024-06-02T22:52:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.368+0000 7fb2db22a640 1 -- 172.21.15.82:0/2419768613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d40b4db0 con 0x7fb2d4072130 2024-06-02T22:52:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.369+0000 7fb2d17fa640 1 -- 172.21.15.82:0/2419768613 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2c801a070 con 0x7fb2d4072130 2024-06-02T22:52:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.369+0000 7fb2d17fa640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2b806be60 0x7fb2b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.369+0000 7fb2d17fa640 1 -- 172.21.15.82:0/2419768613 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb2c808b190 con 0x7fb2d4072130 2024-06-02T22:52:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.369+0000 7fb2d3fff640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2b806be60 0x7fb2b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.369+0000 7fb2d3fff640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2b806be60 0x7fb2b806e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40b0e60 tx=0x7fb2c0007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.373+0000 7fb2d17fa640 1 -- 172.21.15.82:0/2419768613 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb2d40b4db0 con 0x7fb2d4072130 2024-06-02T22:52:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.549+0000 7fb2db22a640 1 -- 172.21.15.82:0/2419768613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2d4068430 con 0x7fb2d4072130 2024-06-02T22:52:09.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.550+0000 7fb2d17fa640 1 -- 172.21.15.82:0/2419768613 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7fb2d415aa30 con 0x7fb2d4072130 2024-06-02T22:52:09.550 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:09.551 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:07.942945+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:09.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.552+0000 7fb2db22a640 1 -- 172.21.15.82:0/2419768613 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2b806be60 msgr2=0x7fb2b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.552+0000 7fb2db22a640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2b806be60 0x7fb2b806e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40b0e60 tx=0x7fb2c0007c10 comp rx=0 tx=0).stop 2024-06-02T22:52:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.552+0000 7fb2db22a640 1 -- 172.21.15.82:0/2419768613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4072130 msgr2=0x7fb2d4156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.552+0000 7fb2db22a640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4072130 0x7fb2d4156ca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800e9b0 tx=0x7fb2c800ee70 comp rx=0 tx=0).stop 2024-06-02T22:52:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.553+0000 7fb2db22a640 1 -- 172.21.15.82:0/2419768613 shutdown_connections 2024-06-02T22:52:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.553+0000 7fb2db22a640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2b806be60 0x7fb2b806e320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.553+0000 7fb2db22a640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d415c7f0 0x7fb2d415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.553+0000 7fb2db22a640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d4156830 0x7fb2d40d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.553+0000 7fb2db22a640 1 --2- 172.21.15.82:0/2419768613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4072130 0x7fb2d4156ca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.553+0000 7fb2db22a640 1 -- 172.21.15.82:0/2419768613 >> 172.21.15.82:0/2419768613 conn(0x7fb2d40b19f0 msgr2=0x7fb2d415cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.553+0000 7fb2db22a640 1 -- 172.21.15.82:0/2419768613 shutdown_connections 2024-06-02T22:52:09.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.553+0000 7fb2db22a640 1 -- 172.21.15.82:0/2419768613 wait complete. 2024-06-02T22:52:09.580 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:52:09.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.679+0000 7f69617ee640 1 Processor -- start 2024-06-02T22:52:09.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.679+0000 7f69617ee640 1 -- start start 2024-06-02T22:52:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.680+0000 7f69617ee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f695c15f1a0 0x7f695c0d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.680+0000 7f69617ee640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f695c0cef70 0x7f695c0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.680+0000 7f69617ee640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f695c15f5e0 con 0x7f695c0d2680 2024-06-02T22:52:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.680+0000 7f69617ee640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f695c0d13e0 con 0x7f695c0cef70 2024-06-02T22:52:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.680+0000 7f69617ee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f695c0d0ad0 con 0x7f695c15f1a0 2024-06-02T22:52:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.680+0000 7f695a7fc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f695c15f1a0 0x7f695c0d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.680+0000 7f695b7fe640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f695c0cef70 0x7f695c0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.680+0000 7f695affd640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f695c0d2680 0x7f695c0d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:54446/0 (socket says 172.21.15.82:54446) 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.680+0000 7f695b7fe640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f695c0cef70 0x7f695c0cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50594/0 (socket says 172.21.15.82:50594) 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.680+0000 7f695affd640 1 -- 172.21.15.82:0/1490946138 learned_addr learned my addr 172.21.15.82:0/1490946138 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.680+0000 7f695a7fc640 1 --2- 172.21.15.82:0/1490946138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f695c15f1a0 0x7f695c0d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:44200/0 (socket says 172.21.15.82:44200) 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.681+0000 7f695b7fe640 1 -- 172.21.15.82:0/1490946138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f695c15f1a0 msgr2=0x7f695c0d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.681+0000 7f695b7fe640 1 --2- 172.21.15.82:0/1490946138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f695c15f1a0 0x7f695c0d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.681+0000 7f695b7fe640 1 -- 172.21.15.82:0/1490946138 >> v1:172.21.15.184:6789/0 conn(0x7f695c0d2680 legacy=0x7f695c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.681+0000 7f695b7fe640 1 -- 172.21.15.82:0/1490946138 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695c15f890 con 0x7f695c0cef70 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.681+0000 7f6959ffb640 1 -- 172.21.15.82:0/1490946138 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038568304 0 0) 0x7f695c15f5e0 con 0x7f695c0d2680 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.681+0000 7f695b7fe640 1 --2- 172.21.15.82:0/1490946138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c0cef70 0x7f695c0cf400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6954009d90 tx=0x7f695402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3797a5e22bb9974c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.681+0000 7f6959ffb640 1 -- 172.21.15.82:0/1490946138 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954007740 con 0x7f695c0cef70 2024-06-02T22:52:09.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.682+0000 7f6959ffb640 1 -- 172.21.15.82:0/1490946138 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69540078e0 con 0x7f695c0cef70 2024-06-02T22:52:09.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.682+0000 7f6959ffb640 1 -- 172.21.15.82:0/1490946138 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954007cb0 con 0x7f695c0cef70 2024-06-02T22:52:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.682+0000 7f69617ee640 1 -- 172.21.15.82:0/1490946138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c0cef70 msgr2=0x7f695c0cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.682+0000 7f69617ee640 1 --2- 172.21.15.82:0/1490946138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c0cef70 0x7f695c0cf400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6954009d90 tx=0x7f695402a660 comp rx=0 tx=0).stop 2024-06-02T22:52:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.682+0000 7f69617ee640 1 -- 172.21.15.82:0/1490946138 shutdown_connections 2024-06-02T22:52:09.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.682+0000 7f69617ee640 1 --2- 172.21.15.82:0/1490946138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c0cef70 0x7f695c0cf400 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.682+0000 7f69617ee640 1 --2- 172.21.15.82:0/1490946138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f695c15f1a0 0x7f695c0d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.682+0000 7f69617ee640 1 -- 172.21.15.82:0/1490946138 >> 172.21.15.82:0/1490946138 conn(0x7f695c09d3f0 msgr2=0x7f695c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.682+0000 7f69617ee640 1 -- 172.21.15.82:0/1490946138 shutdown_connections 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.682+0000 7f69617ee640 1 -- 172.21.15.82:0/1490946138 wait complete. 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.683+0000 7f69617ee640 1 Processor -- start 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.683+0000 7f69617ee640 1 -- start start 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f69617ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f695c0cef70 0x7f695c1494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f69617ee640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c0d2680 0x7f695c1f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f69617ee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f695c15f1a0 0x7f695c1f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f69617ee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f695c0d4f00 con 0x7f695c0cef70 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f69617ee640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f695c0d1070 con 0x7f695c0d2680 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f69617ee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f695c0d1870 con 0x7f695c15f1a0 2024-06-02T22:52:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f695affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f695c0cef70 0x7f695c1494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f695affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f695c0cef70 0x7f695c1494b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36460/0 (socket says 172.21.15.82:36460) 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f695affd640 1 -- 172.21.15.82:0/2162662791 learned_addr learned my addr 172.21.15.82:0/2162662791 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f695a7fc640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c0d2680 0x7f695c1f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f695b7fe640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f695c15f1a0 0x7f695c1f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f695affd640 1 -- 172.21.15.82:0/2162662791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f695c15f1a0 msgr2=0x7f695c1f7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f695affd640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f695c15f1a0 0x7f695c1f7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f695affd640 1 -- 172.21.15.82:0/2162662791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c0d2680 msgr2=0x7f695c1f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.684+0000 7f695affd640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c0d2680 0x7f695c1f7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.685+0000 7f695affd640 1 -- 172.21.15.82:0/2162662791 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695c0c7e90 con 0x7f695c0cef70 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.685+0000 7f695a7fc640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c0d2680 0x7f695c1f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.685+0000 7f695affd640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f695c0cef70 0x7f695c1494b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f694c00c4d0 tx=0x7f694c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.685+0000 7f69437fe640 1 -- 172.21.15.82:0/2162662791 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c018070 con 0x7f695c0cef70 2024-06-02T22:52:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.685+0000 7f69437fe640 1 -- 172.21.15.82:0/2162662791 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c007500 con 0x7f695c0cef70 2024-06-02T22:52:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.685+0000 7f69617ee640 1 -- 172.21.15.82:0/2162662791 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695c158ba0 con 0x7f695c0cef70 2024-06-02T22:52:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.685+0000 7f69437fe640 1 -- 172.21.15.82:0/2162662791 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c004a20 con 0x7f695c0cef70 2024-06-02T22:52:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.685+0000 7f69617ee640 1 -- 172.21.15.82:0/2162662791 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f695c0c8130 con 0x7f695c0cef70 2024-06-02T22:52:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.686+0000 7f69617ee640 1 -- 172.21.15.82:0/2162662791 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f695c068430 con 0x7f695c0cef70 2024-06-02T22:52:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.686+0000 7f69437fe640 1 -- 172.21.15.82:0/2162662791 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f694c004bc0 con 0x7f695c0cef70 2024-06-02T22:52:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.687+0000 7f69437fe640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f694806be30 0x7f694806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.687+0000 7f69437fe640 1 -- 172.21.15.82:0/2162662791 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f694c08a4c0 con 0x7f695c0cef70 2024-06-02T22:52:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.687+0000 7f695a7fc640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f694806be30 0x7f694806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.687+0000 7f695a7fc640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f694806be30 0x7f694806e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f695c0d3ce0 tx=0x7f6950008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.691+0000 7f69437fe640 1 -- 172.21.15.82:0/2162662791 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f694c058ab0 con 0x7f695c0cef70 2024-06-02T22:52:09.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.903+0000 7f69617ee640 1 -- 172.21.15.82:0/2162662791 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f695c0ce580 con 0x7f695c0cef70 2024-06-02T22:52:09.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.903+0000 7f69437fe640 1 -- 172.21.15.82:0/2162662791 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5180 (secure 0 0 0) 0x7f694c0583b0 con 0x7f695c0cef70 2024-06-02T22:52:09.903 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:09.903 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/598338197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":598338197},{"type":"v1","addr":"172.21.15.184:6835","nonce":598338197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2379089503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2379089503},{"type":"v1","addr":"172.21.15.82:6836","nonce":2379089503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:02.905481+0000","modified":"2024-06-02T22:52:07.943138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1449064574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1449064574},{"type":"v1","addr":"172.21.15.82:6837","nonce":1449064574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-06-02T22:52:09.903 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 6 2024-06-02T22:52:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 -- 172.21.15.82:0/2162662791 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f694806be30 msgr2=0x7f694806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f694806be30 0x7f694806e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f695c0d3ce0 tx=0x7f6950008040 comp rx=0 tx=0).stop 2024-06-02T22:52:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 -- 172.21.15.82:0/2162662791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f695c0cef70 msgr2=0x7f695c1494b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f695c0cef70 0x7f695c1494b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f694c00c4d0 tx=0x7f694c00c990 comp rx=0 tx=0).stop 2024-06-02T22:52:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 -- 172.21.15.82:0/2162662791 shutdown_connections 2024-06-02T22:52:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f694806be30 0x7f694806e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f695c15f1a0 0x7f695c1f7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f695c0d2680 0x7f695c1f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 --2- 172.21.15.82:0/2162662791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f695c0cef70 0x7f695c1494b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 -- 172.21.15.82:0/2162662791 >> 172.21.15.82:0/2162662791 conn(0x7f695c09d3f0 msgr2=0x7f695c0d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 -- 172.21.15.82:0/2162662791 shutdown_connections 2024-06-02T22:52:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:09.905+0000 7f69617ee640 1 -- 172.21.15.82:0/2162662791 wait complete. 2024-06-02T22:52:09.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:10.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.015+0000 7f47de8b3640 1 Processor -- start 2024-06-02T22:52:10.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.015+0000 7f47de8b3640 1 -- start start 2024-06-02T22:52:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.016+0000 7f47de8b3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47d806bad0 0x7f47d81553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.016+0000 7f47de8b3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d815f5c0 con 0x7f47d8154fc0 2024-06-02T22:52:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.016+0000 7f47de8b3640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d8162020 con 0x7f47d8162b00 2024-06-02T22:52:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.016+0000 7f47de8b3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f47d80d03a0 con 0x7f47d806bad0 2024-06-02T22:52:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.016+0000 7f47d77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47d806bad0 0x7f47d81553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.016+0000 7f47d77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47d806bad0 0x7f47d81553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36468/0 (socket says 172.21.15.82:36468) 2024-06-02T22:52:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.016+0000 7f47d77fe640 1 -- 172.21.15.82:0/4076761590 learned_addr learned my addr 172.21.15.82:0/4076761590 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.016+0000 7f47d7fff640 1 --1- 172.21.15.82:0/4076761590 >> v1:172.21.15.82:6789/0 conn(0x7f47d8154fc0 0x7f47d806b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60604/0 (socket says 172.21.15.82:60604) 2024-06-02T22:52:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.016+0000 7f47d77fe640 1 -- 172.21.15.82:0/4076761590 >> v1:172.21.15.184:6789/0 conn(0x7f47d8162b00 legacy=0x7f47d80afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.016+0000 7f47d77fe640 1 -- 172.21.15.82:0/4076761590 >> v1:172.21.15.82:6789/0 conn(0x7f47d8154fc0 legacy=0x7f47d806b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.016+0000 7f47d77fe640 1 -- 172.21.15.82:0/4076761590 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d8162300 con 0x7f47d806bad0 2024-06-02T22:52:10.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.017+0000 7f47d77fe640 1 --2- 172.21.15.82:0/4076761590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d806bad0 0x7f47d81553a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009870 tx=0x7f47cc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0920f49a82af59 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.017+0000 7f47d6ffd640 1 -- 172.21.15.82:0/4076761590 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc037070 con 0x7f47d806bad0 2024-06-02T22:52:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.017+0000 7f47d6ffd640 1 -- 172.21.15.82:0/4076761590 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47cc032440 con 0x7f47d806bad0 2024-06-02T22:52:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.017+0000 7f47d6ffd640 1 -- 172.21.15.82:0/4076761590 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc032810 con 0x7f47d806bad0 2024-06-02T22:52:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.017+0000 7f47de8b3640 1 -- 172.21.15.82:0/4076761590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d806bad0 msgr2=0x7f47d81553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.017+0000 7f47de8b3640 1 --2- 172.21.15.82:0/4076761590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d806bad0 0x7f47d81553a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009870 tx=0x7f47cc02a2a0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.017+0000 7f47de8b3640 1 -- 172.21.15.82:0/4076761590 shutdown_connections 2024-06-02T22:52:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.017+0000 7f47de8b3640 1 --2- 172.21.15.82:0/4076761590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d806bad0 0x7f47d81553a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.017+0000 7f47de8b3640 1 -- 172.21.15.82:0/4076761590 >> 172.21.15.82:0/4076761590 conn(0x7f47d80b2ae0 msgr2=0x7f47d80b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.017+0000 7f47de8b3640 1 -- 172.21.15.82:0/4076761590 shutdown_connections 2024-06-02T22:52:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.017+0000 7f47de8b3640 1 -- 172.21.15.82:0/4076761590 wait complete. 2024-06-02T22:52:10.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.018+0000 7f47de8b3640 1 Processor -- start 2024-06-02T22:52:10.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.019+0000 7f47de8b3640 1 -- start start 2024-06-02T22:52:10.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.019+0000 7f47de8b3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d806bad0 0x7f47d81e8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.019+0000 7f47de8b3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d8154fc0 0x7f47d8147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.019+0000 7f47de8b3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d8162b00 0x7f47d81f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.019+0000 7f47de8b3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f47d80b0670 con 0x7f47d806bad0 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.019+0000 7f47de8b3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f47d80b04f0 con 0x7f47d8154fc0 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.019+0000 7f47de8b3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f47d80b07f0 con 0x7f47d8162b00 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.019+0000 7f47d7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d806bad0 0x7f47d81e8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.019+0000 7f47d7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d806bad0 0x7f47d81e8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36480/0 (socket says 172.21.15.82:36480) 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.019+0000 7f47d7fff640 1 -- 172.21.15.82:0/886110611 learned_addr learned my addr 172.21.15.82:0/886110611 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47d77fe640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d8154fc0 0x7f47d8147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47dce50640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d8162b00 0x7f47d81f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47d7fff640 1 -- 172.21.15.82:0/886110611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d8162b00 msgr2=0x7f47d81f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47d7fff640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d8162b00 0x7f47d81f41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47d7fff640 1 -- 172.21.15.82:0/886110611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d8154fc0 msgr2=0x7f47d8147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47d7fff640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d8154fc0 0x7f47d8147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47d7fff640 1 -- 172.21.15.82:0/886110611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d80aef10 con 0x7f47d806bad0 2024-06-02T22:52:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47d77fe640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d8154fc0 0x7f47d8147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47d7fff640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d806bad0 0x7f47d81e8790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c400 tx=0x7f47c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47d4ff9640 1 -- 172.21.15.82:0/886110611 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c80074e0 con 0x7f47d806bad0 2024-06-02T22:52:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47d4ff9640 1 -- 172.21.15.82:0/886110611 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c8007680 con 0x7f47d806bad0 2024-06-02T22:52:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47de8b3640 1 -- 172.21.15.82:0/886110611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d80af1f0 con 0x7f47d806bad0 2024-06-02T22:52:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47d4ff9640 1 -- 172.21.15.82:0/886110611 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8004a00 con 0x7f47d806bad0 2024-06-02T22:52:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.020+0000 7f47de8b3640 1 -- 172.21.15.82:0/886110611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d80afa90 con 0x7f47d806bad0 2024-06-02T22:52:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.021+0000 7f47de8b3640 1 -- 172.21.15.82:0/886110611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d80af5e0 con 0x7f47d806bad0 2024-06-02T22:52:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.021+0000 7f47d4ff9640 1 -- 172.21.15.82:0/886110611 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47c801a020 con 0x7f47d806bad0 2024-06-02T22:52:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.022+0000 7f47d4ff9640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47c406be30 0x7f47c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.022+0000 7f47d77fe640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47c406be30 0x7f47c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.022+0000 7f47d4ff9640 1 -- 172.21.15.82:0/886110611 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f47c808a970 con 0x7f47d806bad0 2024-06-02T22:52:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.022+0000 7f47d77fe640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47c406be30 0x7f47c406e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f47cc034000 tx=0x7f47cc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.026+0000 7f47d4ff9640 1 -- 172.21.15.82:0/886110611 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f47c8059070 con 0x7f47d806bad0 2024-06-02T22:52:10.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.200+0000 7f47de8b3640 1 -- 172.21.15.82:0/886110611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47d8068430 con 0x7f47d806bad0 2024-06-02T22:52:10.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.202+0000 7f47d4ff9640 1 -- 172.21.15.82:0/886110611 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f47c8058970 con 0x7f47d806bad0 2024-06-02T22:52:10.202 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:10.202 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:07.942945+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 -- 172.21.15.82:0/886110611 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47c406be30 msgr2=0x7f47c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47c406be30 0x7f47c406e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f47cc034000 tx=0x7f47cc02e000 comp rx=0 tx=0).stop 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 -- 172.21.15.82:0/886110611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d806bad0 msgr2=0x7f47d81e8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d806bad0 0x7f47d81e8790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c400 tx=0x7f47c800c8c0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 -- 172.21.15.82:0/886110611 shutdown_connections 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47c406be30 0x7f47c406e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d8162b00 0x7f47d81f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d8154fc0 0x7f47d8147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 --2- 172.21.15.82:0/886110611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d806bad0 0x7f47d81e8790 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 -- 172.21.15.82:0/886110611 >> 172.21.15.82:0/886110611 conn(0x7f47d80b2ae0 msgr2=0x7f47d806b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 -- 172.21.15.82:0/886110611 shutdown_connections 2024-06-02T22:52:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.204+0000 7f47de8b3640 1 -- 172.21.15.82:0/886110611 wait complete. 2024-06-02T22:52:10.617 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T22:52:02.905481+0000', 'modified': '2024-06-02T22:52:07.943138+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/1449064574', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6835', 'nonce': 1449064574}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 1449064574}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-06-02T22:52:10.617 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T22:52:10.617 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-06-02T22:52:10.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.719+0000 7f251fca5640 1 Processor -- start 2024-06-02T22:52:10.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.719+0000 7f251fca5640 1 -- start start 2024-06-02T22:52:10.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.720+0000 7f251fca5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25180730d0 0x7f25180b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.720+0000 7f251fca5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25180b5f80 con 0x7f25180b5140 2024-06-02T22:52:10.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.720+0000 7f251fca5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25180b56e0 con 0x7f2518072350 2024-06-02T22:52:10.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.720+0000 7f251fca5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f25180b59c0 con 0x7f25180730d0 2024-06-02T22:52:10.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.720+0000 7f251d240640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25180730d0 0x7f25180b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.720+0000 7f251e242640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f25180b5140 0x7f25180cf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60610/0 (socket says 172.21.15.82:60610) 2024-06-02T22:52:10.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.720+0000 7f251e242640 1 -- 172.21.15.82:0/3620418871 learned_addr learned my addr 172.21.15.82:0/3620418871 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:10.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.720+0000 7f251d240640 1 -- 172.21.15.82:0/3620418871 >> v1:172.21.15.184:6789/0 conn(0x7f2518072350 legacy=0x7f2518072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.720+0000 7f251d240640 1 -- 172.21.15.82:0/3620418871 >> v1:172.21.15.82:6789/0 conn(0x7f25180b5140 legacy=0x7f25180cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.720+0000 7f251ca3f640 1 -- 172.21.15.82:0/3620418871 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516122383 0 0) 0x7f25180b5f80 con 0x7f25180b5140 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.720+0000 7f251d240640 1 -- 172.21.15.82:0/3620418871 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25180b5ca0 con 0x7f25180730d0 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.721+0000 7f251d240640 1 --2- 172.21.15.82:0/3620418871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25180730d0 0x7f25180b4c00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f25080097a0 tx=0x7f250802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2574a36e03593184 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.721+0000 7f251ca3f640 1 -- 172.21.15.82:0/3620418871 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508037070 con 0x7f25180730d0 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.721+0000 7f251ca3f640 1 -- 172.21.15.82:0/3620418871 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2508032440 con 0x7f25180730d0 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.721+0000 7f251ca3f640 1 -- 172.21.15.82:0/3620418871 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250802ae60 con 0x7f25180730d0 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.721+0000 7f251fca5640 1 -- 172.21.15.82:0/3620418871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25180730d0 msgr2=0x7f25180b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.721+0000 7f251fca5640 1 --2- 172.21.15.82:0/3620418871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25180730d0 0x7f25180b4c00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f25080097a0 tx=0x7f250802a110 comp rx=0 tx=0).stop 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.721+0000 7f251fca5640 1 -- 172.21.15.82:0/3620418871 shutdown_connections 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.721+0000 7f251fca5640 1 --2- 172.21.15.82:0/3620418871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25180730d0 0x7f25180b4c00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.721+0000 7f251fca5640 1 -- 172.21.15.82:0/3620418871 >> 172.21.15.82:0/3620418871 conn(0x7f25180b2ae0 msgr2=0x7f25180b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.721+0000 7f251fca5640 1 -- 172.21.15.82:0/3620418871 shutdown_connections 2024-06-02T22:52:10.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.722+0000 7f251fca5640 1 -- 172.21.15.82:0/3620418871 wait complete. 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.723+0000 7f251fca5640 1 Processor -- start 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.723+0000 7f251fca5640 1 -- start start 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.723+0000 7f251fca5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2518072350 0x7f2518156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.723+0000 7f251fca5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25180730d0 0x7f25181476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.723+0000 7f251fca5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25180b5140 0x7f251815f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.723+0000 7f251fca5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f251815c630 con 0x7f25180b5140 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.723+0000 7f251fca5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f251815c4b0 con 0x7f25180730d0 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.723+0000 7f251fca5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f25180cf920 con 0x7f2518072350 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251e242640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25180b5140 0x7f251815f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251e242640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25180b5140 0x7f251815f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36488/0 (socket says 172.21.15.82:36488) 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251e242640 1 -- 172.21.15.82:0/507058415 learned_addr learned my addr 172.21.15.82:0/507058415 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251d240640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25180730d0 0x7f25181476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251da41640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2518072350 0x7f2518156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251e242640 1 -- 172.21.15.82:0/507058415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2518072350 msgr2=0x7f2518156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251e242640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2518072350 0x7f2518156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251e242640 1 -- 172.21.15.82:0/507058415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25180730d0 msgr2=0x7f25181476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251e242640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25180730d0 0x7f25181476d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251e242640 1 -- 172.21.15.82:0/507058415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2518147c10 con 0x7f25180b5140 2024-06-02T22:52:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251e242640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25180b5140 0x7f251815f270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f251000c730 tx=0x7f251000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f250e7fc640 1 -- 172.21.15.82:0/507058415 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510018070 con 0x7f25180b5140 2024-06-02T22:52:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f250e7fc640 1 -- 172.21.15.82:0/507058415 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f251000ce40 con 0x7f25180b5140 2024-06-02T22:52:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251fca5640 1 -- 172.21.15.82:0/507058415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f251815f7b0 con 0x7f25180b5140 2024-06-02T22:52:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f250e7fc640 1 -- 172.21.15.82:0/507058415 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251000a860 con 0x7f25180b5140 2024-06-02T22:52:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.724+0000 7f251fca5640 1 -- 172.21.15.82:0/507058415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f251815e4b0 con 0x7f25180b5140 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.726+0000 7f250e7fc640 1 -- 172.21.15.82:0/507058415 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f251001b070 con 0x7f25180b5140 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.726+0000 7f250e7fc640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24fc06be60 0x7f24fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.726+0000 7f251da41640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24fc06be60 0x7f24fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.726+0000 7f250e7fc640 1 -- 172.21.15.82:0/507058415 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f251008a6d0 con 0x7f25180b5140 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.727+0000 7f251da41640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24fc06be60 0x7f24fc06e320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2514000f60 tx=0x7f2514009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.727+0000 7f25229ba740 1 Processor -- start 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.727+0000 7f25229ba740 1 -- start start 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f25229ba740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5ad00 0x557711f5d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f25229ba740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f5b0e0 0x557711f5da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f25229ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f2d960 0x557711f31170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f25229ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557711e96740 con 0x557711f2d960 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f25229ba740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x557711e34a80 con 0x557711f5b0e0 2024-06-02T22:52:10.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f25229ba740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x557711e92700 con 0x557711f5ad00 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f251e242640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f2d960 0x557711f31170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f251e242640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f2d960 0x557711f31170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36504/0 (socket says 172.21.15.82:36504) 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f251e242640 1 -- 172.21.15.82:0/2338094263 learned_addr learned my addr 172.21.15.82:0/2338094263 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f251da41640 1 --2- 172.21.15.82:0/2338094263 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5ad00 0x557711f5d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f251d240640 1 --2- 172.21.15.82:0/2338094263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f5b0e0 0x557711f5da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f251e242640 1 -- 172.21.15.82:0/2338094263 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5ad00 msgr2=0x557711f5d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f251e242640 1 --2- 172.21.15.82:0/2338094263 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5ad00 0x557711f5d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f251e242640 1 -- 172.21.15.82:0/2338094263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f5b0e0 msgr2=0x557711f5da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f251e242640 1 --2- 172.21.15.82:0/2338094263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f5b0e0 0x557711f5da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.728+0000 7f251e242640 1 -- 172.21.15.82:0/2338094263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557711e5ffb0 con 0x557711f2d960 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f251e242640 1 --2- 172.21.15.82:0/2338094263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f2d960 0x557711f31170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2510060cf0 tx=0x7f25100582b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b929ddc5f3c3b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f24fb7fe640 1 -- 172.21.15.82:0/2338094263 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510056940 con 0x557711f2d960 2024-06-02T22:52:10.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f24fb7fe640 1 -- 172.21.15.82:0/2338094263 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2510054cb0 con 0x557711f2d960 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f24fb7fe640 1 -- 172.21.15.82:0/2338094263 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251005ddc0 con 0x557711f2d960 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f25229ba740 1 -- 172.21.15.82:0/2338094263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f2d960 msgr2=0x557711f31170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f25229ba740 1 --2- 172.21.15.82:0/2338094263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f2d960 0x557711f31170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2510060cf0 tx=0x7f25100582b0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f25229ba740 1 -- 172.21.15.82:0/2338094263 shutdown_connections 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f25229ba740 1 --2- 172.21.15.82:0/2338094263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f2d960 0x557711f31170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f25229ba740 1 --2- 172.21.15.82:0/2338094263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f5b0e0 0x557711f5da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f25229ba740 1 --2- 172.21.15.82:0/2338094263 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5ad00 0x557711f5d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f25229ba740 1 -- 172.21.15.82:0/2338094263 >> 172.21.15.82:0/2338094263 conn(0x557711f2fbd0 msgr2=0x557711f78510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f25229ba740 1 -- 172.21.15.82:0/2338094263 shutdown_connections 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.729+0000 7f25229ba740 1 -- 172.21.15.82:0/2338094263 wait complete. 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.730+0000 7f25229ba740 1 -- start start 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.730+0000 7f25229ba740 1 Processor -- start 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f25229ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f89270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f25229ba740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f5b0e0 0x557711f7c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f25229ba740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f79640 0x557711f79aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f25229ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557711f32d80 con 0x557711f5ad00 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f25229ba740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x557711e1fc30 con 0x557711f5b0e0 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f25229ba740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x557711f33060 con 0x557711f79640 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f25229ba740 10 client.0 _ll_register_callbacks cb 0x557711e517f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251da41640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f89270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251da41640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f89270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36520/0 (socket says 172.21.15.82:36520) 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251da41640 1 -- 172.21.15.82:0/2386173017 learned_addr learned my addr 172.21.15.82:0/2386173017 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251d240640 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f5b0e0 0x557711f7c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251e242640 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f79640 0x557711f79aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251da41640 1 -- 172.21.15.82:0/2386173017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f79640 msgr2=0x557711f79aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251da41640 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f79640 0x557711f79aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251da41640 1 -- 172.21.15.82:0/2386173017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f5b0e0 msgr2=0x557711f7c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251da41640 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f5b0e0 0x557711f7c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251da41640 1 -- 172.21.15.82:0/2386173017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557711baa2d0 con 0x557711f5ad00 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251d240640 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f5b0e0 0x557711f7c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251e242640 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f79640 0x557711f79aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f251da41640 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f89270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2514001e40 tx=0x7f2514000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553e87142333a5d1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f24f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.731+0000 7f24f8ff9640 1 -- 172.21.15.82:0/2386173017 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2514003a40 con 0x557711f5ad00 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f24f8ff9640 1 -- 172.21.15.82:0/2386173017 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2514021dc0 con 0x557711f5ad00 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f25229ba740 1 -- 172.21.15.82:0/2386173017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2510054cb0 con 0x557711f5ad00 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f24f8ff9640 1 -- 172.21.15.82:0/2386173017 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f2514003be0 con 0x557711f5ad00 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f25229ba740 10 client.4398 fetch_fsmap learned FSMap version 6 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f25229ba740 1 -- 172.21.15.82:0/2386173017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x557711c746b0 con 0x557711f5ad00 2024-06-02T22:52:10.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f24f8ff9640 1 -- 172.21.15.82:0/2386173017 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2510054cb0 con 0x557711f5ad00 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f24f8ff9640 1 -- 172.21.15.82:0/2386173017 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f2514021420 con 0x557711f5ad00 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f25229ba740 10 client.4398 fetch_fsmap finished waiting for FSMap version 6 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f25229ba740 10 client.4398 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f25229ba740 20 client.4398 populate_metadata read hostname 'smithi082' 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f25229ba740 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x557711f550f0 0x557711f554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f25229ba740 4 client.4398 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f25229ba740 1 -- 172.21.15.82:0/2386173017 --> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557711ea3e70 con 0x557711f550f0 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f251d240640 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x557711f550f0 0x557711f554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f24f8ff9640 10 client.4398 ms_handle_connect on v2:172.21.15.82:6835/1449064574 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.732+0000 7f251d240640 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x557711f550f0 0x557711f554d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e5356ff099c5587 server_cookie=d683156315d9443 in_seq=0 out_seq=0 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f24f8ff9640 1 -- 172.21.15.82:0/2386173017 <== mds.0 v2:172.21.15.82:6835/1449064574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557711ea3e70 con 0x557711f550f0 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f24f8ff9640 10 client.4398 handle_command_reply: tid=0 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 1 client.4398 shutdown 2024-06-02T22:52:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 1 -- 172.21.15.82:0/2386173017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 msgr2=0x557711f89270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f89270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2514001e40 tx=0x7f2514000ed0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 1 -- 172.21.15.82:0/2386173017 shutdown_connections 2024-06-02T22:52:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x557711f550f0 0x557711f554d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f79640 0x557711f79aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f5b0e0 0x557711f7c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f24f8ff9640 0 client.4398 ms_handle_reset on v2:172.21.15.82:6835/1449064574 2024-06-02T22:52:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 1 --2- 172.21.15.82:0/2386173017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f89270 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 1 -- 172.21.15.82:0/2386173017 >> 172.21.15.82:0/2386173017 conn(0x557711f2d960 msgr2=0x557711f5a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 1 -- 172.21.15.82:0/2386173017 shutdown_connections 2024-06-02T22:52:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 1 -- 172.21.15.82:0/2386173017 wait complete. 2024-06-02T22:52:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.733+0000 7f25229ba740 20 client.4398 trim_cache size 0 max 16384 2024-06-02T22:52:10.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.752+0000 7f25229ba740 1 Processor -- start 2024-06-02T22:52:10.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.752+0000 7f25229ba740 1 -- start start 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f25229ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f9cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f25229ba740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5b0e0 0x557711f5e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f25229ba740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f79640 0x557711f5a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f25229ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f25181fe860 con 0x557711f5ad00 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f25229ba740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f25181fdc50 con 0x557711f79640 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f25229ba740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f25181fe210 con 0x557711f5b0e0 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f251da41640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f9cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f251da41640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f9cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36536/0 (socket says 172.21.15.82:36536) 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f251da41640 1 -- 172.21.15.82:0/1695969995 learned_addr learned my addr 172.21.15.82:0/1695969995 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f251da41640 1 -- 172.21.15.82:0/1695969995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5b0e0 msgr2=0x557711f5e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f251da41640 1 --2- 172.21.15.82:0/1695969995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5b0e0 0x557711f5e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f251da41640 1 -- 172.21.15.82:0/1695969995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f79640 msgr2=0x557711f5a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f251da41640 1 --2- 172.21.15.82:0/1695969995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f79640 0x557711f5a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f251da41640 1 -- 172.21.15.82:0/1695969995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557711f79e10 con 0x557711f5ad00 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f251da41640 1 --2- 172.21.15.82:0/1695969995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f9cb70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2514003620 tx=0x7f251401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd10835919ff937f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f24faffd640 1 -- 172.21.15.82:0/1695969995 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2514030040 con 0x557711f5ad00 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f24faffd640 1 -- 172.21.15.82:0/1695969995 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2514003d80 con 0x557711f5ad00 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.753+0000 7f24faffd640 1 -- 172.21.15.82:0/1695969995 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25140219c0 con 0x557711f5ad00 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.754+0000 7f25229ba740 1 -- 172.21.15.82:0/1695969995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 msgr2=0x557711f9cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.754+0000 7f25229ba740 1 --2- 172.21.15.82:0/1695969995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f9cb70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2514003620 tx=0x7f251401e000 comp rx=0 tx=0).stop 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.754+0000 7f25229ba740 1 -- 172.21.15.82:0/1695969995 shutdown_connections 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.754+0000 7f25229ba740 1 --2- 172.21.15.82:0/1695969995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f79640 0x557711f5a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.754+0000 7f25229ba740 1 --2- 172.21.15.82:0/1695969995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5b0e0 0x557711f5e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.754+0000 7f25229ba740 1 --2- 172.21.15.82:0/1695969995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5ad00 0x557711f9cb70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.754+0000 7f25229ba740 1 -- 172.21.15.82:0/1695969995 >> 172.21.15.82:0/1695969995 conn(0x557711f2d960 msgr2=0x557711f78510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.754+0000 7f25229ba740 1 -- 172.21.15.82:0/1695969995 shutdown_connections 2024-06-02T22:52:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.754+0000 7f25229ba740 1 -- 172.21.15.82:0/1695969995 wait complete. 2024-06-02T22:52:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.754+0000 7f25229ba740 1 -- start start 2024-06-02T22:52:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.754+0000 7f25229ba740 1 Processor -- start 2024-06-02T22:52:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.755+0000 7f25229ba740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5ad00 0x557711ff3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.755+0000 7f25229ba740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5b0e0 0x557711f56e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.755+0000 7f25229ba740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f79640 0x557711f573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.755+0000 7f25229ba740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557711f57db0 con 0x557711f5b0e0 2024-06-02T22:52:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.755+0000 7f25229ba740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x557711f56c90 con 0x557711f79640 2024-06-02T22:52:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.755+0000 7f25229ba740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x557711f8c4f0 con 0x557711f5ad00 2024-06-02T22:52:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.755+0000 7f25229ba740 10 client.0 _ll_register_callbacks cb 0x7f2514005300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:52:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.755+0000 7f251d240640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5b0e0 0x557711f56e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.755+0000 7f251d240640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5b0e0 0x557711f56e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36550/0 (socket says 172.21.15.82:36550) 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.755+0000 7f251d240640 1 -- 172.21.15.82:0/4137362149 learned_addr learned my addr 172.21.15.82:0/4137362149 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f251e242640 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f79640 0x557711f573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f251da41640 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5ad00 0x557711ff3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f251d240640 1 -- 172.21.15.82:0/4137362149 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5ad00 msgr2=0x557711ff3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f251d240640 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5ad00 0x557711ff3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f251d240640 1 -- 172.21.15.82:0/4137362149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f79640 msgr2=0x557711f573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f251d240640 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f79640 0x557711f573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f251d240640 1 -- 172.21.15.82:0/4137362149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557711f5a860 con 0x557711f5b0e0 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f251e242640 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f79640 0x557711f573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f251d240640 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5b0e0 0x557711f56e70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f25080098c0 tx=0x7f2508004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1732352ae5b8b8e0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f24f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f24f8ff9640 1 -- 172.21.15.82:0/4137362149 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508048060 con 0x557711f5b0e0 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f24f8ff9640 1 -- 172.21.15.82:0/4137362149 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2508032c20 con 0x557711f5b0e0 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f25229ba740 1 -- 172.21.15.82:0/4137362149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2514003d80 con 0x557711f5b0e0 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f24f8ff9640 1 -- 172.21.15.82:0/4137362149 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f250804e050 con 0x557711f5b0e0 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f25229ba740 10 client.4404 fetch_fsmap learned FSMap version 6 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f25229ba740 1 -- 172.21.15.82:0/4137362149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x557711f8b7c0 con 0x557711f5b0e0 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f24f8ff9640 1 -- 172.21.15.82:0/4137362149 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2514003d80 con 0x557711f5b0e0 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f24f8ff9640 1 -- 172.21.15.82:0/4137362149 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f2508051020 con 0x557711f5b0e0 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f25229ba740 10 client.4404 fetch_fsmap finished waiting for FSMap version 6 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f25229ba740 10 client.4404 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f25229ba740 20 client.4404 populate_metadata read hostname 'smithi082' 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f25229ba740 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x557711ff68b0 0x557711ff6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f25229ba740 4 client.4404 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.756+0000 7f25229ba740 1 -- 172.21.15.82:0/4137362149 --> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] -- command(tid 0: {"prefix": "status"}) -- 0x557711f5ebd0 con 0x557711ff68b0 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f251da41640 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x557711ff68b0 0x557711ff6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f24f8ff9640 10 client.4404 ms_handle_connect on v2:172.21.15.82:6835/1449064574 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f251da41640 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x557711ff68b0 0x557711ff6c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efea411e390cf4e6 server_cookie=9d6ed25fb7b25cc8 in_seq=0 out_seq=0 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f24f8ff9640 1 -- 172.21.15.82:0/4137362149 <== mds.0 v2:172.21.15.82:6835/1449064574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x557711f5ebd0 con 0x557711ff68b0 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f24f8ff9640 10 client.4404 handle_command_reply: tid=0 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 1 client.4404 shutdown 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 1 -- 172.21.15.82:0/4137362149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5b0e0 msgr2=0x557711f56e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5b0e0 0x557711f56e70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f25080098c0 tx=0x7f2508004730 comp rx=0 tx=0).stop 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 1 -- 172.21.15.82:0/4137362149 shutdown_connections 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x557711ff68b0 0x557711ff6c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557711f79640 0x557711f573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557711f5b0e0 0x557711f56e70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f24f8ff9640 0 client.4404 ms_handle_reset on v2:172.21.15.82:6835/1449064574 2024-06-02T22:52:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 1 --2- 172.21.15.82:0/4137362149 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x557711f5ad00 0x557711ff3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 1 -- 172.21.15.82:0/4137362149 >> 172.21.15.82:0/4137362149 conn(0x557711f2d960 msgr2=0x557711f554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 1 -- 172.21.15.82:0/4137362149 shutdown_connections 2024-06-02T22:52:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 1 -- 172.21.15.82:0/4137362149 wait complete. 2024-06-02T22:52:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.757+0000 7f25229ba740 20 client.4404 trim_cache size 0 max 16384 2024-06-02T22:52:10.764 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:52:10.764 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "6f85057c-cf41-4021-ae61-b6064b1147d0", 2024-06-02T22:52:10.764 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-06-02T22:52:10.764 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4290, 2024-06-02T22:52:10.764 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-06-02T22:52:10.764 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-06-02T22:52:10.765 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-06-02T22:52:10.765 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 7.205305031, 2024-06-02T22:52:10.765 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 6, 2024-06-02T22:52:10.765 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 24, 2024-06-02T22:52:10.765 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 24, 2024-06-02T22:52:10.765 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 13.327793917999999 2024-06-02T22:52:10.765 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 -- 172.21.15.82:0/507058415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24fc06be60 msgr2=0x7f24fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24fc06be60 0x7f24fc06e320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2514000f60 tx=0x7f2514009040 comp rx=0 tx=0).stop 2024-06-02T22:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 -- 172.21.15.82:0/507058415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25180b5140 msgr2=0x7f251815f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25180b5140 0x7f251815f270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f251000c730 tx=0x7f251000cbf0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 -- 172.21.15.82:0/507058415 shutdown_connections 2024-06-02T22:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24fc06be60 0x7f24fc06e320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25180b5140 0x7f251815f270 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25180730d0 0x7f25181476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 --2- 172.21.15.82:0/507058415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2518072350 0x7f2518156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 -- 172.21.15.82:0/507058415 >> 172.21.15.82:0/507058415 conn(0x7f25180b2ae0 msgr2=0x7f2518072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:10.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 -- 172.21.15.82:0/507058415 shutdown_connections 2024-06-02T22:52:10.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.758+0000 7f251fca5640 1 -- 172.21.15.82:0/507058415 wait complete. 2024-06-02T22:52:10.768 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T22:52:10.768 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:52:10.769 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T22:52:10.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.867+0000 7fc897914640 1 Processor -- start 2024-06-02T22:52:10.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.868+0000 7fc897914640 1 -- start start 2024-06-02T22:52:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc897914640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8900d1fc0 0x7fc8900cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc897914640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc89015f5e0 con 0x7fc89015f1a0 2024-06-02T22:52:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc897914640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8900d0ad0 con 0x7fc8900d2680 2024-06-02T22:52:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc897914640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fc8900d13e0 con 0x7fc8900d1fc0 2024-06-02T22:52:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc894eaf640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc89015f1a0 0x7fc8900cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60622/0 (socket says 172.21.15.82:60622) 2024-06-02T22:52:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc894eaf640 1 -- 172.21.15.82:0/317720087 learned_addr learned my addr 172.21.15.82:0/317720087 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc895eb1640 1 --2- 172.21.15.82:0/317720087 >> v2:172.21.15.184:3300/0 conn(0x7fc8900d1fc0 0x7fc8900cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185605816 0 0) 0x7fc89015f5e0 con 0x7fc89015f1a0 2024-06-02T22:52:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc878003520 con 0x7fc89015f1a0 2024-06-02T22:52:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3728409416 0 0) 0x7fc878003520 con 0x7fc89015f1a0 2024-06-02T22:52:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 >> v2:172.21.15.184:3300/0 conn(0x7fc8900d1fc0 msgr2=0x7fc8900cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 --2- 172.21.15.82:0/317720087 >> v2:172.21.15.184:3300/0 conn(0x7fc8900d1fc0 0x7fc8900cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 >> v1:172.21.15.184:6789/0 conn(0x7fc8900d2680 legacy=0x7fc8900d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89015f890 con 0x7fc89015f1a0 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fc884001670 con 0x7fc89015f1a0 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 >> v1:172.21.15.82:6789/0 conn(0x7fc89015f1a0 legacy=0x7fc8900cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8780039b0 0x7fc878003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc878004800 0x7fc878004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8780051c0 0x7fc87800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8900d13e0 con 0x7fc8780039b0 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc87800c060 con 0x7fc878004800 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc87800c260 con 0x7fc8780051c0 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc8956b0640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8780039b0 0x7fc878003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc894eaf640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc878004800 0x7fc878004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.869+0000 7fc895eb1640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8780051c0 0x7fc87800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.870+0000 7fc8956b0640 1 -- 172.21.15.82:0/317720087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8780051c0 msgr2=0x7fc87800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.870+0000 7fc8956b0640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8780051c0 0x7fc87800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.870+0000 7fc8956b0640 1 -- 172.21.15.82:0/317720087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc878004800 msgr2=0x7fc878004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.870+0000 7fc8956b0640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc878004800 0x7fc878004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.870+0000 7fc8956b0640 1 -- 172.21.15.82:0/317720087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc878003520 con 0x7fc8780039b0 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.870+0000 7fc895eb1640 1 -- 172.21.15.82:0/317720087 reap_dead start 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.870+0000 7fc894eaf640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc878004800 0x7fc878004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.870+0000 7fc8956b0640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8780039b0 0x7fc878003dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc888001750 tx=0x7fc878005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d82e1ad215174fd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.870+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc888001370 con 0x7fc8780039b0 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.870+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8880052d0 con 0x7fc8780039b0 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.870+0000 7fc88ffff640 1 -- 172.21.15.82:0/317720087 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88802abc0 con 0x7fc8780039b0 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.871+0000 7fc897914640 1 -- 172.21.15.82:0/317720087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8780039b0 msgr2=0x7fc878003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.871+0000 7fc897914640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8780039b0 0x7fc878003dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc888001750 tx=0x7fc878005830 comp rx=0 tx=0).stop 2024-06-02T22:52:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.871+0000 7fc897914640 1 -- 172.21.15.82:0/317720087 shutdown_connections 2024-06-02T22:52:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.871+0000 7fc897914640 1 --2- 172.21.15.82:0/317720087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8780039b0 0x7fc878003dd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.871+0000 7fc897914640 1 -- 172.21.15.82:0/317720087 >> 172.21.15.82:0/317720087 conn(0x7fc89009d3f0 msgr2=0x7fc8900d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.871+0000 7fc897914640 1 -- 172.21.15.82:0/317720087 shutdown_connections 2024-06-02T22:52:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.871+0000 7fc897914640 1 -- 172.21.15.82:0/317720087 wait complete. 2024-06-02T22:52:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.872+0000 7fc897914640 1 Processor -- start 2024-06-02T22:52:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.872+0000 7fc897914640 1 -- start start 2024-06-02T22:52:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc897914640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8780039b0 0x7fc89015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc897914640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8900a13f0 0x7fc8900a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc897914640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8900b8920 0x7fc8900b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc897914640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8900d2410 con 0x7fc8900b8920 2024-06-02T22:52:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc897914640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc8900d1070 con 0x7fc8900a13f0 2024-06-02T22:52:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc897914640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc8900d4f00 con 0x7fc8780039b0 2024-06-02T22:52:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc895eb1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8900b8920 0x7fc8900b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc895eb1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8900b8920 0x7fc8900b8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36570/0 (socket says 172.21.15.82:36570) 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc895eb1640 1 -- 172.21.15.82:0/2468351571 learned_addr learned my addr 172.21.15.82:0/2468351571 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc8956b0640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8780039b0 0x7fc89015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc894eaf640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8900a13f0 0x7fc8900a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc895eb1640 1 -- 172.21.15.82:0/2468351571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8780039b0 msgr2=0x7fc89015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc895eb1640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8780039b0 0x7fc89015a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc895eb1640 1 -- 172.21.15.82:0/2468351571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8900a13f0 msgr2=0x7fc8900a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc895eb1640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8900a13f0 0x7fc8900a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc895eb1640 1 -- 172.21.15.82:0/2468351571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89015ab00 con 0x7fc8900b8920 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc8956b0640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8780039b0 0x7fc89015a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc894eaf640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8900a13f0 0x7fc8900a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc895eb1640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8900b8920 0x7fc8900b8da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc880007cf0 tx=0x7fc8800115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc88dffb640 1 -- 172.21.15.82:0/2468351571 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880011de0 con 0x7fc8900b8920 2024-06-02T22:52:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc88dffb640 1 -- 172.21.15.82:0/2468351571 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc88001b070 con 0x7fc8900b8920 2024-06-02T22:52:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc897914640 1 -- 172.21.15.82:0/2468351571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8900b6f10 con 0x7fc8900b8920 2024-06-02T22:52:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.873+0000 7fc88dffb640 1 -- 172.21.15.82:0/2468351571 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880003990 con 0x7fc8900b8920 2024-06-02T22:52:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.874+0000 7fc897914640 1 -- 172.21.15.82:0/2468351571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8900b74d0 con 0x7fc8900b8920 2024-06-02T22:52:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.875+0000 7fc897914640 1 -- 172.21.15.82:0/2468351571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc890068430 con 0x7fc8900b8920 2024-06-02T22:52:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.875+0000 7fc88dffb640 1 -- 172.21.15.82:0/2468351571 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc880005d10 con 0x7fc8900b8920 2024-06-02T22:52:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.876+0000 7fc88dffb640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc87c06be30 0x7fc87c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.876+0000 7fc88dffb640 1 -- 172.21.15.82:0/2468351571 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc88008b440 con 0x7fc8900b8920 2024-06-02T22:52:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.876+0000 7fc8956b0640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc87c06be30 0x7fc87c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.876+0000 7fc8956b0640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc87c06be30 0x7fc87c06e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc888032000 tx=0x7fc88802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:10.880+0000 7fc88dffb640 1 -- 172.21.15.82:0/2468351571 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc89015ab00 con 0x7fc8900b8920 2024-06-02T22:52:11.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.092+0000 7fc897914640 1 -- 172.21.15.82:0/2468351571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc89008de90 con 0x7fc8900b8920 2024-06-02T22:52:11.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.093+0000 7fc88dffb640 1 -- 172.21.15.82:0/2468351571 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fc88001d310 con 0x7fc8900b8920 2024-06-02T22:52:11.092 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 -- 172.21.15.82:0/2468351571 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc87c06be30 msgr2=0x7fc87c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc87c06be30 0x7fc87c06e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc888032000 tx=0x7fc88802e000 comp rx=0 tx=0).stop 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 -- 172.21.15.82:0/2468351571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8900b8920 msgr2=0x7fc8900b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8900b8920 0x7fc8900b8da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc880007cf0 tx=0x7fc8800115a0 comp rx=0 tx=0).stop 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 -- 172.21.15.82:0/2468351571 shutdown_connections 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc87c06be30 0x7fc87c06e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8900b8920 0x7fc8900b8da0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8900a13f0 0x7fc8900a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 --2- 172.21.15.82:0/2468351571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8780039b0 0x7fc89015a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 -- 172.21.15.82:0/2468351571 >> 172.21.15.82:0/2468351571 conn(0x7fc89009d3f0 msgr2=0x7fc8900d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 -- 172.21.15.82:0/2468351571 shutdown_connections 2024-06-02T22:52:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11.095+0000 7fc897914640 1 -- 172.21.15.82:0/2468351571 wait complete. 2024-06-02T22:52:11.105 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-02T22:52:11.105 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:52:11.105 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-06-02T22:52:11.105 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-06-02T22:52:11.105 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:52:11.105 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-02T22:52:11.105 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:52:11.106 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:52:11.106 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-06-02T22:52:11.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:11.106 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-06-02T22:52:11.121 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:52:11.121 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:52:11.121 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:52:11.122 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:11.123 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T22:52:11.123 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42767sec preferred_lft 42767sec 2024-06-02T22:52:11.123 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-06-02T22:52:11.123 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:11.123 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T22:52:11.123 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:11.123 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:11.124 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-06-02T22:52:11.124 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-06-02T22:52:11.124 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-06-02T22:52:11.124 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T22:52:11.124 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:11.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:11.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:11.324 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:52:11.349 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-06-02T22:52:11.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:11.351 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-06-02T22:52:11.418 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-06-02T22:52:11.418 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:52:11.418 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T22:52:11.418 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T22:52:11.419 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:52:11.419 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:11.419 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:11.419 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T22:52:11.419 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T22:52:11.419 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T22:52:11.419 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:11.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:11.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:11.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:11.693 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-02T22:52:11.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:11.710 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-06-02T22:52:11.765 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:11.765 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:11.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:52:11.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-06-02T22:52:11.765 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:11.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:11.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:11.885 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-06-02T22:52:11.885 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:11.885 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:11.885 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-06-02T22:52:11.885 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T22:52:11.885 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-06-02T22:52:11.885 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-06-02T22:52:11.885 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-06-02T22:52:11.886 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:11.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:12.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:12.019 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:12.019 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:12.019 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-06-02T22:52:12.019 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T22:52:12.019 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:12.097 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-06-02T22:52:12.097 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:52:12.097 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:52:12.112 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-06-02T22:52:12.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:52:12.112 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:52:12.167 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:52:12.233 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:52:12.288 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:52:12.289 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:52:12.289 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:52:12.289 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:52:12.289 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:52:12.289 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:52:12.289 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:52:12.289 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:52:12.289 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:52:12.289 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:52:12.289 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:52:12.290 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:52:12.290 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:52:12.290 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:52:12.290 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:52:12.290 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:52:12.290 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:52:12.290 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:52:12.290 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:52:12.290 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:52:12.290 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:52:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:52:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:52:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:52:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:52:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:52:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:52:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:52:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:52:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:52:12.291 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:52:12.292 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:52:12.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:12.292 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:52:12.344 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T22:52:12.344 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-06-02T22:52:12.387 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:52:12.411 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:52:12.467 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:52:12.468 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:52:12.469 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:52:12.470 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:52:12.470 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:52:12.470 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:52:12.470 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:52:12.470 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:52:12.470 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:52:12.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:12.470 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:52:12.477 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:2024-06-02T22:52:12.477+0000 7f17a1244480 -1 init, newargv = 0x55967c82cd20 newargc=15 2024-06-02T22:52:12.477 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[44678]: starting ceph client 2024-06-02T22:52:12.482 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[44678]: starting fuse 2024-06-02T22:52:12.491 INFO:teuthology.orchestra.run.smithi082.stdout:40 2024-06-02T22:52:12.492 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T22:52:12.492 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:52:12.492 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-06-02T22:52:12.492 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-06-02T22:52:12.492 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-06-02T22:52:12.492 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-06-02T22:52:12.492 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:12.492 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-06-02T22:52:12.492 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-06-02T22:52:12.492 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-06-02T22:52:12.492 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:52:12.493 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:12.494 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.admin")) 2024-06-02T22:52:12.494 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-06-02T22:52:12.609 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.admin.44678.asok 2024-06-02T22:52:12.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:12.620 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44678.asok 2024-06-02T22:52:12.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:12.620 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44678.asok status 2024-06-02T22:52:12.754 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:52:12.754 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-06-02T22:52:12.754 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:52:12.754 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:52:12.754 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "admin", 2024-06-02T22:52:12.754 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-06-02T22:52:12.754 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-06-02T22:52:12.754 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "44678", 2024-06-02T22:52:12.754 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4419, 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 4419 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:52:12.755 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3337122139 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3337122139 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.4419 192.168.0.1:0/3337122139", 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/3337122139", 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 6, 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 24, 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:52:12.756 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-06-02T22:52:12.757 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-06-02T22:52:12.757 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:52:12.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:12.762 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-06-02T22:52:12.762 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:52:12.778 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-06-02T22:52:12.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:52:12.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:12.779 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:52:12.844 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-06-02T22:52:12.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T22:52:12.945 INFO:teuthology.orchestra.run.smithi082.stdout:# file: . 2024-06-02T22:52:12.945 INFO:teuthology.orchestra.run.smithi082.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-06-02T22:52:12.945 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:12.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:12.951 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:52:12.951 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:12.967 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:52:13.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.109+0000 7f4ba96f5640 1 Processor -- start 2024-06-02T22:52:13.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.109+0000 7f4ba96f5640 1 -- start start 2024-06-02T22:52:13.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4ba96f5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4ba40d1110 0x7f4ba40b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4ba96f5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba4161c10 0x7f4ba40d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4ba96f5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba40cebb0 con 0x7f4ba4161830 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4ba96f5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba40d4cf0 con 0x7f4ba40d1110 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4ba96f5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba40d2fc0 con 0x7f4ba4161c10 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4b9bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4ba40d1110 0x7f4ba40b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4b9bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4ba40d1110 0x7f4ba40b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54868/0 (socket says 172.21.15.82:54868) 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4ba2ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4ba4161830 0x7f4ba40d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42380/0 (socket says 172.21.15.82:42380) 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4b9bfff640 1 -- 172.21.15.82:0/944206471 learned_addr learned my addr 172.21.15.82:0/944206471 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4b9bfff640 1 -- 172.21.15.82:0/944206471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba4161c10 msgr2=0x7f4ba40d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4ba37fe640 1 --2- 172.21.15.82:0/944206471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba4161c10 0x7f4ba40d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4b9bfff640 1 --2- 172.21.15.82:0/944206471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba4161c10 0x7f4ba40d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4b9bfff640 1 -- 172.21.15.82:0/944206471 >> v1:172.21.15.82:6789/0 conn(0x7f4ba4161830 legacy=0x7f4ba40d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4b9bfff640 1 -- 172.21.15.82:0/944206471 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba40d4f20 con 0x7f4ba40d1110 2024-06-02T22:52:13.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.110+0000 7f4ba27fc640 1 -- 172.21.15.82:0/944206471 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3056892434 0 0) 0x7f4ba40cebb0 con 0x7f4ba4161830 2024-06-02T22:52:13.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.111+0000 7f4b9bfff640 1 --2- 172.21.15.82:0/944206471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba40d1110 0x7f4ba40b5270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009870 tx=0x7f4b8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffd5894e39249b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:13.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.111+0000 7f4ba27fc640 1 -- 172.21.15.82:0/944206471 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c037070 con 0x7f4ba40d1110 2024-06-02T22:52:13.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.111+0000 7f4ba27fc640 1 -- 172.21.15.82:0/944206471 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8c032440 con 0x7f4ba40d1110 2024-06-02T22:52:13.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.111+0000 7f4ba27fc640 1 -- 172.21.15.82:0/944206471 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c032810 con 0x7f4ba40d1110 2024-06-02T22:52:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.112+0000 7f4ba96f5640 1 -- 172.21.15.82:0/944206471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba40d1110 msgr2=0x7f4ba40b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.112+0000 7f4ba96f5640 1 --2- 172.21.15.82:0/944206471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba40d1110 0x7f4ba40b5270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009870 tx=0x7f4b8c02a270 comp rx=0 tx=0).stop 2024-06-02T22:52:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.112+0000 7f4ba96f5640 1 -- 172.21.15.82:0/944206471 shutdown_connections 2024-06-02T22:52:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.112+0000 7f4ba96f5640 1 --2- 172.21.15.82:0/944206471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba4161c10 0x7f4ba40d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.112+0000 7f4ba96f5640 1 --2- 172.21.15.82:0/944206471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba40d1110 0x7f4ba40b5270 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.112+0000 7f4ba96f5640 1 -- 172.21.15.82:0/944206471 >> 172.21.15.82:0/944206471 conn(0x7f4ba409d3e0 msgr2=0x7f4ba40d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.112+0000 7f4ba96f5640 1 -- 172.21.15.82:0/944206471 shutdown_connections 2024-06-02T22:52:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.112+0000 7f4ba96f5640 1 -- 172.21.15.82:0/944206471 wait complete. 2024-06-02T22:52:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.113+0000 7f4ba96f5640 1 Processor -- start 2024-06-02T22:52:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.113+0000 7f4ba96f5640 1 -- start start 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.113+0000 7f4ba96f5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ba40d1110 0x7f4ba40b8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba96f5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba4161830 0x7f4ba4160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba96f5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba4161c10 0x7f4ba41f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba96f5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba40d2ce0 con 0x7f4ba4161c10 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba96f5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba40d2a00 con 0x7f4ba40d1110 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba96f5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba40c7bf0 con 0x7f4ba4161830 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba4161c10 0x7f4ba41f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba4161c10 0x7f4ba41f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54880/0 (socket says 172.21.15.82:54880) 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba37fe640 1 -- 172.21.15.82:0/488294099 learned_addr learned my addr 172.21.15.82:0/488294099 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4b9bfff640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba4161830 0x7f4ba4160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba2ffd640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ba40d1110 0x7f4ba40b8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba37fe640 1 -- 172.21.15.82:0/488294099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba4161830 msgr2=0x7f4ba4160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba37fe640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba4161830 0x7f4ba4160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba37fe640 1 -- 172.21.15.82:0/488294099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ba40d1110 msgr2=0x7f4ba40b8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba37fe640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ba40d1110 0x7f4ba40b8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba37fe640 1 -- 172.21.15.82:0/488294099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba40b9440 con 0x7f4ba4161c10 2024-06-02T22:52:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba2ffd640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ba40d1110 0x7f4ba40b8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba37fe640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba4161c10 0x7f4ba41f52d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00cc30 tx=0x7f4b9c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/488294099 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00ce40 con 0x7f4ba4161c10 2024-06-02T22:52:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/488294099 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9c003990 con 0x7f4ba4161c10 2024-06-02T22:52:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba96f5640 1 -- 172.21.15.82:0/488294099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba4161040 con 0x7f4ba4161c10 2024-06-02T22:52:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/488294099 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c003d40 con 0x7f4ba4161c10 2024-06-02T22:52:13.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.114+0000 7f4ba96f5640 1 -- 172.21.15.82:0/488294099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba415f4a0 con 0x7f4ba4161c10 2024-06-02T22:52:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.115+0000 7f4ba96f5640 1 -- 172.21.15.82:0/488294099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba4068430 con 0x7f4ba4161c10 2024-06-02T22:52:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.116+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/488294099 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b9c003ee0 con 0x7f4ba4161c10 2024-06-02T22:52:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.116+0000 7f4b9b7fe640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4b8406be60 0x7f4b8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.116+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/488294099 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4b9c08b4b0 con 0x7f4ba4161c10 2024-06-02T22:52:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.116+0000 7f4ba2ffd640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4b8406be60 0x7f4b8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.117+0000 7f4ba2ffd640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4b8406be60 0x7f4b8406e320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b94000f60 tx=0x7f4b94007c30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:13.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.120+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/488294099 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4b9c014030 con 0x7f4ba4161c10 2024-06-02T22:52:13.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.305+0000 7f4ba96f5640 1 -- 172.21.15.82:0/488294099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4ba40d06b0 con 0x7f4ba4161c10 2024-06-02T22:52:13.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.305+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/488294099 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f4b9c0594d0 con 0x7f4ba4161c10 2024-06-02T22:52:13.305 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:52:13.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 -- 172.21.15.82:0/488294099 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4b8406be60 msgr2=0x7f4b8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4b8406be60 0x7f4b8406e320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b94000f60 tx=0x7f4b94007c30 comp rx=0 tx=0).stop 2024-06-02T22:52:13.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 -- 172.21.15.82:0/488294099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba4161c10 msgr2=0x7f4ba41f52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba4161c10 0x7f4ba41f52d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00cc30 tx=0x7f4b9c00a5c0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 -- 172.21.15.82:0/488294099 shutdown_connections 2024-06-02T22:52:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4b8406be60 0x7f4b8406e320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba4161c10 0x7f4ba41f52d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ba4161830 0x7f4ba4160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 --2- 172.21.15.82:0/488294099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ba40d1110 0x7f4ba40b8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 -- 172.21.15.82:0/488294099 >> 172.21.15.82:0/488294099 conn(0x7f4ba409d3e0 msgr2=0x7f4ba40cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 -- 172.21.15.82:0/488294099 shutdown_connections 2024-06-02T22:52:13.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.307+0000 7f4ba96f5640 1 -- 172.21.15.82:0/488294099 wait complete. 2024-06-02T22:52:13.318 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:52:13.318 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:13.334 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:52:13.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.474+0000 7f9e7c838640 1 Processor -- start 2024-06-02T22:52:13.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.474+0000 7f9e7c838640 1 -- start start 2024-06-02T22:52:13.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.475+0000 7f9e7c838640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9e7815f1a0 0x7f9e780d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.475+0000 7f9e7c838640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9e780cef70 0x7f9e780cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.475+0000 7f9e7c838640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7815f5e0 con 0x7f9e780d2680 2024-06-02T22:52:13.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.475+0000 7f9e7c838640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f9e780d13e0 con 0x7f9e7815f1a0 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.475+0000 7f9e7c838640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f9e780d0ad0 con 0x7f9e780cef70 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.475+0000 7f9e75d9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9e7815f1a0 0x7f9e780d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.475+0000 7f9e7659c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9e780d2680 0x7f9e780d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42390/0 (socket says 172.21.15.82:42390) 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.476+0000 7f9e7659c640 1 -- 172.21.15.82:0/1161842363 learned_addr learned my addr 172.21.15.82:0/1161842363 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.476+0000 7f9e75d9b640 1 -- 172.21.15.82:0/1161842363 >> v2:172.21.15.184:3300/0 conn(0x7f9e780cef70 msgr2=0x7f9e780cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.476+0000 7f9e76d9d640 1 --2- 172.21.15.82:0/1161842363 >> v2:172.21.15.184:3300/0 conn(0x7f9e780cef70 0x7f9e780cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.476+0000 7f9e7559a640 1 -- 172.21.15.82:0/1161842363 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216268631 0 0) 0x7f9e7815f5e0 con 0x7f9e780d2680 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.476+0000 7f9e75d9b640 1 --2- 172.21.15.82:0/1161842363 >> v2:172.21.15.184:3300/0 conn(0x7f9e780cef70 0x7f9e780cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.476+0000 7f9e75d9b640 1 -- 172.21.15.82:0/1161842363 >> v1:172.21.15.82:6789/0 conn(0x7f9e780d2680 legacy=0x7f9e780d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.476+0000 7f9e75d9b640 1 -- 172.21.15.82:0/1161842363 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7815f890 con 0x7f9e7815f1a0 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.476+0000 7f9e76d9d640 1 --2- 172.21.15.82:0/1161842363 >> v2:172.21.15.184:3300/0 conn(0x7f9e780cef70 0x7f9e780cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e75d9b640 1 --2- 172.21.15.82:0/1161842363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e7815f1a0 0x7f9e780d1fc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9e780d1560 tx=0x7f9e6c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c621e5c2a0e5b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e7559a640 1 -- 172.21.15.82:0/1161842363 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c007740 con 0x7f9e7815f1a0 2024-06-02T22:52:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e7559a640 1 -- 172.21.15.82:0/1161842363 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6c0078e0 con 0x7f9e7815f1a0 2024-06-02T22:52:13.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e7559a640 1 -- 172.21.15.82:0/1161842363 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c007cb0 con 0x7f9e7815f1a0 2024-06-02T22:52:13.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e7c838640 1 -- 172.21.15.82:0/1161842363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e7815f1a0 msgr2=0x7f9e780d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e7c838640 1 --2- 172.21.15.82:0/1161842363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e7815f1a0 0x7f9e780d1fc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9e780d1560 tx=0x7f9e6c02a660 comp rx=0 tx=0).stop 2024-06-02T22:52:13.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e7c838640 1 -- 172.21.15.82:0/1161842363 shutdown_connections 2024-06-02T22:52:13.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e7c838640 1 --2- 172.21.15.82:0/1161842363 >> v2:172.21.15.184:3300/0 conn(0x7f9e780cef70 0x7f9e780cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e7c838640 1 --2- 172.21.15.82:0/1161842363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e7815f1a0 0x7f9e780d1fc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e7c838640 1 -- 172.21.15.82:0/1161842363 >> 172.21.15.82:0/1161842363 conn(0x7f9e7809d3f0 msgr2=0x7f9e780d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e7c838640 1 -- 172.21.15.82:0/1161842363 shutdown_connections 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.477+0000 7f9e7c838640 1 -- 172.21.15.82:0/1161842363 wait complete. 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.479+0000 7f9e7c838640 1 Processor -- start 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.479+0000 7f9e7c838640 1 -- start start 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.479+0000 7f9e7c838640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e780cef70 0x7f9e781520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.479+0000 7f9e7c838640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e780d2680 0x7f9e781f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.479+0000 7f9e7c838640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e7815f1a0 0x7f9e781f8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.479+0000 7f9e7c838640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780d4f00 con 0x7f9e7815f1a0 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.479+0000 7f9e7c838640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780d1070 con 0x7f9e780cef70 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.479+0000 7f9e7c838640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f9e780d1870 con 0x7f9e780d2680 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e76d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e7815f1a0 0x7f9e781f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e76d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e7815f1a0 0x7f9e781f8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54908/0 (socket says 172.21.15.82:54908) 2024-06-02T22:52:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e76d9d640 1 -- 172.21.15.82:0/550673104 learned_addr learned my addr 172.21.15.82:0/550673104 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e75d9b640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e780d2680 0x7f9e781f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e7659c640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e780cef70 0x7f9e781520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e76d9d640 1 -- 172.21.15.82:0/550673104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e780d2680 msgr2=0x7f9e781f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e76d9d640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e780d2680 0x7f9e781f8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e76d9d640 1 -- 172.21.15.82:0/550673104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e780cef70 msgr2=0x7f9e781520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e76d9d640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e780cef70 0x7f9e781520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e76d9d640 1 -- 172.21.15.82:0/550673104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e780ccb00 con 0x7f9e7815f1a0 2024-06-02T22:52:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e76d9d640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e7815f1a0 0x7f9e781f8550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800c7c0 tx=0x7f9e6800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e66ffd640 1 -- 172.21.15.82:0/550673104 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e68015020 con 0x7f9e7815f1a0 2024-06-02T22:52:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e66ffd640 1 -- 172.21.15.82:0/550673104 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e68004230 con 0x7f9e7815f1a0 2024-06-02T22:52:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e66ffd640 1 -- 172.21.15.82:0/550673104 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e68007620 con 0x7f9e7815f1a0 2024-06-02T22:52:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e7c838640 1 -- 172.21.15.82:0/550673104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e780cbd40 con 0x7f9e7815f1a0 2024-06-02T22:52:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.480+0000 7f9e7c838640 1 -- 172.21.15.82:0/550673104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e780cc300 con 0x7f9e7815f1a0 2024-06-02T22:52:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.481+0000 7f9e7c838640 1 -- 172.21.15.82:0/550673104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e780c8d70 con 0x7f9e7815f1a0 2024-06-02T22:52:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.482+0000 7f9e66ffd640 1 -- 172.21.15.82:0/550673104 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e68018020 con 0x7f9e7815f1a0 2024-06-02T22:52:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.482+0000 7f9e66ffd640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9e5806be60 0x7f9e5806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.482+0000 7f9e7659c640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9e5806be60 0x7f9e5806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.482+0000 7f9e66ffd640 1 -- 172.21.15.82:0/550673104 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e6808b130 con 0x7f9e7815f1a0 2024-06-02T22:52:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.483+0000 7f9e7659c640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9e5806be60 0x7f9e5806e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e70000f60 tx=0x7f9e70007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.487+0000 7f9e66ffd640 1 -- 172.21.15.82:0/550673104 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9e6801f020 con 0x7f9e7815f1a0 2024-06-02T22:52:13.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.672+0000 7f9e7c838640 1 -- 172.21.15.82:0/550673104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9e780caa60 con 0x7f9e7815f1a0 2024-06-02T22:52:13.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.672+0000 7f9e66ffd640 1 -- 172.21.15.82:0/550673104 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f9e780caa60 con 0x7f9e7815f1a0 2024-06-02T22:52:13.672 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:52:13.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 -- 172.21.15.82:0/550673104 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9e5806be60 msgr2=0x7f9e5806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9e5806be60 0x7f9e5806e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e70000f60 tx=0x7f9e70007b50 comp rx=0 tx=0).stop 2024-06-02T22:52:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 -- 172.21.15.82:0/550673104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e7815f1a0 msgr2=0x7f9e781f8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e7815f1a0 0x7f9e781f8550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800c7c0 tx=0x7f9e6800cc80 comp rx=0 tx=0).stop 2024-06-02T22:52:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 -- 172.21.15.82:0/550673104 shutdown_connections 2024-06-02T22:52:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9e5806be60 0x7f9e5806e320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e7815f1a0 0x7f9e781f8550 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9e780d2680 0x7f9e781f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 --2- 172.21.15.82:0/550673104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e780cef70 0x7f9e781520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 -- 172.21.15.82:0/550673104 >> 172.21.15.82:0/550673104 conn(0x7f9e7809d3f0 msgr2=0x7f9e7815fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 -- 172.21.15.82:0/550673104 shutdown_connections 2024-06-02T22:52:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:13.674+0000 7f9e7c838640 1 -- 172.21.15.82:0/550673104 wait complete. 2024-06-02T22:52:13.685 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-06-02T22:52:13.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:13.685 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:52:13.708 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[44678]: fuse finished with error 0 and tester_r 0 2024-06-02T22:52:13.710 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:52:19.811 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:52:19.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:19.812 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-06-02T22:52:19.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:20.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.002+0000 7fe828d1d640 1 Processor -- start 2024-06-02T22:52:20.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.002+0000 7fe828d1d640 1 -- start start 2024-06-02T22:52:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.002+0000 7fe828d1d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8240ae910 0x7fe82406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.002+0000 7fe828d1d640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe8240cf360 0x7fe8240acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.002+0000 7fe828d1d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82406d130 con 0x7fe82406ea20 2024-06-02T22:52:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.002+0000 7fe828d1d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe82406ee90 con 0x7fe8240ae910 2024-06-02T22:52:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.002+0000 7fe828d1d640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fe82406d410 con 0x7fe8240cf360 2024-06-02T22:52:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.003+0000 7fe82259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8240ae910 0x7fe82406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.003+0000 7fe82259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8240ae910 0x7fe82406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54912/0 (socket says 172.21.15.82:54912) 2024-06-02T22:52:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.003+0000 7fe82259c640 1 -- 172.21.15.82:0/1876954572 learned_addr learned my addr 172.21.15.82:0/1876954572 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.003+0000 7fe822d9d640 1 --2- 172.21.15.82:0/1876954572 >> v2:172.21.15.184:3300/0 conn(0x7fe8240cf360 0x7fe8240acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.003+0000 7fe82259c640 1 -- 172.21.15.82:0/1876954572 >> v2:172.21.15.184:3300/0 conn(0x7fe8240cf360 msgr2=0x7fe8240acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.003+0000 7fe82259c640 1 --2- 172.21.15.82:0/1876954572 >> v2:172.21.15.184:3300/0 conn(0x7fe8240cf360 0x7fe8240acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.003+0000 7fe82259c640 1 -- 172.21.15.82:0/1876954572 >> v1:172.21.15.184:6789/0 conn(0x7fe82406ea20 legacy=0x7fe8240cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.003+0000 7fe82259c640 1 -- 172.21.15.82:0/1876954572 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82406d6f0 con 0x7fe8240ae910 2024-06-02T22:52:20.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.003+0000 7fe822d9d640 1 --2- 172.21.15.82:0/1876954572 >> v2:172.21.15.184:3300/0 conn(0x7fe8240cf360 0x7fe8240acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe82259c640 1 --2- 172.21.15.82:0/1876954572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8240ae910 0x7fe82406e4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe82406fbc0 tx=0x7fe81402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e4e3711c90434e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe821d9b640 1 -- 172.21.15.82:0/1876954572 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814037070 con 0x7fe8240ae910 2024-06-02T22:52:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe821d9b640 1 -- 172.21.15.82:0/1876954572 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe814032440 con 0x7fe8240ae910 2024-06-02T22:52:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe821d9b640 1 -- 172.21.15.82:0/1876954572 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814032810 con 0x7fe8240ae910 2024-06-02T22:52:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe828d1d640 1 -- 172.21.15.82:0/1876954572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8240ae910 msgr2=0x7fe82406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe828d1d640 1 --2- 172.21.15.82:0/1876954572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8240ae910 0x7fe82406e4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe82406fbc0 tx=0x7fe81402a1e0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe828d1d640 1 -- 172.21.15.82:0/1876954572 shutdown_connections 2024-06-02T22:52:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe828d1d640 1 --2- 172.21.15.82:0/1876954572 >> v2:172.21.15.184:3300/0 conn(0x7fe8240cf360 0x7fe8240acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe828d1d640 1 --2- 172.21.15.82:0/1876954572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8240ae910 0x7fe82406e4e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe828d1d640 1 -- 172.21.15.82:0/1876954572 >> 172.21.15.82:0/1876954572 conn(0x7fe8240b19f0 msgr2=0x7fe8240b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe828d1d640 1 -- 172.21.15.82:0/1876954572 shutdown_connections 2024-06-02T22:52:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.004+0000 7fe828d1d640 1 -- 172.21.15.82:0/1876954572 wait complete. 2024-06-02T22:52:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.006+0000 7fe828d1d640 1 Processor -- start 2024-06-02T22:52:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.006+0000 7fe828d1d640 1 -- start start 2024-06-02T22:52:20.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe828d1d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe82406ea20 0x7fe824151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe828d1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8240ae910 0x7fe824158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe828d1d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8240cf360 0x7fe824155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe828d1d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe8240ad280 con 0x7fe8240ae910 2024-06-02T22:52:20.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe828d1d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe8240aecf0 con 0x7fe82406ea20 2024-06-02T22:52:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe828d1d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe8240ad400 con 0x7fe8240cf360 2024-06-02T22:52:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8240ae910 0x7fe824158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8240ae910 0x7fe824158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54918/0 (socket says 172.21.15.82:54918) 2024-06-02T22:52:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81bfff640 1 -- 172.21.15.82:0/3313623497 learned_addr learned my addr 172.21.15.82:0/3313623497 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe82259c640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe82406ea20 0x7fe824151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe822d9d640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8240cf360 0x7fe824155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81bfff640 1 -- 172.21.15.82:0/3313623497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8240cf360 msgr2=0x7fe824155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81bfff640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8240cf360 0x7fe824155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81bfff640 1 -- 172.21.15.82:0/3313623497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe82406ea20 msgr2=0x7fe824151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81bfff640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe82406ea20 0x7fe824151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81bfff640 1 -- 172.21.15.82:0/3313623497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82409c300 con 0x7fe8240ae910 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81bfff640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8240ae910 0x7fe824158040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00c400 tx=0x7fe80c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81affd640 1 -- 172.21.15.82:0/3313623497 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c017070 con 0x7fe8240ae910 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81affd640 1 -- 172.21.15.82:0/3313623497 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80c0052d0 con 0x7fe8240ae910 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe828d1d640 1 -- 172.21.15.82:0/3313623497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8241562b0 con 0x7fe8240ae910 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe81affd640 1 -- 172.21.15.82:0/3313623497 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c003830 con 0x7fe8240ae910 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.007+0000 7fe828d1d640 1 -- 172.21.15.82:0/3313623497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe824156590 con 0x7fe8240ae910 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.009+0000 7fe828d1d640 1 -- 172.21.15.82:0/3313623497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe824068430 con 0x7fe8240ae910 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.009+0000 7fe81affd640 1 -- 172.21.15.82:0/3313623497 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe80c01a070 con 0x7fe8240ae910 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.009+0000 7fe81affd640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe80406be30 0x7fe80406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.009+0000 7fe81affd640 1 -- 172.21.15.82:0/3313623497 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe80c08a450 con 0x7fe8240ae910 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.009+0000 7fe82259c640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe80406be30 0x7fe80406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.010+0000 7fe82259c640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe80406be30 0x7fe80406e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe814034000 tx=0x7fe81402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.014+0000 7fe81affd640 1 -- 172.21.15.82:0/3313623497 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe80c058470 con 0x7fe8240ae910 2024-06-02T22:52:20.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.188+0000 7fe828d1d640 1 -- 172.21.15.82:0/3313623497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe82409dde0 con 0x7fe8240ae910 2024-06-02T22:52:20.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.189+0000 7fe81affd640 1 -- 172.21.15.82:0/3313623497 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7fe80c05c770 con 0x7fe8240ae910 2024-06-02T22:52:20.189 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:20.189 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:07.942945+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 -- 172.21.15.82:0/3313623497 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe80406be30 msgr2=0x7fe80406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe80406be30 0x7fe80406e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe814034000 tx=0x7fe81402e000 comp rx=0 tx=0).stop 2024-06-02T22:52:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 -- 172.21.15.82:0/3313623497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8240ae910 msgr2=0x7fe824158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8240ae910 0x7fe824158040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00c400 tx=0x7fe80c00c8c0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 -- 172.21.15.82:0/3313623497 shutdown_connections 2024-06-02T22:52:20.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe80406be30 0x7fe80406e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8240cf360 0x7fe824155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8240ae910 0x7fe824158040 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 --2- 172.21.15.82:0/3313623497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe82406ea20 0x7fe824151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 -- 172.21.15.82:0/3313623497 >> 172.21.15.82:0/3313623497 conn(0x7fe8240b19f0 msgr2=0x7fe8240ad7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:20.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 -- 172.21.15.82:0/3313623497 shutdown_connections 2024-06-02T22:52:20.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.191+0000 7fe828d1d640 1 -- 172.21.15.82:0/3313623497 wait complete. 2024-06-02T22:52:20.203 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:20.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.302+0000 7f63f89f9640 1 Processor -- start 2024-06-02T22:52:20.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.302+0000 7f63f89f9640 1 -- start start 2024-06-02T22:52:20.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.303+0000 7f63f89f9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63f40cc6d0 0x7f63f40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.303+0000 7f63f89f9640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f63f40720e0 0x7f63f40b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.303+0000 7f63f89f9640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f40ccff0 con 0x7f63f4071c60 2024-06-02T22:52:20.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.303+0000 7f63f89f9640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f63f4072550 con 0x7f63f40720e0 2024-06-02T22:52:20.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.303+0000 7f63f89f9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f63f4072820 con 0x7f63f40cc6d0 2024-06-02T22:52:20.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.303+0000 7f63f259c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63f40cc6d0 0x7f63f40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.303+0000 7f63f2d9d640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f63f40720e0 0x7f63f40b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.303+0000 7f63f1d9b640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f63f4071c60 0x7f63f40b36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:50054/0 (socket says 172.21.15.82:50054) 2024-06-02T22:52:20.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.303+0000 7f63f259c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63f40cc6d0 0x7f63f40ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:41462/0 (socket says 172.21.15.82:41462) 2024-06-02T22:52:20.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.303+0000 7f63f1d9b640 1 -- 172.21.15.82:0/2101490794 learned_addr learned my addr 172.21.15.82:0/2101490794 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:20.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.304+0000 7f63f259c640 1 -- 172.21.15.82:0/2101490794 >> v2:172.21.15.184:3300/0 conn(0x7f63f40720e0 msgr2=0x7f63f40b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:20.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.304+0000 7f63f259c640 1 --2- 172.21.15.82:0/2101490794 >> v2:172.21.15.184:3300/0 conn(0x7f63f40720e0 0x7f63f40b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.304+0000 7f63f259c640 1 -- 172.21.15.82:0/2101490794 >> v1:172.21.15.184:6789/0 conn(0x7f63f4071c60 legacy=0x7f63f40b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.304+0000 7f63f259c640 1 -- 172.21.15.82:0/2101490794 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f4072b00 con 0x7f63f40cc6d0 2024-06-02T22:52:20.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.304+0000 7f63f159a640 1 -- 172.21.15.82:0/2101490794 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287970258 0 0) 0x7f63f40ccff0 con 0x7f63f4071c60 2024-06-02T22:52:20.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.304+0000 7f63f2d9d640 1 --2- 172.21.15.82:0/2101490794 >> v2:172.21.15.184:3300/0 conn(0x7f63f40720e0 0x7f63f40b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:20.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f259c640 1 --2- 172.21.15.82:0/2101490794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63f40cc6d0 0x7f63f40ccab0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f63e40097a0 tx=0x7f63e402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99980812b2167796 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:20.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f159a640 1 -- 172.21.15.82:0/2101490794 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4037070 con 0x7f63f40cc6d0 2024-06-02T22:52:20.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f159a640 1 -- 172.21.15.82:0/2101490794 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e4032440 con 0x7f63f40cc6d0 2024-06-02T22:52:20.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f159a640 1 -- 172.21.15.82:0/2101490794 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4032810 con 0x7f63f40cc6d0 2024-06-02T22:52:20.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f89f9640 1 -- 172.21.15.82:0/2101490794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63f40cc6d0 msgr2=0x7f63f40ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f89f9640 1 --2- 172.21.15.82:0/2101490794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63f40cc6d0 0x7f63f40ccab0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f63e40097a0 tx=0x7f63e402a180 comp rx=0 tx=0).stop 2024-06-02T22:52:20.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f89f9640 1 -- 172.21.15.82:0/2101490794 shutdown_connections 2024-06-02T22:52:20.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f89f9640 1 --2- 172.21.15.82:0/2101490794 >> v2:172.21.15.184:3300/0 conn(0x7f63f40720e0 0x7f63f40b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f89f9640 1 --2- 172.21.15.82:0/2101490794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63f40cc6d0 0x7f63f40ccab0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f89f9640 1 -- 172.21.15.82:0/2101490794 >> 172.21.15.82:0/2101490794 conn(0x7f63f40b19f0 msgr2=0x7f63f40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:20.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f89f9640 1 -- 172.21.15.82:0/2101490794 shutdown_connections 2024-06-02T22:52:20.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.305+0000 7f63f89f9640 1 -- 172.21.15.82:0/2101490794 wait complete. 2024-06-02T22:52:20.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.307+0000 7f63f89f9640 1 Processor -- start 2024-06-02T22:52:20.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.307+0000 7f63f89f9640 1 -- start start 2024-06-02T22:52:20.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.307+0000 7f63f89f9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63f4071c60 0x7f63f4150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.307+0000 7f63f89f9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63f40720e0 0x7f63f40d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.307+0000 7f63f89f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f40cc6d0 0x7f63f409c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.307+0000 7f63f89f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f63f415c890 con 0x7f63f40cc6d0 2024-06-02T22:52:20.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.307+0000 7f63f89f9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f63f40b31a0 con 0x7f63f4071c60 2024-06-02T22:52:20.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.307+0000 7f63f89f9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f63f4159f60 con 0x7f63f40720e0 2024-06-02T22:52:20.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63f2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f40cc6d0 0x7f63f409c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63f2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f40cc6d0 0x7f63f409c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54934/0 (socket says 172.21.15.82:54934) 2024-06-02T22:52:20.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63f2d9d640 1 -- 172.21.15.82:0/2102505805 learned_addr learned my addr 172.21.15.82:0/2102505805 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:20.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63f2d9d640 1 -- 172.21.15.82:0/2102505805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63f40720e0 msgr2=0x7f63f40d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63f2d9d640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63f40720e0 0x7f63f40d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63f2d9d640 1 -- 172.21.15.82:0/2102505805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63f4071c60 msgr2=0x7f63f4150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63f2d9d640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63f4071c60 0x7f63f4150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63f2d9d640 1 -- 172.21.15.82:0/2102505805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f40ce550 con 0x7f63f40cc6d0 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63f2d9d640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f40cc6d0 0x7f63f409c950 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00efc0 tx=0x7f63ec009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63e2ffd640 1 -- 172.21.15.82:0/2102505805 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec018030 con 0x7f63f40cc6d0 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63e2ffd640 1 -- 172.21.15.82:0/2102505805 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ec00cd80 con 0x7f63f40cc6d0 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63f89f9640 1 -- 172.21.15.82:0/2102505805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f40ce830 con 0x7f63f40cc6d0 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63e2ffd640 1 -- 172.21.15.82:0/2102505805 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec003bb0 con 0x7f63f40cc6d0 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.308+0000 7f63f89f9640 1 -- 172.21.15.82:0/2102505805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f40cedf0 con 0x7f63f40cc6d0 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.309+0000 7f63f89f9640 1 -- 172.21.15.82:0/2102505805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f4151ec0 con 0x7f63f40cc6d0 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.310+0000 7f63e2ffd640 1 -- 172.21.15.82:0/2102505805 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63ec01b070 con 0x7f63f40cc6d0 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.310+0000 7f63e2ffd640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f63d406be30 0x7f63d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.310+0000 7f63e2ffd640 1 -- 172.21.15.82:0/2102505805 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f63ec08bc50 con 0x7f63f40cc6d0 2024-06-02T22:52:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.310+0000 7f63f259c640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f63d406be30 0x7f63d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.311+0000 7f63f259c640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f63d406be30 0x7f63d406e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f63e4034000 tx=0x7f63e402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:20.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.315+0000 7f63e2ffd640 1 -- 172.21.15.82:0/2102505805 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f63f4151ec0 con 0x7f63f40cc6d0 2024-06-02T22:52:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.488+0000 7f63f89f9640 1 -- 172.21.15.82:0/2102505805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63f4068430 con 0x7f63f40cc6d0 2024-06-02T22:52:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.489+0000 7f63e2ffd640 1 -- 172.21.15.82:0/2102505805 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f63ec091020 con 0x7f63f40cc6d0 2024-06-02T22:52:20.489 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:20.489 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:07.942945+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:20.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 -- 172.21.15.82:0/2102505805 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f63d406be30 msgr2=0x7f63d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f63d406be30 0x7f63d406e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f63e4034000 tx=0x7f63e402c000 comp rx=0 tx=0).stop 2024-06-02T22:52:20.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 -- 172.21.15.82:0/2102505805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f40cc6d0 msgr2=0x7f63f409c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f40cc6d0 0x7f63f409c950 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00efc0 tx=0x7f63ec009f90 comp rx=0 tx=0).stop 2024-06-02T22:52:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 -- 172.21.15.82:0/2102505805 shutdown_connections 2024-06-02T22:52:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f63d406be30 0x7f63d406e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63f40cc6d0 0x7f63f409c950 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63f40720e0 0x7f63f40d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 --2- 172.21.15.82:0/2102505805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63f4071c60 0x7f63f4150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 -- 172.21.15.82:0/2102505805 >> 172.21.15.82:0/2102505805 conn(0x7f63f40b19f0 msgr2=0x7f63f40b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 -- 172.21.15.82:0/2102505805 shutdown_connections 2024-06-02T22:52:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.491+0000 7f63f89f9640 1 -- 172.21.15.82:0/2102505805 wait complete. 2024-06-02T22:52:20.507 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-02T22:52:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.610+0000 7fa2a19fb640 1 Processor -- start 2024-06-02T22:52:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.610+0000 7fa2a19fb640 1 -- start start 2024-06-02T22:52:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa2a19fb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa29c15c2c0 0x7fa29c06b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa2a19fb640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa29c072950 0x7fa29c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa2a19fb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa29c06b900 0x7fa29c0b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa2a19fb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa29c0b4ad0 con 0x7fa29c06b900 2024-06-02T22:52:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa2a19fb640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fa29c0ce900 con 0x7fa29c072950 2024-06-02T22:52:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa2a19fb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa29c0cebe0 con 0x7fa29c15c2c0 2024-06-02T22:52:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa29b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa29c06b900 0x7fa29c0b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa29b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa29c06b900 0x7fa29c0b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54950/0 (socket says 172.21.15.82:54950) 2024-06-02T22:52:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa29b7fe640 1 -- 172.21.15.82:0/3095041705 learned_addr learned my addr 172.21.15.82:0/3095041705 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa29affd640 1 --2- 172.21.15.82:0/3095041705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa29c15c2c0 0x7fa29c06b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa29a7fc640 1 --2- 172.21.15.82:0/3095041705 >> v2:172.21.15.184:3300/0 conn(0x7fa29c072950 0x7fa29c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa29b7fe640 1 -- 172.21.15.82:0/3095041705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa29c15c2c0 msgr2=0x7fa29c06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa29b7fe640 1 --2- 172.21.15.82:0/3095041705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa29c15c2c0 0x7fa29c06b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa29b7fe640 1 -- 172.21.15.82:0/3095041705 >> v2:172.21.15.184:3300/0 conn(0x7fa29c072950 msgr2=0x7fa29c0b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa29b7fe640 1 --2- 172.21.15.82:0/3095041705 >> v2:172.21.15.184:3300/0 conn(0x7fa29c072950 0x7fa29c0b4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.611+0000 7fa29b7fe640 1 -- 172.21.15.82:0/3095041705 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29c0b4760 con 0x7fa29c06b900 2024-06-02T22:52:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.612+0000 7fa29b7fe640 1 --2- 172.21.15.82:0/3095041705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c06b900 0x7fa29c0b54a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa29c06d070 tx=0x7fa29402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71414015a0a94321 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.612+0000 7fa299ffb640 1 -- 172.21.15.82:0/3095041705 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294036070 con 0x7fa29c06b900 2024-06-02T22:52:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.612+0000 7fa299ffb640 1 -- 172.21.15.82:0/3095041705 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa294031600 con 0x7fa29c06b900 2024-06-02T22:52:20.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.612+0000 7fa299ffb640 1 -- 172.21.15.82:0/3095041705 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2940319d0 con 0x7fa29c06b900 2024-06-02T22:52:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.613+0000 7fa2a19fb640 1 -- 172.21.15.82:0/3095041705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c06b900 msgr2=0x7fa29c0b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.613+0000 7fa2a19fb640 1 --2- 172.21.15.82:0/3095041705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c06b900 0x7fa29c0b54a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa29c06d070 tx=0x7fa29402a610 comp rx=0 tx=0).stop 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.613+0000 7fa2a19fb640 1 -- 172.21.15.82:0/3095041705 shutdown_connections 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.613+0000 7fa2a19fb640 1 --2- 172.21.15.82:0/3095041705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c06b900 0x7fa29c0b54a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.613+0000 7fa2a19fb640 1 --2- 172.21.15.82:0/3095041705 >> v2:172.21.15.184:3300/0 conn(0x7fa29c072950 0x7fa29c0b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.613+0000 7fa2a19fb640 1 --2- 172.21.15.82:0/3095041705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa29c15c2c0 0x7fa29c06b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.613+0000 7fa2a19fb640 1 -- 172.21.15.82:0/3095041705 >> 172.21.15.82:0/3095041705 conn(0x7fa29c0b22b0 msgr2=0x7fa29c0b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.613+0000 7fa2a19fb640 1 -- 172.21.15.82:0/3095041705 shutdown_connections 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.613+0000 7fa2a19fb640 1 -- 172.21.15.82:0/3095041705 wait complete. 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.614+0000 7fa2a19fb640 1 Processor -- start 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.614+0000 7fa2a19fb640 1 -- start start 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa2a19fb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa29c06b900 0x7fa29c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa2a19fb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa29c072950 0x7fa29c158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa2a19fb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c15c2c0 0x7fa29c144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa2a19fb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c0ce580 con 0x7fa29c15c2c0 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa2a19fb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c0ce400 con 0x7fa29c072950 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa2a19fb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa29c0afb10 con 0x7fa29c06b900 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa29b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c15c2c0 0x7fa29c144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa29b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c15c2c0 0x7fa29c144e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54962/0 (socket says 172.21.15.82:54962) 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa29b7fe640 1 -- 172.21.15.82:0/1436124117 learned_addr learned my addr 172.21.15.82:0/1436124117 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa29affd640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa29c06b900 0x7fa29c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa29b7fe640 1 -- 172.21.15.82:0/1436124117 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa29c06b900 msgr2=0x7fa29c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa29b7fe640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa29c06b900 0x7fa29c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa29b7fe640 1 -- 172.21.15.82:0/1436124117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa29c072950 msgr2=0x7fa29c158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa29b7fe640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa29c072950 0x7fa29c158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa29b7fe640 1 -- 172.21.15.82:0/1436124117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29c151f10 con 0x7fa29c15c2c0 2024-06-02T22:52:20.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.615+0000 7fa29b7fe640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c15c2c0 0x7fa29c144e00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa294009f40 tx=0x7fa294004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:20.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.616+0000 7fa283fff640 1 -- 172.21.15.82:0/1436124117 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294036050 con 0x7fa29c15c2c0 2024-06-02T22:52:20.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.616+0000 7fa283fff640 1 -- 172.21.15.82:0/1436124117 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa294042070 con 0x7fa29c15c2c0 2024-06-02T22:52:20.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.616+0000 7fa2a19fb640 1 -- 172.21.15.82:0/1436124117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29c1563b0 con 0x7fa29c15c2c0 2024-06-02T22:52:20.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.616+0000 7fa283fff640 1 -- 172.21.15.82:0/1436124117 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294009510 con 0x7fa29c15c2c0 2024-06-02T22:52:20.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.616+0000 7fa2a19fb640 1 -- 172.21.15.82:0/1436124117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29c158b60 con 0x7fa29c15c2c0 2024-06-02T22:52:20.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.617+0000 7fa2a19fb640 1 -- 172.21.15.82:0/1436124117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa29c0683c0 con 0x7fa29c15c2c0 2024-06-02T22:52:20.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.617+0000 7fa283fff640 1 -- 172.21.15.82:0/1436124117 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa294007bd0 con 0x7fa29c15c2c0 2024-06-02T22:52:20.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.618+0000 7fa283fff640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa28806be30 0x7fa28806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:20.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.618+0000 7fa283fff640 1 -- 172.21.15.82:0/1436124117 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa2940abfd0 con 0x7fa29c15c2c0 2024-06-02T22:52:20.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.618+0000 7fa29affd640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa28806be30 0x7fa28806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:20.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.618+0000 7fa29affd640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa28806be30 0x7fa28806e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa28c006fd0 tx=0x7fa28c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:20.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.622+0000 7fa283fff640 1 -- 172.21.15.82:0/1436124117 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa29407a6d0 con 0x7fa29c15c2c0 2024-06-02T22:52:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:20.832+0000 7fa2a19fb640 1 -- 172.21.15.82:0/1436124117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa29c0675e0 con 0x7fa29c15c2c0 2024-06-02T22:52:21.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.639+0000 7fa283fff640 1 -- 172.21.15.82:0/1436124117 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fa294079fd0 con 0x7fa29c15c2c0 2024-06-02T22:52:21.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 -- 172.21.15.82:0/1436124117 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa28806be30 msgr2=0x7fa28806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:21.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa28806be30 0x7fa28806e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa28c006fd0 tx=0x7fa28c008040 comp rx=0 tx=0).stop 2024-06-02T22:52:21.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 -- 172.21.15.82:0/1436124117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c15c2c0 msgr2=0x7fa29c144e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:21.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c15c2c0 0x7fa29c144e00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa294009f40 tx=0x7fa294004a40 comp rx=0 tx=0).stop 2024-06-02T22:52:21.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 -- 172.21.15.82:0/1436124117 shutdown_connections 2024-06-02T22:52:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa28806be30 0x7fa28806e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c15c2c0 0x7fa29c144e00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa29c072950 0x7fa29c158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 --2- 172.21.15.82:0/1436124117 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa29c06b900 0x7fa29c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 -- 172.21.15.82:0/1436124117 >> 172.21.15.82:0/1436124117 conn(0x7fa29c0b22b0 msgr2=0x7fa29c0b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 -- 172.21.15.82:0/1436124117 shutdown_connections 2024-06-02T22:52:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.642+0000 7fa2a19fb640 1 -- 172.21.15.82:0/1436124117 wait complete. 2024-06-02T22:52:21.656 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-06-02T22:52:21.656 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-02T22:52:21.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.764+0000 7fe10f7ee640 1 Processor -- start 2024-06-02T22:52:21.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.764+0000 7fe10f7ee640 1 -- start start 2024-06-02T22:52:21.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.765+0000 7fe10f7ee640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe1080b4c60 0x7fe108162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:21.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.765+0000 7fe10f7ee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe108162da0 0x7fe1080acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.765+0000 7fe10f7ee640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe108163380 con 0x7fe108162480 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.765+0000 7fe10f7ee640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fe108163660 con 0x7fe1080b4c60 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.765+0000 7fe10f7ee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe108163940 con 0x7fe108162da0 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.765+0000 7fe10d58a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe108162480 0x7fe10806d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48054/0 (socket says 172.21.15.82:48054) 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.765+0000 7fe10d58a640 1 -- 172.21.15.82:0/3007641666 learned_addr learned my addr 172.21.15.82:0/3007641666 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.765+0000 7fe10dd8b640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe108162da0 0x7fe1080acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.765+0000 7fe10cd89640 1 --2- 172.21.15.82:0/3007641666 >> v2:172.21.15.184:3300/0 conn(0x7fe1080b4c60 0x7fe108162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.765+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2771176204 0 0) 0x7fe108163380 con 0x7fe108162480 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.765+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0f4003520 con 0x7fe108162480 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 913907696 0 0) 0x7fe0f4003520 con 0x7fe108162480 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe108162da0 msgr2=0x7fe1080acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe108162da0 0x7fe1080acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:21.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 >> v2:172.21.15.184:3300/0 conn(0x7fe1080b4c60 msgr2=0x7fe108162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 --2- 172.21.15.82:0/3007641666 >> v2:172.21.15.184:3300/0 conn(0x7fe1080b4c60 0x7fe108162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10806cd90 con 0x7fe108162480 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fe104001670 con 0x7fe108162480 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe10dd8b640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe108162da0 0x7fe1080acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 >> v1:172.21.15.82:6789/0 conn(0x7fe108162480 legacy=0x7fe10806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe108162da0 0x7fe0f40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4003ef0 0x7fe0f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0f4004d40 0x7fe0f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe108163660 con 0x7fe0f4003ef0 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe108163940 con 0x7fe0f4004d40 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f400ba70 con 0x7fe108162da0 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe10cd89640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4003ef0 0x7fe0f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe10d58a640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe108162da0 0x7fe0f40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:21.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe10dd8b640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0f4004d40 0x7fe0f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe10cd89640 1 -- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe108162da0 msgr2=0x7fe0f40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe10cd89640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe108162da0 0x7fe0f40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe10cd89640 1 -- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0f4004d40 msgr2=0x7fe0f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe10cd89640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0f4004d40 0x7fe0f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.766+0000 7fe10cd89640 1 -- 172.21.15.82:0/3007641666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f4003520 con 0x7fe0f4003ef0 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.767+0000 7fe10cd89640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4003ef0 0x7fe0f4004800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009ac0 tx=0x7fe0f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f5659a35f0db25 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.767+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8036070 con 0x7fe0f4003ef0 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.767+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f8031400 con 0x7fe0f4003ef0 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.767+0000 7fe0fffff640 1 -- 172.21.15.82:0/3007641666 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8009690 con 0x7fe0f4003ef0 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.767+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3007641666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4003ef0 msgr2=0x7fe0f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.767+0000 7fe10f7ee640 1 --2- 172.21.15.82:0/3007641666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4003ef0 0x7fe0f4004800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009ac0 tx=0x7fe0f4005830 comp rx=0 tx=0).stop 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.767+0000 7fe10dd8b640 1 -- 172.21.15.82:0/3007641666 reap_dead start 2024-06-02T22:52:21.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.767+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3007641666 shutdown_connections 2024-06-02T22:52:21.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.767+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3007641666 >> 172.21.15.82:0/3007641666 conn(0x7fe1080b1d10 msgr2=0x7fe1080b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:21.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.768+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3007641666 shutdown_connections 2024-06-02T22:52:21.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.768+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3007641666 wait complete. 2024-06-02T22:52:21.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.769+0000 7fe10f7ee640 1 Processor -- start 2024-06-02T22:52:21.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.769+0000 7fe10f7ee640 1 -- start start 2024-06-02T22:52:21.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.769+0000 7fe10f7ee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0f4003ef0 0x7fe108158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:21.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.769+0000 7fe10f7ee640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe108149910 0x7fe108149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.769+0000 7fe10f7ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe10815a810 0x7fe10815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.769+0000 7fe10f7ee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe1080acec0 con 0x7fe10815a810 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.769+0000 7fe10f7ee640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe1080acd40 con 0x7fe108149910 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.769+0000 7fe10f7ee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe1080ad040 con 0x7fe0f4003ef0 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10dd8b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe10815a810 0x7fe10815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10dd8b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe10815a810 0x7fe10815ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34230/0 (socket says 172.21.15.82:34230) 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10dd8b640 1 -- 172.21.15.82:0/3565068867 learned_addr learned my addr 172.21.15.82:0/3565068867 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10cd89640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe108149910 0x7fe108149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10d58a640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0f4003ef0 0x7fe108158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10dd8b640 1 -- 172.21.15.82:0/3565068867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0f4003ef0 msgr2=0x7fe108158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10dd8b640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0f4003ef0 0x7fe108158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10dd8b640 1 -- 172.21.15.82:0/3565068867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe108149910 msgr2=0x7fe108149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:21.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10dd8b640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe108149910 0x7fe108149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10dd8b640 1 -- 172.21.15.82:0/3565068867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe108155380 con 0x7fe10815a810 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10dd8b640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe10815a810 0x7fe10815ac90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe108167130 tx=0x7fe100009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe0fdffb640 1 -- 172.21.15.82:0/3565068867 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10000fb10 con 0x7fe10815a810 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe0fdffb640 1 -- 172.21.15.82:0/3565068867 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10000fcf0 con 0x7fe10815a810 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3565068867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe108155660 con 0x7fe10815a810 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe0fdffb640 1 -- 172.21.15.82:0/3565068867 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10000fea0 con 0x7fe10815a810 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.770+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3565068867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe108155c20 con 0x7fe10815a810 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.771+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3565068867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1080683c0 con 0x7fe10815a810 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.772+0000 7fe0fdffb640 1 -- 172.21.15.82:0/3565068867 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe10001f020 con 0x7fe10815a810 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.772+0000 7fe0fdffb640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe0ec06be60 0x7fe0ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.773+0000 7fe10d58a640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe0ec06be60 0x7fe0ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.773+0000 7fe0fdffb640 1 -- 172.21.15.82:0/3565068867 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe10008b1f0 con 0x7fe10815a810 2024-06-02T22:52:21.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.773+0000 7fe10d58a640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe0ec06be60 0x7fe0ec06e320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1040011e0 tx=0x7fe1040078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:21.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.777+0000 7fe0fdffb640 1 -- 172.21.15.82:0/3565068867 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe100010040 con 0x7fe10815a810 2024-06-02T22:52:21.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:21.988+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3565068867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe108155df0 con 0x7fe10815a810 2024-06-02T22:52:22.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.647+0000 7fe0fdffb640 1 -- 172.21.15.82:0/3565068867 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fe100059210 con 0x7fe10815a810 2024-06-02T22:52:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3565068867 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe0ec06be60 msgr2=0x7fe0ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe0ec06be60 0x7fe0ec06e320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1040011e0 tx=0x7fe1040078f0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3565068867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe10815a810 msgr2=0x7fe10815ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe10815a810 0x7fe10815ac90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe108167130 tx=0x7fe100009f90 comp rx=0 tx=0).stop 2024-06-02T22:52:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3565068867 shutdown_connections 2024-06-02T22:52:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe0ec06be60 0x7fe0ec06e320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe10815a810 0x7fe10815ac90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe108149910 0x7fe108149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 --2- 172.21.15.82:0/3565068867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0f4003ef0 0x7fe108158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3565068867 >> 172.21.15.82:0/3565068867 conn(0x7fe1080b1d10 msgr2=0x7fe1080cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:22.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3565068867 shutdown_connections 2024-06-02T22:52:22.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.650+0000 7fe10f7ee640 1 -- 172.21.15.82:0/3565068867 wait complete. 2024-06-02T22:52:22.661 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-02T22:52:22.662 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:52:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.763+0000 7f5a0bde7640 1 Processor -- start 2024-06-02T22:52:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.763+0000 7f5a0bde7640 1 -- start start 2024-06-02T22:52:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.764+0000 7f5a0bde7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040ae910 0x7f5a0406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.764+0000 7f5a0bde7640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5a040cf360 0x7f5a040acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.764+0000 7f5a0bde7640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a0406d130 con 0x7f5a0406ea20 2024-06-02T22:52:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.764+0000 7f5a0bde7640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f5a0406ee60 con 0x7f5a040cf360 2024-06-02T22:52:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.764+0000 7f5a0bde7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0406d410 con 0x7f5a040ae910 2024-06-02T22:52:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.765+0000 7f5a0a384640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5a040cf360 0x7f5a040acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.765+0000 7f5a09b83640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040ae910 0x7f5a0406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.765+0000 7f5a0a384640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5a040cf360 0x7f5a040acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45378/0 (socket says 172.21.15.82:45378) 2024-06-02T22:52:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.765+0000 7f5a09382640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f5a0406ea20 0x7f5a040cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:35396/0 (socket says 172.21.15.82:35396) 2024-06-02T22:52:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.765+0000 7f5a09b83640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040ae910 0x7f5a0406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42404/0 (socket says 172.21.15.82:42404) 2024-06-02T22:52:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.765+0000 7f5a0a384640 1 -- 172.21.15.82:0/1041728017 learned_addr learned my addr 172.21.15.82:0/1041728017 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.765+0000 7f5a09b83640 1 -- 172.21.15.82:0/1041728017 >> v2:172.21.15.184:3300/0 conn(0x7f5a040cf360 msgr2=0x7f5a040acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.765+0000 7f5a09b83640 1 --2- 172.21.15.82:0/1041728017 >> v2:172.21.15.184:3300/0 conn(0x7f5a040cf360 0x7f5a040acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.765+0000 7f5a09b83640 1 -- 172.21.15.82:0/1041728017 >> v1:172.21.15.184:6789/0 conn(0x7f5a0406ea20 legacy=0x7f5a040cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.765+0000 7f5a09b83640 1 -- 172.21.15.82:0/1041728017 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0406d6f0 con 0x7f5a040ae910 2024-06-02T22:52:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.765+0000 7f5a0a384640 1 --2- 172.21.15.82:0/1041728017 >> v2:172.21.15.184:3300/0 conn(0x7f5a040cf360 0x7f5a040acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.766+0000 7f5a09b83640 1 --2- 172.21.15.82:0/1041728017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040ae910 0x7f5a0406e4e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000ba70 tx=0x7f5a0002c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=759f9ea9ae569c0a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.766+0000 7f5a08b81640 1 -- 172.21.15.82:0/1041728017 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00031710 con 0x7f5a040ae910 2024-06-02T22:52:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.766+0000 7f5a08b81640 1 -- 172.21.15.82:0/1041728017 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a000318b0 con 0x7f5a040ae910 2024-06-02T22:52:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.766+0000 7f5a08b81640 1 -- 172.21.15.82:0/1041728017 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00031c80 con 0x7f5a040ae910 2024-06-02T22:52:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.766+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1041728017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040ae910 msgr2=0x7f5a0406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.766+0000 7f5a0bde7640 1 --2- 172.21.15.82:0/1041728017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040ae910 0x7f5a0406e4e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000ba70 tx=0x7f5a0002c7e0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.766+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1041728017 shutdown_connections 2024-06-02T22:52:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.766+0000 7f5a0bde7640 1 --2- 172.21.15.82:0/1041728017 >> v2:172.21.15.184:3300/0 conn(0x7f5a040cf360 0x7f5a040acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.766+0000 7f5a0bde7640 1 --2- 172.21.15.82:0/1041728017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040ae910 0x7f5a0406e4e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.766+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1041728017 >> 172.21.15.82:0/1041728017 conn(0x7f5a040b19f0 msgr2=0x7f5a040b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.766+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1041728017 shutdown_connections 2024-06-02T22:52:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.767+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1041728017 wait complete. 2024-06-02T22:52:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.768+0000 7f5a0bde7640 1 Processor -- start 2024-06-02T22:52:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.768+0000 7f5a0bde7640 1 -- start start 2024-06-02T22:52:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.768+0000 7f5a0bde7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a0406ea20 0x7f5a04152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.768+0000 7f5a0bde7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a040ae910 0x7f5a040caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.768+0000 7f5a0bde7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040cf360 0x7f5a040cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.768+0000 7f5a0bde7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a040ad280 con 0x7f5a0406ea20 2024-06-02T22:52:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.768+0000 7f5a0bde7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5a040aecf0 con 0x7f5a040ae910 2024-06-02T22:52:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.768+0000 7f5a0bde7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5a040ad400 con 0x7f5a040cf360 2024-06-02T22:52:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a09b83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a0406ea20 0x7f5a04152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a09b83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a0406ea20 0x7f5a04152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34232/0 (socket says 172.21.15.82:34232) 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a09b83640 1 -- 172.21.15.82:0/1192591802 learned_addr learned my addr 172.21.15.82:0/1192591802 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a0a384640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040cf360 0x7f5a040cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a09382640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a040ae910 0x7f5a040caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a09b83640 1 -- 172.21.15.82:0/1192591802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040cf360 msgr2=0x7f5a040cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a09b83640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040cf360 0x7f5a040cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a09b83640 1 -- 172.21.15.82:0/1192591802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a040ae910 msgr2=0x7f5a040caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a09b83640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a040ae910 0x7f5a040caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a09b83640 1 -- 172.21.15.82:0/1192591802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a04153220 con 0x7f5a0406ea20 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a09382640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a040ae910 0x7f5a040caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a09b83640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a0406ea20 0x7f5a04152ce0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5a0002cdd0 tx=0x7f5a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f59fa7fc640 1 -- 172.21.15.82:0/1192591802 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00041070 con 0x7f5a0406ea20 2024-06-02T22:52:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f59fa7fc640 1 -- 172.21.15.82:0/1192591802 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a00033c40 con 0x7f5a0406ea20 2024-06-02T22:52:22.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1192591802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0414f350 con 0x7f5a0406ea20 2024-06-02T22:52:22.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f59fa7fc640 1 -- 172.21.15.82:0/1192591802 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0003c430 con 0x7f5a0406ea20 2024-06-02T22:52:22.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.769+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1192591802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a0414f910 con 0x7f5a0406ea20 2024-06-02T22:52:22.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.770+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1192591802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a04068430 con 0x7f5a0406ea20 2024-06-02T22:52:22.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.771+0000 7f59fa7fc640 1 -- 172.21.15.82:0/1192591802 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a00044070 con 0x7f5a0406ea20 2024-06-02T22:52:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.771+0000 7f59fa7fc640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f59e806be30 0x7f59e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.771+0000 7f59fa7fc640 1 -- 172.21.15.82:0/1192591802 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5a000abc40 con 0x7f5a0406ea20 2024-06-02T22:52:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.771+0000 7f5a09382640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f59e806be30 0x7f59e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.772+0000 7f5a09382640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f59e806be30 0x7f59e806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f59f4007fd0 tx=0x7f59f4007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.775+0000 7f59fa7fc640 1 -- 172.21.15.82:0/1192591802 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5a00079e10 con 0x7f5a0406ea20 2024-06-02T22:52:22.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.986+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1192591802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a04075430 con 0x7f5a0406ea20 2024-06-02T22:52:22.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.986+0000 7f59fa7fc640 1 -- 172.21.15.82:0/1192591802 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f5a0007e110 con 0x7f5a0406ea20 2024-06-02T22:52:22.986 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:22.986 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/598338197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":598338197},{"type":"v1","addr":"172.21.15.184:6835","nonce":598338197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2379089503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2379089503},{"type":"v1","addr":"172.21.15.82:6836","nonce":2379089503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:02.905481+0000","modified":"2024-06-02T22:52:21.989508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1449064574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1449064574},{"type":"v1","addr":"172.21.15.82:6837","nonce":1449064574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-06-02T22:52:22.987 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-06-02T22:52:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.988+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1192591802 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f59e806be30 msgr2=0x7f59e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.988+0000 7f5a0bde7640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f59e806be30 0x7f59e806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f59f4007fd0 tx=0x7f59f4007d60 comp rx=0 tx=0).stop 2024-06-02T22:52:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.988+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1192591802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a0406ea20 msgr2=0x7f5a04152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.988+0000 7f5a0bde7640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a0406ea20 0x7f5a04152ce0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5a0002cdd0 tx=0x7f5a000046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.988+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1192591802 shutdown_connections 2024-06-02T22:52:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.988+0000 7f5a0bde7640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f59e806be30 0x7f59e806e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.988+0000 7f5a0bde7640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a040cf360 0x7f5a040cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.988+0000 7f5a0bde7640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a040ae910 0x7f5a040caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.988+0000 7f5a0bde7640 1 --2- 172.21.15.82:0/1192591802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a0406ea20 0x7f5a04152ce0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.988+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1192591802 >> 172.21.15.82:0/1192591802 conn(0x7f5a040b19f0 msgr2=0x7f5a04071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:22.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.989+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1192591802 shutdown_connections 2024-06-02T22:52:22.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:22.989+0000 7f5a0bde7640 1 -- 172.21.15.82:0/1192591802 wait complete. 2024-06-02T22:52:22.999 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:23.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.098+0000 7fe59ce53640 1 Processor -- start 2024-06-02T22:52:23.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.098+0000 7fe59ce53640 1 -- start start 2024-06-02T22:52:23.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe59ce53640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe59806ebf0 0x7fe5980cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe59ce53640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5980cf190 0x7fe5980acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe59ce53640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5980cf620 con 0x7fe5980ae910 2024-06-02T22:52:23.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe59ce53640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe59806d130 con 0x7fe59806ebf0 2024-06-02T22:52:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe59ce53640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe59806d410 con 0x7fe5980cf190 2024-06-02T22:52:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe595d9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe59806ebf0 0x7fe5980cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe59659c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe5980ae910 0x7fe59806e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48058/0 (socket says 172.21.15.82:48058) 2024-06-02T22:52:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe595d9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe59806ebf0 0x7fe5980cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34248/0 (socket says 172.21.15.82:34248) 2024-06-02T22:52:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe59659c640 1 -- 172.21.15.82:0/3010080866 learned_addr learned my addr 172.21.15.82:0/3010080866 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe596d9d640 1 --2- 172.21.15.82:0/3010080866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5980cf190 0x7fe5980acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe595d9b640 1 -- 172.21.15.82:0/3010080866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5980cf190 msgr2=0x7fe5980acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe595d9b640 1 --2- 172.21.15.82:0/3010080866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5980cf190 0x7fe5980acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe595d9b640 1 -- 172.21.15.82:0/3010080866 >> v1:172.21.15.82:6789/0 conn(0x7fe5980ae910 legacy=0x7fe59806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.099+0000 7fe59559a640 1 -- 172.21.15.82:0/3010080866 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780631154 0 0) 0x7fe5980cf620 con 0x7fe5980ae910 2024-06-02T22:52:23.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.100+0000 7fe595d9b640 1 -- 172.21.15.82:0/3010080866 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59806d6f0 con 0x7fe59806ebf0 2024-06-02T22:52:23.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.100+0000 7fe595d9b640 1 --2- 172.21.15.82:0/3010080866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe59806ebf0 0x7fe5980cec50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0097a0 tx=0x7fe58c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a58f01c409b576 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.100+0000 7fe59559a640 1 -- 172.21.15.82:0/3010080866 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c037070 con 0x7fe59806ebf0 2024-06-02T22:52:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.100+0000 7fe59559a640 1 -- 172.21.15.82:0/3010080866 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c02ae50 con 0x7fe59806ebf0 2024-06-02T22:52:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.100+0000 7fe59559a640 1 -- 172.21.15.82:0/3010080866 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c032660 con 0x7fe59806ebf0 2024-06-02T22:52:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.101+0000 7fe59ce53640 1 -- 172.21.15.82:0/3010080866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe59806ebf0 msgr2=0x7fe5980cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.101+0000 7fe59ce53640 1 --2- 172.21.15.82:0/3010080866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe59806ebf0 0x7fe5980cec50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0097a0 tx=0x7fe58c02a100 comp rx=0 tx=0).stop 2024-06-02T22:52:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.101+0000 7fe59ce53640 1 -- 172.21.15.82:0/3010080866 shutdown_connections 2024-06-02T22:52:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.101+0000 7fe59ce53640 1 --2- 172.21.15.82:0/3010080866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5980cf190 0x7fe5980acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.101+0000 7fe59ce53640 1 --2- 172.21.15.82:0/3010080866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe59806ebf0 0x7fe5980cec50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.101+0000 7fe59ce53640 1 -- 172.21.15.82:0/3010080866 >> 172.21.15.82:0/3010080866 conn(0x7fe5980b19f0 msgr2=0x7fe5980b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.101+0000 7fe59ce53640 1 -- 172.21.15.82:0/3010080866 shutdown_connections 2024-06-02T22:52:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.101+0000 7fe59ce53640 1 -- 172.21.15.82:0/3010080866 wait complete. 2024-06-02T22:52:23.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.102+0000 7fe59ce53640 1 Processor -- start 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.102+0000 7fe59ce53640 1 -- start start 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59ce53640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe59806ebf0 0x7fe59809bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59ce53640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5980ae910 0x7fe59815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59ce53640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5980cf190 0x7fe598154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59ce53640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980ad280 con 0x7fe59806ebf0 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59ce53640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980aecf0 con 0x7fe5980cf190 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59ce53640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe5980ad400 con 0x7fe5980ae910 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe59806ebf0 0x7fe59809bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe59806ebf0 0x7fe59809bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34252/0 (socket says 172.21.15.82:34252) 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59659c640 1 -- 172.21.15.82:0/687664369 learned_addr learned my addr 172.21.15.82:0/687664369 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe595d9b640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5980ae910 0x7fe59815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe596d9d640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5980cf190 0x7fe598154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59659c640 1 -- 172.21.15.82:0/687664369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5980ae910 msgr2=0x7fe59815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59659c640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5980ae910 0x7fe59815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59659c640 1 -- 172.21.15.82:0/687664369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5980cf190 msgr2=0x7fe598154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59659c640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5980cf190 0x7fe598154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.103+0000 7fe59659c640 1 -- 172.21.15.82:0/687664369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5981f1db0 con 0x7fe59806ebf0 2024-06-02T22:52:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.104+0000 7fe59659c640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe59806ebf0 0x7fe59809bf60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c4d0 tx=0x7fe58800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.104+0000 7fe586ffd640 1 -- 172.21.15.82:0/687664369 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588018070 con 0x7fe59806ebf0 2024-06-02T22:52:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.104+0000 7fe586ffd640 1 -- 172.21.15.82:0/687664369 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe588007500 con 0x7fe59806ebf0 2024-06-02T22:52:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.104+0000 7fe59ce53640 1 -- 172.21.15.82:0/687664369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe59815ba00 con 0x7fe59806ebf0 2024-06-02T22:52:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.104+0000 7fe586ffd640 1 -- 172.21.15.82:0/687664369 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588004a20 con 0x7fe59806ebf0 2024-06-02T22:52:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.104+0000 7fe59ce53640 1 -- 172.21.15.82:0/687664369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe59815c270 con 0x7fe59806ebf0 2024-06-02T22:52:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.105+0000 7fe59ce53640 1 -- 172.21.15.82:0/687664369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe598068430 con 0x7fe59806ebf0 2024-06-02T22:52:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.106+0000 7fe586ffd640 1 -- 172.21.15.82:0/687664369 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe58801b070 con 0x7fe59806ebf0 2024-06-02T22:52:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.106+0000 7fe586ffd640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe57806be60 0x7fe57806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.106+0000 7fe586ffd640 1 -- 172.21.15.82:0/687664369 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe58808a3b0 con 0x7fe59806ebf0 2024-06-02T22:52:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.106+0000 7fe595d9b640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe57806be60 0x7fe57806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.106+0000 7fe595d9b640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe57806be60 0x7fe57806e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe58c034000 tx=0x7fe58c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:23.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.110+0000 7fe586ffd640 1 -- 172.21.15.82:0/687664369 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe5981f1db0 con 0x7fe59806ebf0 2024-06-02T22:52:23.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.284+0000 7fe59ce53640 1 -- 172.21.15.82:0/687664369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5980cdf50 con 0x7fe59806ebf0 2024-06-02T22:52:23.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.285+0000 7fe586ffd640 1 -- 172.21.15.82:0/687664369 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7fe588058ab0 con 0x7fe59806ebf0 2024-06-02T22:52:23.285 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:23.285 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:07.942945+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:23.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 -- 172.21.15.82:0/687664369 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe57806be60 msgr2=0x7fe57806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe57806be60 0x7fe57806e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe58c034000 tx=0x7fe58c02e000 comp rx=0 tx=0).stop 2024-06-02T22:52:23.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 -- 172.21.15.82:0/687664369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe59806ebf0 msgr2=0x7fe59809bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe59806ebf0 0x7fe59809bf60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c4d0 tx=0x7fe58800c990 comp rx=0 tx=0).stop 2024-06-02T22:52:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 -- 172.21.15.82:0/687664369 shutdown_connections 2024-06-02T22:52:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe57806be60 0x7fe57806e320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5980cf190 0x7fe598154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5980ae910 0x7fe59815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 --2- 172.21.15.82:0/687664369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe59806ebf0 0x7fe59809bf60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 -- 172.21.15.82:0/687664369 >> 172.21.15.82:0/687664369 conn(0x7fe5980b19f0 msgr2=0x7fe5980710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 -- 172.21.15.82:0/687664369 shutdown_connections 2024-06-02T22:52:23.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.287+0000 7fe59ce53640 1 -- 172.21.15.82:0/687664369 wait complete. 2024-06-02T22:52:23.299 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T22:52:23.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:52:23.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.399+0000 7f2964293640 1 Processor -- start 2024-06-02T22:52:23.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.400+0000 7f2964293640 1 -- start start 2024-06-02T22:52:23.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.401+0000 7f2964293640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f295c06ebf0 0x7f295c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.401+0000 7f2964293640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c0cf640 con 0x7f295c0cf190 2024-06-02T22:52:23.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.401+0000 7f2964293640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c06d130 con 0x7f295c0ae910 2024-06-02T22:52:23.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.401+0000 7f2964293640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f295c06d410 con 0x7f295c06ebf0 2024-06-02T22:52:23.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.401+0000 7f2962830640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f295c0cf190 0x7f295c0acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48060/0 (socket says 172.21.15.82:48060) 2024-06-02T22:52:23.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.401+0000 7f2962830640 1 -- 172.21.15.82:0/2477886789 learned_addr learned my addr 172.21.15.82:0/2477886789 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:23.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.401+0000 7f296182e640 1 --2- 172.21.15.82:0/2477886789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f295c06ebf0 0x7f295c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.401+0000 7f296102d640 1 -- 172.21.15.82:0/2477886789 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2885829570 0 0) 0x7f295c0cf640 con 0x7f295c0cf190 2024-06-02T22:52:23.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.401+0000 7f296102d640 1 -- 172.21.15.82:0/2477886789 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2948003520 con 0x7f295c0cf190 2024-06-02T22:52:23.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.402+0000 7f296182e640 1 -- 172.21.15.82:0/2477886789 >> v1:172.21.15.184:6789/0 conn(0x7f295c0ae910 legacy=0x7f295c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.402+0000 7f296102d640 1 -- 172.21.15.82:0/2477886789 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309987324 0 0) 0x7f295c06d130 con 0x7f295c0ae910 2024-06-02T22:52:23.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.402+0000 7f296182e640 1 -- 172.21.15.82:0/2477886789 >> v1:172.21.15.82:6789/0 conn(0x7f295c0cf190 legacy=0x7f295c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.402+0000 7f296182e640 1 -- 172.21.15.82:0/2477886789 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c06d6f0 con 0x7f295c06ebf0 2024-06-02T22:52:23.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.402+0000 7f296182e640 1 --2- 172.21.15.82:0/2477886789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f295c06ebf0 0x7f295c0cec50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f294c009800 tx=0x7f294c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19fc7ff53877f9c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:23.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.403+0000 7f296102d640 1 -- 172.21.15.82:0/2477886789 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c037070 con 0x7f295c06ebf0 2024-06-02T22:52:23.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.403+0000 7f296102d640 1 -- 172.21.15.82:0/2477886789 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294c032440 con 0x7f295c06ebf0 2024-06-02T22:52:23.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.403+0000 7f296102d640 1 -- 172.21.15.82:0/2477886789 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c032810 con 0x7f295c06ebf0 2024-06-02T22:52:23.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.403+0000 7f2964293640 1 -- 172.21.15.82:0/2477886789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f295c06ebf0 msgr2=0x7f295c0cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.403+0000 7f2964293640 1 --2- 172.21.15.82:0/2477886789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f295c06ebf0 0x7f295c0cec50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f294c009800 tx=0x7f294c02a1a0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.403+0000 7f2964293640 1 -- 172.21.15.82:0/2477886789 shutdown_connections 2024-06-02T22:52:23.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.403+0000 7f2964293640 1 --2- 172.21.15.82:0/2477886789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f295c06ebf0 0x7f295c0cec50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.403+0000 7f2964293640 1 -- 172.21.15.82:0/2477886789 >> 172.21.15.82:0/2477886789 conn(0x7f295c0b19f0 msgr2=0x7f295c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:23.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.403+0000 7f2964293640 1 -- 172.21.15.82:0/2477886789 shutdown_connections 2024-06-02T22:52:23.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.403+0000 7f2964293640 1 -- 172.21.15.82:0/2477886789 wait complete. 2024-06-02T22:52:23.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.404+0000 7f2964293640 1 Processor -- start 2024-06-02T22:52:23.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.405+0000 7f2964293640 1 -- start start 2024-06-02T22:52:23.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.405+0000 7f2964293640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f295c06ebf0 0x7f295c15ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.405+0000 7f2964293640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f295c0ae910 0x7f295c14e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.405+0000 7f2964293640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295c0cf190 0x7f295c15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.405+0000 7f2964293640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f295c0ad450 con 0x7f295c0cf190 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.405+0000 7f2964293640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f295c0aecf0 con 0x7f295c06ebf0 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.405+0000 7f2964293640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f295c0ad5d0 con 0x7f295c0ae910 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.405+0000 7f2962830640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295c0cf190 0x7f295c15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.405+0000 7f2962830640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295c0cf190 0x7f295c15b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34262/0 (socket says 172.21.15.82:34262) 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.405+0000 7f2962830640 1 -- 172.21.15.82:0/2740026064 learned_addr learned my addr 172.21.15.82:0/2740026064 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f296182e640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f295c0ae910 0x7f295c14e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f296202f640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f295c06ebf0 0x7f295c15ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f2962830640 1 -- 172.21.15.82:0/2740026064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f295c0ae910 msgr2=0x7f295c14e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f2962830640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f295c0ae910 0x7f295c14e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f2962830640 1 -- 172.21.15.82:0/2740026064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f295c06ebf0 msgr2=0x7f295c15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f2962830640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f295c06ebf0 0x7f295c15ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f2962830640 1 -- 172.21.15.82:0/2740026064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c15be30 con 0x7f295c0cf190 2024-06-02T22:52:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f2962830640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295c0cf190 0x7f295c15b4c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f295400cb40 tx=0x7f295400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f2952ffd640 1 -- 172.21.15.82:0/2740026064 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954017070 con 0x7f295c0cf190 2024-06-02T22:52:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f2952ffd640 1 -- 172.21.15.82:0/2740026064 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f295400aca0 con 0x7f295c0cf190 2024-06-02T22:52:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f2952ffd640 1 -- 172.21.15.82:0/2740026064 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954012620 con 0x7f295c0cf190 2024-06-02T22:52:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f2964293640 1 -- 172.21.15.82:0/2740026064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295c15c110 con 0x7f295c0cf190 2024-06-02T22:52:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.406+0000 7f2964293640 1 -- 172.21.15.82:0/2740026064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295c15c9b0 con 0x7f295c0cf190 2024-06-02T22:52:23.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.407+0000 7f2964293640 1 -- 172.21.15.82:0/2740026064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f295c15c500 con 0x7f295c0cf190 2024-06-02T22:52:23.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.408+0000 7f2952ffd640 1 -- 172.21.15.82:0/2740026064 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f295401a070 con 0x7f295c0cf190 2024-06-02T22:52:23.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.408+0000 7f2952ffd640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f294006be30 0x7f294006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.408+0000 7f2952ffd640 1 -- 172.21.15.82:0/2740026064 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f295408b010 con 0x7f295c0cf190 2024-06-02T22:52:23.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.408+0000 7f296202f640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f294006be30 0x7f294006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.408+0000 7f296202f640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f294006be30 0x7f294006e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2958000f60 tx=0x7f2958009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:23.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.412+0000 7f2952ffd640 1 -- 172.21.15.82:0/2740026064 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2954059680 con 0x7f295c0cf190 2024-06-02T22:52:23.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.590+0000 7f2964293640 1 -- 172.21.15.82:0/2740026064 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f295c068430 con 0x7f294006be30 2024-06-02T22:52:23.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.599+0000 7f2952ffd640 1 -- 172.21.15.82:0/2740026064 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f295c068430 con 0x7f294006be30 2024-06-02T22:52:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:23.607 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:52:23.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 -- 172.21.15.82:0/2740026064 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f294006be30 msgr2=0x7f294006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f294006be30 0x7f294006e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2958000f60 tx=0x7f2958009040 comp rx=0 tx=0).stop 2024-06-02T22:52:23.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 -- 172.21.15.82:0/2740026064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295c0cf190 msgr2=0x7f295c15b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295c0cf190 0x7f295c15b4c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f295400cb40 tx=0x7f295400a060 comp rx=0 tx=0).stop 2024-06-02T22:52:23.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 -- 172.21.15.82:0/2740026064 shutdown_connections 2024-06-02T22:52:23.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f294006be30 0x7f294006e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f295c0cf190 0x7f295c15b4c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f295c0ae910 0x7f295c14e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 --2- 172.21.15.82:0/2740026064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f295c06ebf0 0x7f295c15ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 -- 172.21.15.82:0/2740026064 >> 172.21.15.82:0/2740026064 conn(0x7f295c0b19f0 msgr2=0x7f295c06e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 -- 172.21.15.82:0/2740026064 shutdown_connections 2024-06-02T22:52:23.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.603+0000 7f2964293640 1 -- 172.21.15.82:0/2740026064 wait complete. 2024-06-02T22:52:23.614 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-06-02T22:52:21.826321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002541"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867448+0000","last_change":"2024-06-02T22:52:02.575295+0000","last_active":"2024-06-02T22:52:09.867448+0000","last_peered":"2024-06-02T22:52:09.867448+0000","last_clean":"2024-06-02T22:52:09.867448+0000","last_became_active":"2024-06-02T22:52:02.575023+0000","last_became_peered":"2024-06-02T22:52:02.575023+0000","last_unstale":"2024-06-02T22:52:09.867448+0000","last_undegraded":"2024-06-02T22:52:09.867448+0000","last_fullsized":"2024-06-02T22:52:09.867448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:31:16.566686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802284+0000","last_change":"2024-06-02T22:52:03.580611+0000","last_active":"2024-06-02T22:52:09.802284+0000","last_peered":"2024-06-02T22:52:09.802284+0000","last_clean":"2024-06-02T22:52:09.802284+0000","last_became_active":"2024-06-02T22:52:03.580225+0000","last_became_peered":"2024-06-02T22:52:03.580225+0000","last_unstale":"2024-06-02T22:52:09.802284+0000","last_undegraded":"2024-06-02T22:52:09.802284+0000","last_fullsized":"2024-06-02T22:52:09.802284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801869+0000","last_change":"2024-06-02T22:52:07.615955+0000","last_active":"2024-06-02T22:52:09.801869+0000","last_peered":"2024-06-02T22:52:09.801869+0000","last_clean":"2024-06-02T22:52:09.801869+0000","last_became_active":"2024-06-02T22:52:07.615566+0000","last_became_peered":"2024-06-02T22:52:07.615566+0000","last_unstale":"2024-06-02T22:52:09.801869+0000","last_undegraded":"2024-06-02T22:52:09.801869+0000","last_fullsized":"2024-06-02T22:52:09.801869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:27:30.054564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802388+0000","last_change":"2024-06-02T22:52:02.574379+0000","last_active":"2024-06-02T22:52:09.802388+0000","last_peered":"2024-06-02T22:52:09.802388+0000","last_clean":"2024-06-02T22:52:09.802388+0000","last_became_active":"2024-06-02T22:52:02.574045+0000","last_became_peered":"2024-06-02T22:52:02.574045+0000","last_unstale":"2024-06-02T22:52:09.802388+0000","last_undegraded":"2024-06-02T22:52:09.802388+0000","last_fullsized":"2024-06-02T22:52:09.802388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867282+0000","last_change":"2024-06-02T22:52:03.576563+0000","last_active":"2024-06-02T22:52:09.867282+0000","last_peered":"2024-06-02T22:52:09.867282+0000","last_clean":"2024-06-02T22:52:09.867282+0000","last_became_active":"2024-06-02T22:52:03.576270+0000","last_became_peered":"2024-06-02T22:52:03.576270+0000","last_unstale":"2024-06-02T22:52:09.867282+0000","last_undegraded":"2024-06-02T22:52:09.867282+0000","last_fullsized":"2024-06-02T22:52:09.867282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:18:18.561237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608375+0000","last_change":"2024-06-02T22:52:07.602568+0000","last_active":"2024-06-02T22:52:08.608375+0000","last_peered":"2024-06-02T22:52:08.608375+0000","last_clean":"2024-06-02T22:52:08.608375+0000","last_became_active":"2024-06-02T22:52:07.602120+0000","last_became_peered":"2024-06-02T22:52:07.602120+0000","last_unstale":"2024-06-02T22:52:08.608375+0000","last_undegraded":"2024-06-02T22:52:08.608375+0000","last_fullsized":"2024-06-02T22:52:08.608375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:47.081866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366155+0000","last_change":"2024-06-02T22:52:02.571940+0000","last_active":"2024-06-02T22:52:09.366155+0000","last_peered":"2024-06-02T22:52:09.366155+0000","last_clean":"2024-06-02T22:52:09.366155+0000","last_became_active":"2024-06-02T22:52:02.571659+0000","last_became_peered":"2024-06-02T22:52:02.571659+0000","last_unstale":"2024-06-02T22:52:09.366155+0000","last_undegraded":"2024-06-02T22:52:09.366155+0000","last_fullsized":"2024-06-02T22:52:09.366155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:38:20.818313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866687+0000","last_change":"2024-06-02T22:52:03.585947+0000","last_active":"2024-06-02T22:52:09.866687+0000","last_peered":"2024-06-02T22:52:09.866687+0000","last_clean":"2024-06-02T22:52:09.866687+0000","last_became_active":"2024-06-02T22:52:03.585500+0000","last_became_peered":"2024-06-02T22:52:03.585500+0000","last_unstale":"2024-06-02T22:52:09.866687+0000","last_undegraded":"2024-06-02T22:52:09.866687+0000","last_fullsized":"2024-06-02T22:52:09.866687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609695+0000","last_change":"2024-06-02T22:52:07.601710+0000","last_active":"2024-06-02T22:52:08.609695+0000","last_peered":"2024-06-02T22:52:08.609695+0000","last_clean":"2024-06-02T22:52:08.609695+0000","last_became_active":"2024-06-02T22:52:07.601102+0000","last_became_peered":"2024-06-02T22:52:07.601102+0000","last_unstale":"2024-06-02T22:52:08.609695+0000","last_undegraded":"2024-06-02T22:52:08.609695+0000","last_fullsized":"2024-06-02T22:52:08.609695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365966+0000","last_change":"2024-06-02T22:52:02.571116+0000","last_active":"2024-06-02T22:52:09.365966+0000","last_peered":"2024-06-02T22:52:09.365966+0000","last_clean":"2024-06-02T22:52:09.365966+0000","last_became_active":"2024-06-02T22:52:02.570844+0000","last_became_peered":"2024-06-02T22:52:02.570844+0000","last_unstale":"2024-06-02T22:52:09.365966+0000","last_undegraded":"2024-06-02T22:52:09.365966+0000","last_fullsized":"2024-06-02T22:52:09.365966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:29.459302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866964+0000","last_change":"2024-06-02T22:52:03.586616+0000","last_active":"2024-06-02T22:52:09.866964+0000","last_peered":"2024-06-02T22:52:09.866964+0000","last_clean":"2024-06-02T22:52:09.866964+0000","last_became_active":"2024-06-02T22:52:03.586329+0000","last_became_peered":"2024-06-02T22:52:03.586329+0000","last_unstale":"2024-06-02T22:52:09.866964+0000","last_undegraded":"2024-06-02T22:52:09.866964+0000","last_fullsized":"2024-06-02T22:52:09.866964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:53.784824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608637+0000","last_change":"2024-06-02T22:52:07.601892+0000","last_active":"2024-06-02T22:52:08.608637+0000","last_peered":"2024-06-02T22:52:08.608637+0000","last_clean":"2024-06-02T22:52:08.608637+0000","last_became_active":"2024-06-02T22:52:07.601456+0000","last_became_peered":"2024-06-02T22:52:07.601456+0000","last_unstale":"2024-06-02T22:52:08.608637+0000","last_undegraded":"2024-06-02T22:52:08.608637+0000","last_fullsized":"2024-06-02T22:52:08.608637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:36.100904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609102+0000","last_change":"2024-06-02T22:52:03.565750+0000","last_active":"2024-06-02T22:52:08.609102+0000","last_peered":"2024-06-02T22:52:08.609102+0000","last_clean":"2024-06-02T22:52:08.609102+0000","last_became_active":"2024-06-02T22:52:03.565467+0000","last_became_peered":"2024-06-02T22:52:03.565467+0000","last_unstale":"2024-06-02T22:52:08.609102+0000","last_undegraded":"2024-06-02T22:52:08.609102+0000","last_fullsized":"2024-06-02T22:52:08.609102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365983+0000","last_change":"2024-06-02T22:52:02.570379+0000","last_active":"2024-06-02T22:52:09.365983+0000","last_peered":"2024-06-02T22:52:09.365983+0000","last_clean":"2024-06-02T22:52:09.365983+0000","last_became_active":"2024-06-02T22:52:02.570030+0000","last_became_peered":"2024-06-02T22:52:02.570030+0000","last_unstale":"2024-06-02T22:52:09.365983+0000","last_undegraded":"2024-06-02T22:52:09.365983+0000","last_fullsized":"2024-06-02T22:52:09.365983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:22.565230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609584+0000","last_change":"2024-06-02T22:52:07.595784+0000","last_active":"2024-06-02T22:52:08.609584+0000","last_peered":"2024-06-02T22:52:08.609584+0000","last_clean":"2024-06-02T22:52:08.609584+0000","last_became_active":"2024-06-02T22:52:07.595380+0000","last_became_peered":"2024-06-02T22:52:07.595380+0000","last_unstale":"2024-06-02T22:52:08.609584+0000","last_undegraded":"2024-06-02T22:52:08.609584+0000","last_fullsized":"2024-06-02T22:52:08.609584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:58.268207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802173+0000","last_change":"2024-06-02T22:52:03.576639+0000","last_active":"2024-06-02T22:52:09.802173+0000","last_peered":"2024-06-02T22:52:09.802173+0000","last_clean":"2024-06-02T22:52:09.802173+0000","last_became_active":"2024-06-02T22:52:03.576309+0000","last_became_peered":"2024-06-02T22:52:03.576309+0000","last_unstale":"2024-06-02T22:52:09.802173+0000","last_undegraded":"2024-06-02T22:52:09.802173+0000","last_fullsized":"2024-06-02T22:52:09.802173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:12.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867086+0000","last_change":"2024-06-02T22:52:02.571697+0000","last_active":"2024-06-02T22:52:09.867086+0000","last_peered":"2024-06-02T22:52:09.867086+0000","last_clean":"2024-06-02T22:52:09.867086+0000","last_became_active":"2024-06-02T22:52:02.571334+0000","last_became_peered":"2024-06-02T22:52:02.571334+0000","last_unstale":"2024-06-02T22:52:09.867086+0000","last_undegraded":"2024-06-02T22:52:09.867086+0000","last_fullsized":"2024-06-02T22:52:09.867086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608904+0000","last_change":"2024-06-02T22:52:07.602282+0000","last_active":"2024-06-02T22:52:08.608904+0000","last_peered":"2024-06-02T22:52:08.608904+0000","last_clean":"2024-06-02T22:52:08.608904+0000","last_became_active":"2024-06-02T22:52:07.601727+0000","last_became_peered":"2024-06-02T22:52:07.601727+0000","last_unstale":"2024-06-02T22:52:08.608904+0000","last_undegraded":"2024-06-02T22:52:08.608904+0000","last_fullsized":"2024-06-02T22:52:08.608904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:16.624490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802324+0000","last_change":"2024-06-02T22:52:03.581537+0000","last_active":"2024-06-02T22:52:09.802324+0000","last_peered":"2024-06-02T22:52:09.802324+0000","last_clean":"2024-06-02T22:52:09.802324+0000","last_became_active":"2024-06-02T22:52:03.581246+0000","last_became_peered":"2024-06-02T22:52:03.581246+0000","last_unstale":"2024-06-02T22:52:09.802324+0000","last_undegraded":"2024-06-02T22:52:09.802324+0000","last_fullsized":"2024-06-02T22:52:09.802324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866507+0000","last_change":"2024-06-02T22:52:02.572402+0000","last_active":"2024-06-02T22:52:09.866507+0000","last_peered":"2024-06-02T22:52:09.866507+0000","last_clean":"2024-06-02T22:52:09.866507+0000","last_became_active":"2024-06-02T22:52:02.572115+0000","last_became_peered":"2024-06-02T22:52:02.572115+0000","last_unstale":"2024-06-02T22:52:09.866507+0000","last_undegraded":"2024-06-02T22:52:09.866507+0000","last_fullsized":"2024-06-02T22:52:09.866507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866967+0000","last_change":"2024-06-02T22:52:07.612631+0000","last_active":"2024-06-02T22:52:09.866967+0000","last_peered":"2024-06-02T22:52:09.866967+0000","last_clean":"2024-06-02T22:52:09.866967+0000","last_became_active":"2024-06-02T22:52:07.612232+0000","last_became_peered":"2024-06-02T22:52:07.612232+0000","last_unstale":"2024-06-02T22:52:09.866967+0000","last_undegraded":"2024-06-02T22:52:09.866967+0000","last_fullsized":"2024-06-02T22:52:09.866967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:06.782146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609382+0000","last_change":"2024-06-02T22:52:03.572261+0000","last_active":"2024-06-02T22:52:08.609382+0000","last_peered":"2024-06-02T22:52:08.609382+0000","last_clean":"2024-06-02T22:52:08.609382+0000","last_became_active":"2024-06-02T22:52:03.571880+0000","last_became_peered":"2024-06-02T22:52:03.571880+0000","last_unstale":"2024-06-02T22:52:08.609382+0000","last_undegraded":"2024-06-02T22:52:08.609382+0000","last_fullsized":"2024-06-02T22:52:08.609382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:12.138755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365549+0000","last_change":"2024-06-02T22:52:02.577529+0000","last_active":"2024-06-02T22:52:09.365549+0000","last_peered":"2024-06-02T22:52:09.365549+0000","last_clean":"2024-06-02T22:52:09.365549+0000","last_became_active":"2024-06-02T22:52:02.577284+0000","last_became_peered":"2024-06-02T22:52:02.577284+0000","last_unstale":"2024-06-02T22:52:09.365549+0000","last_undegraded":"2024-06-02T22:52:09.365549+0000","last_fullsized":"2024-06-02T22:52:09.365549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608462+0000","last_change":"2024-06-02T22:52:07.602336+0000","last_active":"2024-06-02T22:52:08.608462+0000","last_peered":"2024-06-02T22:52:08.608462+0000","last_clean":"2024-06-02T22:52:08.608462+0000","last_became_active":"2024-06-02T22:52:07.601622+0000","last_became_peered":"2024-06-02T22:52:07.601622+0000","last_unstale":"2024-06-02T22:52:08.608462+0000","last_undegraded":"2024-06-02T22:52:08.608462+0000","last_fullsized":"2024-06-02T22:52:08.608462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:51.634356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867716+0000","last_change":"2024-06-02T22:52:03.572653+0000","last_active":"2024-06-02T22:52:09.867716+0000","last_peered":"2024-06-02T22:52:09.867716+0000","last_clean":"2024-06-02T22:52:09.867716+0000","last_became_active":"2024-06-02T22:52:03.570668+0000","last_became_peered":"2024-06-02T22:52:03.570668+0000","last_unstale":"2024-06-02T22:52:09.867716+0000","last_undegraded":"2024-06-02T22:52:09.867716+0000","last_fullsized":"2024-06-02T22:52:09.867716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609605+0000","last_change":"2024-06-02T22:52:02.567590+0000","last_active":"2024-06-02T22:52:08.609605+0000","last_peered":"2024-06-02T22:52:08.609605+0000","last_clean":"2024-06-02T22:52:08.609605+0000","last_became_active":"2024-06-02T22:52:02.567282+0000","last_became_peered":"2024-06-02T22:52:02.567282+0000","last_unstale":"2024-06-02T22:52:08.609605+0000","last_undegraded":"2024-06-02T22:52:08.609605+0000","last_fullsized":"2024-06-02T22:52:08.609605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609106+0000","last_change":"2024-06-02T22:52:07.612665+0000","last_active":"2024-06-02T22:52:08.609106+0000","last_peered":"2024-06-02T22:52:08.609106+0000","last_clean":"2024-06-02T22:52:08.609106+0000","last_became_active":"2024-06-02T22:52:07.612285+0000","last_became_peered":"2024-06-02T22:52:07.612285+0000","last_unstale":"2024-06-02T22:52:08.609106+0000","last_undegraded":"2024-06-02T22:52:08.609106+0000","last_fullsized":"2024-06-02T22:52:08.609106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:16.674095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802607+0000","last_change":"2024-06-02T22:52:03.582904+0000","last_active":"2024-06-02T22:52:09.802607+0000","last_peered":"2024-06-02T22:52:09.802607+0000","last_clean":"2024-06-02T22:52:09.802607+0000","last_became_active":"2024-06-02T22:52:03.582518+0000","last_became_peered":"2024-06-02T22:52:03.582518+0000","last_unstale":"2024-06-02T22:52:09.802607+0000","last_undegraded":"2024-06-02T22:52:09.802607+0000","last_fullsized":"2024-06-02T22:52:09.802607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866796+0000","last_change":"2024-06-02T22:52:02.573748+0000","last_active":"2024-06-02T22:52:09.866796+0000","last_peered":"2024-06-02T22:52:09.866796+0000","last_clean":"2024-06-02T22:52:09.866796+0000","last_became_active":"2024-06-02T22:52:02.573176+0000","last_became_peered":"2024-06-02T22:52:02.573176+0000","last_unstale":"2024-06-02T22:52:09.866796+0000","last_undegraded":"2024-06-02T22:52:09.866796+0000","last_fullsized":"2024-06-02T22:52:09.866796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801791+0000","last_change":"2024-06-02T22:52:07.616184+0000","last_active":"2024-06-02T22:52:09.801791+0000","last_peered":"2024-06-02T22:52:09.801791+0000","last_clean":"2024-06-02T22:52:09.801791+0000","last_became_active":"2024-06-02T22:52:07.615819+0000","last_became_peered":"2024-06-02T22:52:07.615819+0000","last_unstale":"2024-06-02T22:52:09.801791+0000","last_undegraded":"2024-06-02T22:52:09.801791+0000","last_fullsized":"2024-06-02T22:52:09.801791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:19.408730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867127+0000","last_change":"2024-06-02T22:52:03.569758+0000","last_active":"2024-06-02T22:52:09.867127+0000","last_peered":"2024-06-02T22:52:09.867127+0000","last_clean":"2024-06-02T22:52:09.867127+0000","last_became_active":"2024-06-02T22:52:03.569452+0000","last_became_peered":"2024-06-02T22:52:03.569452+0000","last_unstale":"2024-06-02T22:52:09.867127+0000","last_undegraded":"2024-06-02T22:52:09.867127+0000","last_fullsized":"2024-06-02T22:52:09.867127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366261+0000","last_change":"2024-06-02T22:52:02.580385+0000","last_active":"2024-06-02T22:52:09.366261+0000","last_peered":"2024-06-02T22:52:09.366261+0000","last_clean":"2024-06-02T22:52:09.366261+0000","last_became_active":"2024-06-02T22:52:02.580155+0000","last_became_peered":"2024-06-02T22:52:02.580155+0000","last_unstale":"2024-06-02T22:52:09.366261+0000","last_undegraded":"2024-06-02T22:52:09.366261+0000","last_fullsized":"2024-06-02T22:52:09.366261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:13:02.259557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866547+0000","last_change":"2024-06-02T22:52:07.613087+0000","last_active":"2024-06-02T22:52:09.866547+0000","last_peered":"2024-06-02T22:52:09.866547+0000","last_clean":"2024-06-02T22:52:09.866547+0000","last_became_active":"2024-06-02T22:52:07.612654+0000","last_became_peered":"2024-06-02T22:52:07.612654+0000","last_unstale":"2024-06-02T22:52:09.866547+0000","last_undegraded":"2024-06-02T22:52:09.866547+0000","last_fullsized":"2024-06-02T22:52:09.866547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867078+0000","last_change":"2024-06-02T22:52:03.582326+0000","last_active":"2024-06-02T22:52:09.867078+0000","last_peered":"2024-06-02T22:52:09.867078+0000","last_clean":"2024-06-02T22:52:09.867078+0000","last_became_active":"2024-06-02T22:52:03.581989+0000","last_became_peered":"2024-06-02T22:52:03.581989+0000","last_unstale":"2024-06-02T22:52:09.867078+0000","last_undegraded":"2024-06-02T22:52:09.867078+0000","last_fullsized":"2024-06-02T22:52:09.867078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:32.545502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867218+0000","last_change":"2024-06-02T22:52:02.574632+0000","last_active":"2024-06-02T22:52:09.867218+0000","last_peered":"2024-06-02T22:52:09.867218+0000","last_clean":"2024-06-02T22:52:09.867218+0000","last_became_active":"2024-06-02T22:52:02.573272+0000","last_became_peered":"2024-06-02T22:52:02.573272+0000","last_unstale":"2024-06-02T22:52:09.867218+0000","last_undegraded":"2024-06-02T22:52:09.867218+0000","last_fullsized":"2024-06-02T22:52:09.867218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:29.459302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866384+0000","last_change":"2024-06-02T22:52:07.598965+0000","last_active":"2024-06-02T22:52:09.866384+0000","last_peered":"2024-06-02T22:52:09.866384+0000","last_clean":"2024-06-02T22:52:09.866384+0000","last_became_active":"2024-06-02T22:52:07.597987+0000","last_became_peered":"2024-06-02T22:52:07.597987+0000","last_unstale":"2024-06-02T22:52:09.866384+0000","last_undegraded":"2024-06-02T22:52:09.866384+0000","last_fullsized":"2024-06-02T22:52:09.866384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609823+0000","last_change":"2024-06-02T22:52:03.566069+0000","last_active":"2024-06-02T22:52:08.609823+0000","last_peered":"2024-06-02T22:52:08.609823+0000","last_clean":"2024-06-02T22:52:08.609823+0000","last_became_active":"2024-06-02T22:52:03.565771+0000","last_became_peered":"2024-06-02T22:52:03.565771+0000","last_unstale":"2024-06-02T22:52:08.609823+0000","last_undegraded":"2024-06-02T22:52:08.609823+0000","last_fullsized":"2024-06-02T22:52:08.609823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:21.517626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866865+0000","last_change":"2024-06-02T22:52:02.568991+0000","last_active":"2024-06-02T22:52:09.866865+0000","last_peered":"2024-06-02T22:52:09.866865+0000","last_clean":"2024-06-02T22:52:09.866865+0000","last_became_active":"2024-06-02T22:52:02.568707+0000","last_became_peered":"2024-06-02T22:52:02.568707+0000","last_unstale":"2024-06-02T22:52:09.866865+0000","last_undegraded":"2024-06-02T22:52:09.866865+0000","last_fullsized":"2024-06-02T22:52:09.866865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867124+0000","last_change":"2024-06-02T22:52:07.599911+0000","last_active":"2024-06-02T22:52:09.867124+0000","last_peered":"2024-06-02T22:52:09.867124+0000","last_clean":"2024-06-02T22:52:09.867124+0000","last_became_active":"2024-06-02T22:52:07.599511+0000","last_became_peered":"2024-06-02T22:52:07.599511+0000","last_unstale":"2024-06-02T22:52:09.867124+0000","last_undegraded":"2024-06-02T22:52:09.867124+0000","last_fullsized":"2024-06-02T22:52:09.867124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:12.840435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867482+0000","last_change":"2024-06-02T22:52:03.569708+0000","last_active":"2024-06-02T22:52:09.867482+0000","last_peered":"2024-06-02T22:52:09.867482+0000","last_clean":"2024-06-02T22:52:09.867482+0000","last_became_active":"2024-06-02T22:52:03.568694+0000","last_became_peered":"2024-06-02T22:52:03.568694+0000","last_unstale":"2024-06-02T22:52:09.867482+0000","last_undegraded":"2024-06-02T22:52:09.867482+0000","last_fullsized":"2024-06-02T22:52:09.867482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610009+0000","last_change":"2024-06-02T22:52:02.567971+0000","last_active":"2024-06-02T22:52:08.610009+0000","last_peered":"2024-06-02T22:52:08.610009+0000","last_clean":"2024-06-02T22:52:08.610009+0000","last_became_active":"2024-06-02T22:52:02.567623+0000","last_became_peered":"2024-06-02T22:52:02.567623+0000","last_unstale":"2024-06-02T22:52:08.610009+0000","last_undegraded":"2024-06-02T22:52:08.610009+0000","last_fullsized":"2024-06-02T22:52:08.610009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866990+0000","last_change":"2024-06-02T22:52:07.602117+0000","last_active":"2024-06-02T22:52:09.866990+0000","last_peered":"2024-06-02T22:52:09.866990+0000","last_clean":"2024-06-02T22:52:09.866990+0000","last_became_active":"2024-06-02T22:52:07.599651+0000","last_became_peered":"2024-06-02T22:52:07.599651+0000","last_unstale":"2024-06-02T22:52:09.866990+0000","last_undegraded":"2024-06-02T22:52:09.866990+0000","last_fullsized":"2024-06-02T22:52:09.866990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:36.573360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866296+0000","last_change":"2024-06-02T22:52:03.563190+0000","last_active":"2024-06-02T22:52:09.866296+0000","last_peered":"2024-06-02T22:52:09.866296+0000","last_clean":"2024-06-02T22:52:09.866296+0000","last_became_active":"2024-06-02T22:52:03.562873+0000","last_became_peered":"2024-06-02T22:52:03.562873+0000","last_unstale":"2024-06-02T22:52:09.866296+0000","last_undegraded":"2024-06-02T22:52:09.866296+0000","last_fullsized":"2024-06-02T22:52:09.866296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:31.146827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365584+0000","last_change":"2024-06-02T22:52:02.570735+0000","last_active":"2024-06-02T22:52:09.365584+0000","last_peered":"2024-06-02T22:52:09.365584+0000","last_clean":"2024-06-02T22:52:09.365584+0000","last_became_active":"2024-06-02T22:52:02.570459+0000","last_became_peered":"2024-06-02T22:52:02.570459+0000","last_unstale":"2024-06-02T22:52:09.365584+0000","last_undegraded":"2024-06-02T22:52:09.365584+0000","last_fullsized":"2024-06-02T22:52:09.365584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867640+0000","last_change":"2024-06-02T22:52:07.612607+0000","last_active":"2024-06-02T22:52:09.867640+0000","last_peered":"2024-06-02T22:52:09.867640+0000","last_clean":"2024-06-02T22:52:09.867640+0000","last_became_active":"2024-06-02T22:52:07.612210+0000","last_became_peered":"2024-06-02T22:52:07.612210+0000","last_unstale":"2024-06-02T22:52:09.867640+0000","last_undegraded":"2024-06-02T22:52:09.867640+0000","last_fullsized":"2024-06-02T22:52:09.867640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:12.840435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802134+0000","last_change":"2024-06-02T22:52:03.581959+0000","last_active":"2024-06-02T22:52:09.802134+0000","last_peered":"2024-06-02T22:52:09.802134+0000","last_clean":"2024-06-02T22:52:09.802134+0000","last_became_active":"2024-06-02T22:52:03.581625+0000","last_became_peered":"2024-06-02T22:52:03.581625+0000","last_unstale":"2024-06-02T22:52:09.802134+0000","last_undegraded":"2024-06-02T22:52:09.802134+0000","last_fullsized":"2024-06-02T22:52:09.802134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866575+0000","last_change":"2024-06-02T22:52:02.565526+0000","last_active":"2024-06-02T22:52:09.866575+0000","last_peered":"2024-06-02T22:52:09.866575+0000","last_clean":"2024-06-02T22:52:09.866575+0000","last_became_active":"2024-06-02T22:52:02.565197+0000","last_became_peered":"2024-06-02T22:52:02.565197+0000","last_unstale":"2024-06-02T22:52:09.866575+0000","last_undegraded":"2024-06-02T22:52:09.866575+0000","last_fullsized":"2024-06-02T22:52:09.866575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365701+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:52:09.365701+0000","last_peered":"2024-06-02T22:52:09.365701+0000","last_clean":"2024-06-02T22:52:09.365701+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:52:09.365701+0000","last_undegraded":"2024-06-02T22:52:09.365701+0000","last_fullsized":"2024-06-02T22:52:09.365701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608822+0000","last_change":"2024-06-02T22:52:07.615952+0000","last_active":"2024-06-02T22:52:08.608822+0000","last_peered":"2024-06-02T22:52:08.608822+0000","last_clean":"2024-06-02T22:52:08.608822+0000","last_became_active":"2024-06-02T22:52:07.615538+0000","last_became_peered":"2024-06-02T22:52:07.615538+0000","last_unstale":"2024-06-02T22:52:08.608822+0000","last_undegraded":"2024-06-02T22:52:08.608822+0000","last_fullsized":"2024-06-02T22:52:08.608822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:11.213283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366025+0000","last_change":"2024-06-02T22:52:03.577819+0000","last_active":"2024-06-02T22:52:09.366025+0000","last_peered":"2024-06-02T22:52:09.366025+0000","last_clean":"2024-06-02T22:52:09.366025+0000","last_became_active":"2024-06-02T22:52:03.577525+0000","last_became_peered":"2024-06-02T22:52:03.577525+0000","last_unstale":"2024-06-02T22:52:09.366025+0000","last_undegraded":"2024-06-02T22:52:09.366025+0000","last_fullsized":"2024-06-02T22:52:09.366025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:02.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610185+0000","last_change":"2024-06-02T22:52:02.565482+0000","last_active":"2024-06-02T22:52:08.610185+0000","last_peered":"2024-06-02T22:52:08.610185+0000","last_clean":"2024-06-02T22:52:08.610185+0000","last_became_active":"2024-06-02T22:52:02.565172+0000","last_became_peered":"2024-06-02T22:52:02.565172+0000","last_unstale":"2024-06-02T22:52:08.610185+0000","last_undegraded":"2024-06-02T22:52:08.610185+0000","last_fullsized":"2024-06-02T22:52:08.610185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:37:05.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608322+0000","last_change":"2024-06-02T22:52:07.612701+0000","last_active":"2024-06-02T22:52:08.608322+0000","last_peered":"2024-06-02T22:52:08.608322+0000","last_clean":"2024-06-02T22:52:08.608322+0000","last_became_active":"2024-06-02T22:52:07.612260+0000","last_became_peered":"2024-06-02T22:52:07.612260+0000","last_unstale":"2024-06-02T22:52:08.608322+0000","last_undegraded":"2024-06-02T22:52:08.608322+0000","last_fullsized":"2024-06-02T22:52:08.608322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:47.081866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866731+0000","last_change":"2024-06-02T22:52:03.587460+0000","last_active":"2024-06-02T22:52:09.866731+0000","last_peered":"2024-06-02T22:52:09.866731+0000","last_clean":"2024-06-02T22:52:09.866731+0000","last_became_active":"2024-06-02T22:52:03.587183+0000","last_became_peered":"2024-06-02T22:52:03.587183+0000","last_unstale":"2024-06-02T22:52:09.866731+0000","last_undegraded":"2024-06-02T22:52:09.866731+0000","last_fullsized":"2024-06-02T22:52:09.866731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:43.054007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866861+0000","last_change":"2024-06-02T22:52:02.570822+0000","last_active":"2024-06-02T22:52:09.866861+0000","last_peered":"2024-06-02T22:52:09.866861+0000","last_clean":"2024-06-02T22:52:09.866861+0000","last_became_active":"2024-06-02T22:52:02.570425+0000","last_became_peered":"2024-06-02T22:52:02.570425+0000","last_unstale":"2024-06-02T22:52:09.866861+0000","last_undegraded":"2024-06-02T22:52:09.866861+0000","last_fullsized":"2024-06-02T22:52:09.866861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:22.565230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866793+0000","last_change":"2024-06-02T22:52:07.596605+0000","last_active":"2024-06-02T22:52:09.866793+0000","last_peered":"2024-06-02T22:52:09.866793+0000","last_clean":"2024-06-02T22:52:09.866793+0000","last_became_active":"2024-06-02T22:52:07.596062+0000","last_became_peered":"2024-06-02T22:52:07.596062+0000","last_unstale":"2024-06-02T22:52:09.866793+0000","last_undegraded":"2024-06-02T22:52:09.866793+0000","last_fullsized":"2024-06-02T22:52:09.866793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:57.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366406+0000","last_change":"2024-06-02T22:52:03.583665+0000","last_active":"2024-06-02T22:52:09.366406+0000","last_peered":"2024-06-02T22:52:09.366406+0000","last_clean":"2024-06-02T22:52:09.366406+0000","last_became_active":"2024-06-02T22:52:03.583405+0000","last_became_peered":"2024-06-02T22:52:03.583405+0000","last_unstale":"2024-06-02T22:52:09.366406+0000","last_undegraded":"2024-06-02T22:52:09.366406+0000","last_fullsized":"2024-06-02T22:52:09.366406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.055543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610318+0000","last_change":"2024-06-02T22:52:02.568513+0000","last_active":"2024-06-02T22:52:08.610318+0000","last_peered":"2024-06-02T22:52:08.610318+0000","last_clean":"2024-06-02T22:52:08.610318+0000","last_became_active":"2024-06-02T22:52:02.567653+0000","last_became_peered":"2024-06-02T22:52:02.567653+0000","last_unstale":"2024-06-02T22:52:08.610318+0000","last_undegraded":"2024-06-02T22:52:08.610318+0000","last_fullsized":"2024-06-02T22:52:08.610318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866292+0000","last_change":"2024-06-02T22:52:07.612655+0000","last_active":"2024-06-02T22:52:09.866292+0000","last_peered":"2024-06-02T22:52:09.866292+0000","last_clean":"2024-06-02T22:52:09.866292+0000","last_became_active":"2024-06-02T22:52:07.612255+0000","last_became_peered":"2024-06-02T22:52:07.612255+0000","last_unstale":"2024-06-02T22:52:09.866292+0000","last_undegraded":"2024-06-02T22:52:09.866292+0000","last_fullsized":"2024-06-02T22:52:09.866292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:19.408730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366212+0000","last_change":"2024-06-02T22:52:03.584406+0000","last_active":"2024-06-02T22:52:09.366212+0000","last_peered":"2024-06-02T22:52:09.366212+0000","last_clean":"2024-06-02T22:52:09.366212+0000","last_became_active":"2024-06-02T22:52:03.584128+0000","last_became_peered":"2024-06-02T22:52:03.584128+0000","last_unstale":"2024-06-02T22:52:09.366212+0000","last_undegraded":"2024-06-02T22:52:09.366212+0000","last_fullsized":"2024-06-02T22:52:09.366212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:02.241694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608660+0000","last_change":"2024-06-02T22:52:02.567072+0000","last_active":"2024-06-02T22:52:08.608660+0000","last_peered":"2024-06-02T22:52:08.608660+0000","last_clean":"2024-06-02T22:52:08.608660+0000","last_became_active":"2024-06-02T22:52:02.566757+0000","last_became_peered":"2024-06-02T22:52:02.566757+0000","last_unstale":"2024-06-02T22:52:08.608660+0000","last_undegraded":"2024-06-02T22:52:08.608660+0000","last_fullsized":"2024-06-02T22:52:08.608660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:57.107796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609128+0000","last_change":"2024-06-02T22:52:07.601781+0000","last_active":"2024-06-02T22:52:08.609128+0000","last_peered":"2024-06-02T22:52:08.609128+0000","last_clean":"2024-06-02T22:52:08.609128+0000","last_became_active":"2024-06-02T22:52:07.601121+0000","last_became_peered":"2024-06-02T22:52:07.601121+0000","last_unstale":"2024-06-02T22:52:08.609128+0000","last_undegraded":"2024-06-02T22:52:08.609128+0000","last_fullsized":"2024-06-02T22:52:08.609128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:40.819611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365745+0000","last_change":"2024-06-02T22:52:03.583571+0000","last_active":"2024-06-02T22:52:09.365745+0000","last_peered":"2024-06-02T22:52:09.365745+0000","last_clean":"2024-06-02T22:52:09.365745+0000","last_became_active":"2024-06-02T22:52:03.583035+0000","last_became_peered":"2024-06-02T22:52:03.583035+0000","last_unstale":"2024-06-02T22:52:09.365745+0000","last_undegraded":"2024-06-02T22:52:09.365745+0000","last_fullsized":"2024-06-02T22:52:09.365745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609832+0000","last_change":"2024-06-02T22:52:02.568253+0000","last_active":"2024-06-02T22:52:08.609832+0000","last_peered":"2024-06-02T22:52:08.609832+0000","last_clean":"2024-06-02T22:52:08.609832+0000","last_became_active":"2024-06-02T22:52:02.567725+0000","last_became_peered":"2024-06-02T22:52:02.567725+0000","last_unstale":"2024-06-02T22:52:08.609832+0000","last_undegraded":"2024-06-02T22:52:08.609832+0000","last_fullsized":"2024-06-02T22:52:08.609832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867536+0000","last_change":"2024-06-02T22:52:07.601097+0000","last_active":"2024-06-02T22:52:09.867536+0000","last_peered":"2024-06-02T22:52:09.867536+0000","last_clean":"2024-06-02T22:52:09.867536+0000","last_became_active":"2024-06-02T22:52:07.600696+0000","last_became_peered":"2024-06-02T22:52:07.600696+0000","last_unstale":"2024-06-02T22:52:09.867536+0000","last_undegraded":"2024-06-02T22:52:09.867536+0000","last_fullsized":"2024-06-02T22:52:09.867536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:36.573360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608536+0000","last_change":"2024-06-02T22:52:03.579404+0000","last_active":"2024-06-02T22:52:08.608536+0000","last_peered":"2024-06-02T22:52:08.608536+0000","last_clean":"2024-06-02T22:52:08.608536+0000","last_became_active":"2024-06-02T22:52:03.579057+0000","last_became_peered":"2024-06-02T22:52:03.579057+0000","last_unstale":"2024-06-02T22:52:08.608536+0000","last_undegraded":"2024-06-02T22:52:08.608536+0000","last_fullsized":"2024-06-02T22:52:08.608536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609446+0000","last_change":"2024-06-02T22:52:02.566374+0000","last_active":"2024-06-02T22:52:08.609446+0000","last_peered":"2024-06-02T22:52:08.609446+0000","last_clean":"2024-06-02T22:52:08.609446+0000","last_became_active":"2024-06-02T22:52:02.566091+0000","last_became_peered":"2024-06-02T22:52:02.566091+0000","last_unstale":"2024-06-02T22:52:08.609446+0000","last_undegraded":"2024-06-02T22:52:08.609446+0000","last_fullsized":"2024-06-02T22:52:08.609446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802585+0000","last_change":"2024-06-02T22:52:07.615876+0000","last_active":"2024-06-02T22:52:09.802585+0000","last_peered":"2024-06-02T22:52:09.802585+0000","last_clean":"2024-06-02T22:52:09.802585+0000","last_became_active":"2024-06-02T22:52:07.615423+0000","last_became_peered":"2024-06-02T22:52:07.615423+0000","last_unstale":"2024-06-02T22:52:09.802585+0000","last_undegraded":"2024-06-02T22:52:09.802585+0000","last_fullsized":"2024-06-02T22:52:09.802585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:20:08.691545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365895+0000","last_change":"2024-06-02T22:52:03.579077+0000","last_active":"2024-06-02T22:52:09.365895+0000","last_peered":"2024-06-02T22:52:09.365895+0000","last_clean":"2024-06-02T22:52:09.365895+0000","last_became_active":"2024-06-02T22:52:03.578126+0000","last_became_peered":"2024-06-02T22:52:03.578126+0000","last_unstale":"2024-06-02T22:52:09.365895+0000","last_undegraded":"2024-06-02T22:52:09.365895+0000","last_fullsized":"2024-06-02T22:52:09.365895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:43.054007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866722+0000","last_change":"2024-06-02T22:52:02.570439+0000","last_active":"2024-06-02T22:52:09.866722+0000","last_peered":"2024-06-02T22:52:09.866722+0000","last_clean":"2024-06-02T22:52:09.866722+0000","last_became_active":"2024-06-02T22:52:02.569937+0000","last_became_peered":"2024-06-02T22:52:02.569937+0000","last_unstale":"2024-06-02T22:52:09.866722+0000","last_undegraded":"2024-06-02T22:52:09.866722+0000","last_fullsized":"2024-06-02T22:52:09.866722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802494+0000","last_change":"2024-06-02T22:52:07.612603+0000","last_active":"2024-06-02T22:52:09.802494+0000","last_peered":"2024-06-02T22:52:09.802494+0000","last_clean":"2024-06-02T22:52:09.802494+0000","last_became_active":"2024-06-02T22:52:07.612214+0000","last_became_peered":"2024-06-02T22:52:07.612214+0000","last_unstale":"2024-06-02T22:52:09.802494+0000","last_undegraded":"2024-06-02T22:52:09.802494+0000","last_fullsized":"2024-06-02T22:52:09.802494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:20:19.247700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867054+0000","last_change":"2024-06-02T22:52:03.579566+0000","last_active":"2024-06-02T22:52:09.867054+0000","last_peered":"2024-06-02T22:52:09.867054+0000","last_clean":"2024-06-02T22:52:09.867054+0000","last_became_active":"2024-06-02T22:52:03.579295+0000","last_became_peered":"2024-06-02T22:52:03.579295+0000","last_unstale":"2024-06-02T22:52:09.867054+0000","last_undegraded":"2024-06-02T22:52:09.867054+0000","last_fullsized":"2024-06-02T22:52:09.867054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867327+0000","last_change":"2024-06-02T22:52:02.563970+0000","last_active":"2024-06-02T22:52:09.867327+0000","last_peered":"2024-06-02T22:52:09.867327+0000","last_clean":"2024-06-02T22:52:09.867327+0000","last_became_active":"2024-06-02T22:52:02.563675+0000","last_became_peered":"2024-06-02T22:52:02.563675+0000","last_unstale":"2024-06-02T22:52:09.867327+0000","last_undegraded":"2024-06-02T22:52:09.867327+0000","last_fullsized":"2024-06-02T22:52:09.867327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:31.842742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866976+0000","last_change":"2024-06-02T22:52:07.615973+0000","last_active":"2024-06-02T22:52:09.866976+0000","last_peered":"2024-06-02T22:52:09.866976+0000","last_clean":"2024-06-02T22:52:09.866976+0000","last_became_active":"2024-06-02T22:52:07.615586+0000","last_became_peered":"2024-06-02T22:52:07.615586+0000","last_unstale":"2024-06-02T22:52:09.866976+0000","last_undegraded":"2024-06-02T22:52:09.866976+0000","last_fullsized":"2024-06-02T22:52:09.866976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:27:30.054564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365923+0000","last_change":"2024-06-02T22:52:03.584686+0000","last_active":"2024-06-02T22:52:09.365923+0000","last_peered":"2024-06-02T22:52:09.365923+0000","last_clean":"2024-06-02T22:52:09.365923+0000","last_became_active":"2024-06-02T22:52:03.584398+0000","last_became_peered":"2024-06-02T22:52:03.584398+0000","last_unstale":"2024-06-02T22:52:09.365923+0000","last_undegraded":"2024-06-02T22:52:09.365923+0000","last_fullsized":"2024-06-02T22:52:09.365923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:07.185424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:12.944886+0000","last_change":"2024-06-02T22:52:02.568278+0000","last_active":"2024-06-02T22:52:12.944886+0000","last_peered":"2024-06-02T22:52:12.944886+0000","last_clean":"2024-06-02T22:52:12.944886+0000","last_became_active":"2024-06-02T22:52:02.567915+0000","last_became_peered":"2024-06-02T22:52:02.567915+0000","last_unstale":"2024-06-02T22:52:12.944886+0000","last_undegraded":"2024-06-02T22:52:12.944886+0000","last_fullsized":"2024-06-02T22:52:12.944886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866737+0000","last_change":"2024-06-02T22:52:07.596273+0000","last_active":"2024-06-02T22:52:09.866737+0000","last_peered":"2024-06-02T22:52:09.866737+0000","last_clean":"2024-06-02T22:52:09.866737+0000","last_became_active":"2024-06-02T22:52:07.595893+0000","last_became_peered":"2024-06-02T22:52:07.595893+0000","last_unstale":"2024-06-02T22:52:09.866737+0000","last_undegraded":"2024-06-02T22:52:09.866737+0000","last_fullsized":"2024-06-02T22:52:09.866737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:57.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609245+0000","last_change":"2024-06-02T22:52:03.576403+0000","last_active":"2024-06-02T22:52:08.609245+0000","last_peered":"2024-06-02T22:52:08.609245+0000","last_clean":"2024-06-02T22:52:08.609245+0000","last_became_active":"2024-06-02T22:52:03.574665+0000","last_became_peered":"2024-06-02T22:52:03.574665+0000","last_unstale":"2024-06-02T22:52:08.609245+0000","last_undegraded":"2024-06-02T22:52:08.609245+0000","last_fullsized":"2024-06-02T22:52:08.609245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:30.466832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866748+0000","last_change":"2024-06-02T22:52:02.572661+0000","last_active":"2024-06-02T22:52:09.866748+0000","last_peered":"2024-06-02T22:52:09.866748+0000","last_clean":"2024-06-02T22:52:09.866748+0000","last_became_active":"2024-06-02T22:52:02.571128+0000","last_became_peered":"2024-06-02T22:52:02.571128+0000","last_unstale":"2024-06-02T22:52:09.866748+0000","last_undegraded":"2024-06-02T22:52:09.866748+0000","last_fullsized":"2024-06-02T22:52:09.866748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609673+0000","last_change":"2024-06-02T22:52:07.595758+0000","last_active":"2024-06-02T22:52:08.609673+0000","last_peered":"2024-06-02T22:52:08.609673+0000","last_clean":"2024-06-02T22:52:08.609673+0000","last_became_active":"2024-06-02T22:52:07.595359+0000","last_became_peered":"2024-06-02T22:52:07.595359+0000","last_unstale":"2024-06-02T22:52:08.609673+0000","last_undegraded":"2024-06-02T22:52:08.609673+0000","last_fullsized":"2024-06-02T22:52:08.609673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:11.213283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867361+0000","last_change":"2024-06-02T22:52:03.575977+0000","last_active":"2024-06-02T22:52:09.867361+0000","last_peered":"2024-06-02T22:52:09.867361+0000","last_clean":"2024-06-02T22:52:09.867361+0000","last_became_active":"2024-06-02T22:52:03.575690+0000","last_became_peered":"2024-06-02T22:52:03.575690+0000","last_unstale":"2024-06-02T22:52:09.867361+0000","last_undegraded":"2024-06-02T22:52:09.867361+0000","last_fullsized":"2024-06-02T22:52:09.867361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866849+0000","last_change":"2024-06-02T22:52:02.571504+0000","last_active":"2024-06-02T22:52:09.866849+0000","last_peered":"2024-06-02T22:52:09.866849+0000","last_clean":"2024-06-02T22:52:09.866849+0000","last_became_active":"2024-06-02T22:52:02.571227+0000","last_became_peered":"2024-06-02T22:52:02.571227+0000","last_unstale":"2024-06-02T22:52:09.866849+0000","last_undegraded":"2024-06-02T22:52:09.866849+0000","last_fullsized":"2024-06-02T22:52:09.866849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801961+0000","last_change":"2024-06-02T22:52:07.599829+0000","last_active":"2024-06-02T22:52:09.801961+0000","last_peered":"2024-06-02T22:52:09.801961+0000","last_clean":"2024-06-02T22:52:09.801961+0000","last_became_active":"2024-06-02T22:52:07.599407+0000","last_became_peered":"2024-06-02T22:52:07.599407+0000","last_unstale":"2024-06-02T22:52:09.801961+0000","last_undegraded":"2024-06-02T22:52:09.801961+0000","last_fullsized":"2024-06-02T22:52:09.801961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:33:49.412166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866795+0000","last_change":"2024-06-02T22:52:03.585466+0000","last_active":"2024-06-02T22:52:09.866795+0000","last_peered":"2024-06-02T22:52:09.866795+0000","last_clean":"2024-06-02T22:52:09.866795+0000","last_became_active":"2024-06-02T22:52:03.584977+0000","last_became_peered":"2024-06-02T22:52:03.584977+0000","last_unstale":"2024-06-02T22:52:09.866795+0000","last_undegraded":"2024-06-02T22:52:09.866795+0000","last_fullsized":"2024-06-02T22:52:09.866795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:07.185424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609512+0000","last_change":"2024-06-02T22:52:02.566185+0000","last_active":"2024-06-02T22:52:08.609512+0000","last_peered":"2024-06-02T22:52:08.609512+0000","last_clean":"2024-06-02T22:52:08.609512+0000","last_became_active":"2024-06-02T22:52:02.565884+0000","last_became_peered":"2024-06-02T22:52:02.565884+0000","last_unstale":"2024-06-02T22:52:08.609512+0000","last_undegraded":"2024-06-02T22:52:08.609512+0000","last_fullsized":"2024-06-02T22:52:08.609512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801946+0000","last_change":"2024-06-02T22:52:07.613267+0000","last_active":"2024-06-02T22:52:09.801946+0000","last_peered":"2024-06-02T22:52:09.801946+0000","last_clean":"2024-06-02T22:52:09.801946+0000","last_became_active":"2024-06-02T22:52:07.612830+0000","last_became_peered":"2024-06-02T22:52:07.612830+0000","last_unstale":"2024-06-02T22:52:09.801946+0000","last_undegraded":"2024-06-02T22:52:09.801946+0000","last_fullsized":"2024-06-02T22:52:09.801946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:08:51.327311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867496+0000","last_change":"2024-06-02T22:52:07.615985+0000","last_active":"2024-06-02T22:52:09.867496+0000","last_peered":"2024-06-02T22:52:09.867496+0000","last_clean":"2024-06-02T22:52:09.867496+0000","last_became_active":"2024-06-02T22:52:07.615499+0000","last_became_peered":"2024-06-02T22:52:07.615499+0000","last_unstale":"2024-06-02T22:52:09.867496+0000","last_undegraded":"2024-06-02T22:52:09.867496+0000","last_fullsized":"2024-06-02T22:52:09.867496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:06.782146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866321+0000","last_change":"2024-06-02T22:52:03.582276+0000","last_active":"2024-06-02T22:52:09.866321+0000","last_peered":"2024-06-02T22:52:09.866321+0000","last_clean":"2024-06-02T22:52:09.866321+0000","last_became_active":"2024-06-02T22:52:03.582024+0000","last_became_peered":"2024-06-02T22:52:03.582024+0000","last_unstale":"2024-06-02T22:52:09.866321+0000","last_undegraded":"2024-06-02T22:52:09.866321+0000","last_fullsized":"2024-06-02T22:52:09.866321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866520+0000","last_change":"2024-06-02T22:52:02.566673+0000","last_active":"2024-06-02T22:52:09.866520+0000","last_peered":"2024-06-02T22:52:09.866520+0000","last_clean":"2024-06-02T22:52:09.866520+0000","last_became_active":"2024-06-02T22:52:02.566382+0000","last_became_peered":"2024-06-02T22:52:02.566382+0000","last_unstale":"2024-06-02T22:52:09.866520+0000","last_undegraded":"2024-06-02T22:52:09.866520+0000","last_fullsized":"2024-06-02T22:52:09.866520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609482+0000","last_change":"2024-06-02T22:52:07.595868+0000","last_active":"2024-06-02T22:52:08.609482+0000","last_peered":"2024-06-02T22:52:08.609482+0000","last_clean":"2024-06-02T22:52:08.609482+0000","last_became_active":"2024-06-02T22:52:07.595443+0000","last_became_peered":"2024-06-02T22:52:07.595443+0000","last_unstale":"2024-06-02T22:52:08.609482+0000","last_undegraded":"2024-06-02T22:52:08.609482+0000","last_fullsized":"2024-06-02T22:52:08.609482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801957+0000","last_change":"2024-06-02T22:52:03.577756+0000","last_active":"2024-06-02T22:52:09.801957+0000","last_peered":"2024-06-02T22:52:09.801957+0000","last_clean":"2024-06-02T22:52:09.801957+0000","last_became_active":"2024-06-02T22:52:03.577464+0000","last_became_peered":"2024-06-02T22:52:03.577464+0000","last_unstale":"2024-06-02T22:52:09.801957+0000","last_undegraded":"2024-06-02T22:52:09.801957+0000","last_fullsized":"2024-06-02T22:52:09.801957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802322+0000","last_change":"2024-06-02T22:52:02.573076+0000","last_active":"2024-06-02T22:52:09.802322+0000","last_peered":"2024-06-02T22:52:09.802322+0000","last_clean":"2024-06-02T22:52:09.802322+0000","last_became_active":"2024-06-02T22:52:02.572774+0000","last_became_peered":"2024-06-02T22:52:02.572774+0000","last_unstale":"2024-06-02T22:52:09.802322+0000","last_undegraded":"2024-06-02T22:52:09.802322+0000","last_fullsized":"2024-06-02T22:52:09.802322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:37:05.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609292+0000","last_change":"2024-06-02T22:52:02.567544+0000","last_active":"2024-06-02T22:52:08.609292+0000","last_peered":"2024-06-02T22:52:08.609292+0000","last_clean":"2024-06-02T22:52:08.609292+0000","last_became_active":"2024-06-02T22:52:02.566808+0000","last_became_peered":"2024-06-02T22:52:02.566808+0000","last_unstale":"2024-06-02T22:52:08.609292+0000","last_undegraded":"2024-06-02T22:52:08.609292+0000","last_fullsized":"2024-06-02T22:52:08.609292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867244+0000","last_change":"2024-06-02T22:52:03.562967+0000","last_active":"2024-06-02T22:52:09.867244+0000","last_peered":"2024-06-02T22:52:09.867244+0000","last_clean":"2024-06-02T22:52:09.867244+0000","last_became_active":"2024-06-02T22:52:03.562081+0000","last_became_peered":"2024-06-02T22:52:03.562081+0000","last_unstale":"2024-06-02T22:52:09.867244+0000","last_undegraded":"2024-06-02T22:52:09.867244+0000","last_fullsized":"2024-06-02T22:52:09.867244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610074+0000","last_change":"2024-06-02T22:52:07.601119+0000","last_active":"2024-06-02T22:52:08.610074+0000","last_peered":"2024-06-02T22:52:08.610074+0000","last_clean":"2024-06-02T22:52:08.610074+0000","last_became_active":"2024-06-02T22:52:07.600750+0000","last_became_peered":"2024-06-02T22:52:07.600750+0000","last_unstale":"2024-06-02T22:52:08.610074+0000","last_undegraded":"2024-06-02T22:52:08.610074+0000","last_fullsized":"2024-06-02T22:52:08.610074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:35.174685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802437+0000","last_change":"2024-06-02T22:52:02.571567+0000","last_active":"2024-06-02T22:52:09.802437+0000","last_peered":"2024-06-02T22:52:09.802437+0000","last_clean":"2024-06-02T22:52:09.802437+0000","last_became_active":"2024-06-02T22:52:02.571287+0000","last_became_peered":"2024-06-02T22:52:02.571287+0000","last_unstale":"2024-06-02T22:52:09.802437+0000","last_undegraded":"2024-06-02T22:52:09.802437+0000","last_fullsized":"2024-06-02T22:52:09.802437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:31:16.566686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608886+0000","last_change":"2024-06-02T22:52:03.570359+0000","last_active":"2024-06-02T22:52:08.608886+0000","last_peered":"2024-06-02T22:52:08.608886+0000","last_clean":"2024-06-02T22:52:08.608886+0000","last_became_active":"2024-06-02T22:52:03.570078+0000","last_became_peered":"2024-06-02T22:52:03.570078+0000","last_unstale":"2024-06-02T22:52:08.608886+0000","last_undegraded":"2024-06-02T22:52:08.608886+0000","last_fullsized":"2024-06-02T22:52:08.608886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:23.572760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802391+0000","last_change":"2024-06-02T22:52:07.599308+0000","last_active":"2024-06-02T22:52:09.802391+0000","last_peered":"2024-06-02T22:52:09.802391+0000","last_clean":"2024-06-02T22:52:09.802391+0000","last_became_active":"2024-06-02T22:52:07.598853+0000","last_became_peered":"2024-06-02T22:52:07.598853+0000","last_unstale":"2024-06-02T22:52:09.802391+0000","last_undegraded":"2024-06-02T22:52:09.802391+0000","last_fullsized":"2024-06-02T22:52:09.802391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:58:51.080840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608325+0000","last_change":"2024-06-02T22:52:03.579154+0000","last_active":"2024-06-02T22:52:08.608325+0000","last_peered":"2024-06-02T22:52:08.608325+0000","last_clean":"2024-06-02T22:52:08.608325+0000","last_became_active":"2024-06-02T22:52:03.578832+0000","last_became_peered":"2024-06-02T22:52:03.578832+0000","last_unstale":"2024-06-02T22:52:08.608325+0000","last_undegraded":"2024-06-02T22:52:08.608325+0000","last_fullsized":"2024-06-02T22:52:08.608325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609855+0000","last_change":"2024-06-02T22:52:03.575695+0000","last_active":"2024-06-02T22:52:08.609855+0000","last_peered":"2024-06-02T22:52:08.609855+0000","last_clean":"2024-06-02T22:52:08.609855+0000","last_became_active":"2024-06-02T22:52:03.575447+0000","last_became_peered":"2024-06-02T22:52:03.575447+0000","last_unstale":"2024-06-02T22:52:08.609855+0000","last_undegraded":"2024-06-02T22:52:08.609855+0000","last_fullsized":"2024-06-02T22:52:08.609855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:23.572760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866720+0000","last_change":"2024-06-02T22:52:03.579412+0000","last_active":"2024-06-02T22:52:09.866720+0000","last_peered":"2024-06-02T22:52:09.866720+0000","last_clean":"2024-06-02T22:52:09.866720+0000","last_became_active":"2024-06-02T22:52:03.578767+0000","last_became_peered":"2024-06-02T22:52:03.578767+0000","last_unstale":"2024-06-02T22:52:09.866720+0000","last_undegraded":"2024-06-02T22:52:09.866720+0000","last_fullsized":"2024-06-02T22:52:09.866720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867151+0000","last_change":"2024-06-02T22:52:03.578192+0000","last_active":"2024-06-02T22:52:09.867151+0000","last_peered":"2024-06-02T22:52:09.867151+0000","last_clean":"2024-06-02T22:52:09.867151+0000","last_became_active":"2024-06-02T22:52:03.577899+0000","last_became_peered":"2024-06-02T22:52:03.577899+0000","last_unstale":"2024-06-02T22:52:09.867151+0000","last_undegraded":"2024-06-02T22:52:09.867151+0000","last_fullsized":"2024-06-02T22:52:09.867151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802510+0000","last_change":"2024-06-02T22:52:03.585412+0000","last_active":"2024-06-02T22:52:09.802510+0000","last_peered":"2024-06-02T22:52:09.802510+0000","last_clean":"2024-06-02T22:52:09.802510+0000","last_became_active":"2024-06-02T22:52:03.585003+0000","last_became_peered":"2024-06-02T22:52:03.585003+0000","last_unstale":"2024-06-02T22:52:09.802510+0000","last_undegraded":"2024-06-02T22:52:09.802510+0000","last_fullsized":"2024-06-02T22:52:09.802510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866492+0000","last_change":"2024-06-02T22:52:03.581743+0000","last_active":"2024-06-02T22:52:09.866492+0000","last_peered":"2024-06-02T22:52:09.866492+0000","last_clean":"2024-06-02T22:52:09.866492+0000","last_became_active":"2024-06-02T22:52:03.581485+0000","last_became_peered":"2024-06-02T22:52:03.581485+0000","last_unstale":"2024-06-02T22:52:09.866492+0000","last_undegraded":"2024-06-02T22:52:09.866492+0000","last_fullsized":"2024-06-02T22:52:09.866492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609761+0000","last_change":"2024-06-02T22:52:03.578703+0000","last_active":"2024-06-02T22:52:08.609761+0000","last_peered":"2024-06-02T22:52:08.609761+0000","last_clean":"2024-06-02T22:52:08.609761+0000","last_became_active":"2024-06-02T22:52:03.578406+0000","last_became_peered":"2024-06-02T22:52:03.578406+0000","last_unstale":"2024-06-02T22:52:08.609761+0000","last_undegraded":"2024-06-02T22:52:08.609761+0000","last_fullsized":"2024-06-02T22:52:08.609761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802540+0000","last_change":"2024-06-02T22:52:03.585351+0000","last_active":"2024-06-02T22:52:09.802540+0000","last_peered":"2024-06-02T22:52:09.802540+0000","last_clean":"2024-06-02T22:52:09.802540+0000","last_became_active":"2024-06-02T22:52:03.585010+0000","last_became_peered":"2024-06-02T22:52:03.585010+0000","last_unstale":"2024-06-02T22:52:09.802540+0000","last_undegraded":"2024-06-02T22:52:09.802540+0000","last_fullsized":"2024-06-02T22:52:09.802540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866426+0000","last_change":"2024-06-02T22:52:03.583268+0000","last_active":"2024-06-02T22:52:09.866426+0000","last_peered":"2024-06-02T22:52:09.866426+0000","last_clean":"2024-06-02T22:52:09.866426+0000","last_became_active":"2024-06-02T22:52:03.582821+0000","last_became_peered":"2024-06-02T22:52:03.582821+0000","last_unstale":"2024-06-02T22:52:09.866426+0000","last_undegraded":"2024-06-02T22:52:09.866426+0000","last_fullsized":"2024-06-02T22:52:09.866426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802429+0000","last_change":"2024-06-02T22:52:03.585232+0000","last_active":"2024-06-02T22:52:09.802429+0000","last_peered":"2024-06-02T22:52:09.802429+0000","last_clean":"2024-06-02T22:52:09.802429+0000","last_became_active":"2024-06-02T22:52:03.584909+0000","last_became_peered":"2024-06-02T22:52:03.584909+0000","last_unstale":"2024-06-02T22:52:09.802429+0000","last_undegraded":"2024-06-02T22:52:09.802429+0000","last_fullsized":"2024-06-02T22:52:09.802429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866614+0000","last_change":"2024-06-02T22:52:03.580413+0000","last_active":"2024-06-02T22:52:09.866614+0000","last_peered":"2024-06-02T22:52:09.866614+0000","last_clean":"2024-06-02T22:52:09.866614+0000","last_became_active":"2024-06-02T22:52:03.580073+0000","last_became_peered":"2024-06-02T22:52:03.580073+0000","last_unstale":"2024-06-02T22:52:09.866614+0000","last_undegraded":"2024-06-02T22:52:09.866614+0000","last_fullsized":"2024-06-02T22:52:09.866614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866640+0000","last_change":"2024-06-02T22:52:03.579729+0000","last_active":"2024-06-02T22:52:09.866640+0000","last_peered":"2024-06-02T22:52:09.866640+0000","last_clean":"2024-06-02T22:52:09.866640+0000","last_became_active":"2024-06-02T22:52:03.578651+0000","last_became_peered":"2024-06-02T22:52:03.578651+0000","last_unstale":"2024-06-02T22:52:09.866640+0000","last_undegraded":"2024-06-02T22:52:09.866640+0000","last_fullsized":"2024-06-02T22:52:09.866640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608916+0000","last_change":"2024-06-02T22:52:03.566626+0000","last_active":"2024-06-02T22:52:08.608916+0000","last_peered":"2024-06-02T22:52:08.608916+0000","last_clean":"2024-06-02T22:52:08.608916+0000","last_became_active":"2024-06-02T22:52:03.566318+0000","last_became_peered":"2024-06-02T22:52:03.566318+0000","last_unstale":"2024-06-02T22:52:08.608916+0000","last_undegraded":"2024-06-02T22:52:08.608916+0000","last_fullsized":"2024-06-02T22:52:08.608916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366167+0000","last_change":"2024-06-02T22:52:03.576084+0000","last_active":"2024-06-02T22:52:09.366167+0000","last_peered":"2024-06-02T22:52:09.366167+0000","last_clean":"2024-06-02T22:52:09.366167+0000","last_became_active":"2024-06-02T22:52:03.574965+0000","last_became_peered":"2024-06-02T22:52:03.574965+0000","last_unstale":"2024-06-02T22:52:09.366167+0000","last_undegraded":"2024-06-02T22:52:09.366167+0000","last_fullsized":"2024-06-02T22:52:09.366167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:08.812577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610259+0000","last_change":"2024-06-02T22:52:03.566226+0000","last_active":"2024-06-02T22:52:08.610259+0000","last_peered":"2024-06-02T22:52:08.610259+0000","last_clean":"2024-06-02T22:52:08.610259+0000","last_became_active":"2024-06-02T22:52:03.565402+0000","last_became_peered":"2024-06-02T22:52:03.565402+0000","last_unstale":"2024-06-02T22:52:08.610259+0000","last_undegraded":"2024-06-02T22:52:08.610259+0000","last_fullsized":"2024-06-02T22:52:08.610259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:30.466832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867094+0000","last_change":"2024-06-02T22:52:03.586071+0000","last_active":"2024-06-02T22:52:09.867094+0000","last_peered":"2024-06-02T22:52:09.867094+0000","last_clean":"2024-06-02T22:52:09.867094+0000","last_became_active":"2024-06-02T22:52:03.585280+0000","last_became_peered":"2024-06-02T22:52:03.585280+0000","last_unstale":"2024-06-02T22:52:09.867094+0000","last_undegraded":"2024-06-02T22:52:09.867094+0000","last_fullsized":"2024-06-02T22:52:09.867094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:02.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866301+0000","last_change":"2024-06-02T22:52:03.579486+0000","last_active":"2024-06-02T22:52:09.866301+0000","last_peered":"2024-06-02T22:52:09.866301+0000","last_clean":"2024-06-02T22:52:09.866301+0000","last_became_active":"2024-06-02T22:52:03.579239+0000","last_became_peered":"2024-06-02T22:52:03.579239+0000","last_unstale":"2024-06-02T22:52:09.866301+0000","last_undegraded":"2024-06-02T22:52:09.866301+0000","last_fullsized":"2024-06-02T22:52:09.866301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866412+0000","last_change":"2024-06-02T22:52:03.575434+0000","last_active":"2024-06-02T22:52:09.866412+0000","last_peered":"2024-06-02T22:52:09.866412+0000","last_clean":"2024-06-02T22:52:09.866412+0000","last_became_active":"2024-06-02T22:52:03.575156+0000","last_became_peered":"2024-06-02T22:52:03.575156+0000","last_unstale":"2024-06-02T22:52:09.866412+0000","last_undegraded":"2024-06-02T22:52:09.866412+0000","last_fullsized":"2024-06-02T22:52:09.866412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867007+0000","last_change":"2024-06-02T22:52:03.573576+0000","last_active":"2024-06-02T22:52:09.867007+0000","last_peered":"2024-06-02T22:52:09.867007+0000","last_clean":"2024-06-02T22:52:09.867007+0000","last_became_active":"2024-06-02T22:52:03.573309+0000","last_became_peered":"2024-06-02T22:52:03.573309+0000","last_unstale":"2024-06-02T22:52:09.867007+0000","last_undegraded":"2024-06-02T22:52:09.867007+0000","last_fullsized":"2024-06-02T22:52:09.867007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:16.007531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802158+0000","last_change":"2024-06-02T22:52:03.581040+0000","last_active":"2024-06-02T22:52:09.802158+0000","last_peered":"2024-06-02T22:52:09.802158+0000","last_clean":"2024-06-02T22:52:09.802158+0000","last_became_active":"2024-06-02T22:52:03.580786+0000","last_became_peered":"2024-06-02T22:52:03.580786+0000","last_unstale":"2024-06-02T22:52:09.802158+0000","last_undegraded":"2024-06-02T22:52:09.802158+0000","last_fullsized":"2024-06-02T22:52:09.802158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609154+0000","last_change":"2024-06-02T22:52:03.564691+0000","last_active":"2024-06-02T22:52:08.609154+0000","last_peered":"2024-06-02T22:52:08.609154+0000","last_clean":"2024-06-02T22:52:08.609154+0000","last_became_active":"2024-06-02T22:52:03.564367+0000","last_became_peered":"2024-06-02T22:52:03.564367+0000","last_unstale":"2024-06-02T22:52:08.609154+0000","last_undegraded":"2024-06-02T22:52:08.609154+0000","last_fullsized":"2024-06-02T22:52:08.609154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:32.549919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609176+0000","last_change":"2024-06-02T22:52:03.579026+0000","last_active":"2024-06-02T22:52:08.609176+0000","last_peered":"2024-06-02T22:52:08.609176+0000","last_clean":"2024-06-02T22:52:08.609176+0000","last_became_active":"2024-06-02T22:52:03.578719+0000","last_became_peered":"2024-06-02T22:52:03.578719+0000","last_unstale":"2024-06-02T22:52:08.609176+0000","last_undegraded":"2024-06-02T22:52:08.609176+0000","last_fullsized":"2024-06-02T22:52:08.609176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609690+0000","last_change":"2024-06-02T22:52:03.576967+0000","last_active":"2024-06-02T22:52:08.609690+0000","last_peered":"2024-06-02T22:52:08.609690+0000","last_clean":"2024-06-02T22:52:08.609690+0000","last_became_active":"2024-06-02T22:52:03.576347+0000","last_became_peered":"2024-06-02T22:52:03.576347+0000","last_unstale":"2024-06-02T22:52:08.609690+0000","last_undegraded":"2024-06-02T22:52:08.609690+0000","last_fullsized":"2024-06-02T22:52:08.609690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366345+0000","last_change":"2024-06-02T22:52:03.582428+0000","last_active":"2024-06-02T22:52:09.366345+0000","last_peered":"2024-06-02T22:52:09.366345+0000","last_clean":"2024-06-02T22:52:09.366345+0000","last_became_active":"2024-06-02T22:52:03.582154+0000","last_became_peered":"2024-06-02T22:52:03.582154+0000","last_unstale":"2024-06-02T22:52:09.366345+0000","last_undegraded":"2024-06-02T22:52:09.366345+0000","last_fullsized":"2024-06-02T22:52:09.366345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:32.545502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801844+0000","last_change":"2024-06-02T22:52:03.577725+0000","last_active":"2024-06-02T22:52:09.801844+0000","last_peered":"2024-06-02T22:52:09.801844+0000","last_clean":"2024-06-02T22:52:09.801844+0000","last_became_active":"2024-06-02T22:52:03.577449+0000","last_became_peered":"2024-06-02T22:52:03.577449+0000","last_unstale":"2024-06-02T22:52:09.801844+0000","last_undegraded":"2024-06-02T22:52:09.801844+0000","last_fullsized":"2024-06-02T22:52:09.801844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365700+0000","last_change":"2024-06-02T22:52:03.578806+0000","last_active":"2024-06-02T22:52:09.365700+0000","last_peered":"2024-06-02T22:52:09.365700+0000","last_clean":"2024-06-02T22:52:09.365700+0000","last_became_active":"2024-06-02T22:52:03.578505+0000","last_became_peered":"2024-06-02T22:52:03.578505+0000","last_unstale":"2024-06-02T22:52:09.365700+0000","last_undegraded":"2024-06-02T22:52:09.365700+0000","last_fullsized":"2024-06-02T22:52:09.365700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866425+0000","last_change":"2024-06-02T22:52:03.579621+0000","last_active":"2024-06-02T22:52:09.866425+0000","last_peered":"2024-06-02T22:52:09.866425+0000","last_clean":"2024-06-02T22:52:09.866425+0000","last_became_active":"2024-06-02T22:52:03.579140+0000","last_became_peered":"2024-06-02T22:52:03.579140+0000","last_unstale":"2024-06-02T22:52:09.866425+0000","last_undegraded":"2024-06-02T22:52:09.866425+0000","last_fullsized":"2024-06-02T22:52:09.866425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:12.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365766+0000","last_change":"2024-06-02T22:52:03.575446+0000","last_active":"2024-06-02T22:52:09.365766+0000","last_peered":"2024-06-02T22:52:09.365766+0000","last_clean":"2024-06-02T22:52:09.365766+0000","last_became_active":"2024-06-02T22:52:03.573953+0000","last_became_peered":"2024-06-02T22:52:03.573953+0000","last_unstale":"2024-06-02T22:52:09.365766+0000","last_undegraded":"2024-06-02T22:52:09.365766+0000","last_fullsized":"2024-06-02T22:52:09.365766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866605+0000","last_change":"2024-06-02T22:52:03.585130+0000","last_active":"2024-06-02T22:52:09.866605+0000","last_peered":"2024-06-02T22:52:09.866605+0000","last_clean":"2024-06-02T22:52:09.866605+0000","last_became_active":"2024-06-02T22:52:03.584816+0000","last_became_peered":"2024-06-02T22:52:03.584816+0000","last_unstale":"2024-06-02T22:52:09.866605+0000","last_undegraded":"2024-06-02T22:52:09.866605+0000","last_fullsized":"2024-06-02T22:52:09.866605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:02.241694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867276+0000","last_change":"2024-06-02T22:52:03.571403+0000","last_active":"2024-06-02T22:52:09.867276+0000","last_peered":"2024-06-02T22:52:09.867276+0000","last_clean":"2024-06-02T22:52:09.867276+0000","last_became_active":"2024-06-02T22:52:03.568977+0000","last_became_peered":"2024-06-02T22:52:03.568977+0000","last_unstale":"2024-06-02T22:52:09.867276+0000","last_undegraded":"2024-06-02T22:52:09.867276+0000","last_fullsized":"2024-06-02T22:52:09.867276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866695+0000","last_change":"2024-06-02T22:52:03.577758+0000","last_active":"2024-06-02T22:52:09.866695+0000","last_peered":"2024-06-02T22:52:09.866695+0000","last_clean":"2024-06-02T22:52:09.866695+0000","last_became_active":"2024-06-02T22:52:03.577260+0000","last_became_peered":"2024-06-02T22:52:03.577260+0000","last_unstale":"2024-06-02T22:52:09.866695+0000","last_undegraded":"2024-06-02T22:52:09.866695+0000","last_fullsized":"2024-06-02T22:52:09.866695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366256+0000","last_change":"2024-06-02T22:52:03.576942+0000","last_active":"2024-06-02T22:52:09.366256+0000","last_peered":"2024-06-02T22:52:09.366256+0000","last_clean":"2024-06-02T22:52:09.366256+0000","last_became_active":"2024-06-02T22:52:03.576652+0000","last_became_peered":"2024-06-02T22:52:03.576652+0000","last_unstale":"2024-06-02T22:52:09.366256+0000","last_undegraded":"2024-06-02T22:52:09.366256+0000","last_fullsized":"2024-06-02T22:52:09.366256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:53.784824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:52:23.620 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:52:23.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.759+0000 7f5ac3ae1640 1 Processor -- start 2024-06-02T22:52:23.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.759+0000 7f5ac3ae1640 1 -- start start 2024-06-02T22:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.760+0000 7f5ac3ae1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5abc0b2430 0x7f5abc09aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.760+0000 7f5ac3ae1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5abc0b6cd0 con 0x7f5abc15e1f0 2024-06-02T22:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.760+0000 7f5ac3ae1640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5abc0b5800 con 0x7f5abc09aa10 2024-06-02T22:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.760+0000 7f5ac3ae1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5abc15e5d0 con 0x7f5abc0b2430 2024-06-02T22:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.760+0000 7f5ac207e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5abc0b2430 0x7f5abc09aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.760+0000 7f5ac187d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5abc15e1f0 0x7f5abc0b65c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48062/0 (socket says 172.21.15.82:48062) 2024-06-02T22:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.760+0000 7f5ac207e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5abc0b2430 0x7f5abc09aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34274/0 (socket says 172.21.15.82:34274) 2024-06-02T22:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.760+0000 7f5ac187d640 1 -- 172.21.15.82:0/767611382 learned_addr learned my addr 172.21.15.82:0/767611382 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.760+0000 7f5ac207e640 1 -- 172.21.15.82:0/767611382 >> v1:172.21.15.184:6789/0 conn(0x7f5abc09aa10 legacy=0x7f5abc0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.760+0000 7f5ac207e640 1 -- 172.21.15.82:0/767611382 >> v1:172.21.15.82:6789/0 conn(0x7f5abc15e1f0 legacy=0x7f5abc0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.760+0000 7f5ac207e640 1 -- 172.21.15.82:0/767611382 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc0b5ae0 con 0x7f5abc0b2430 2024-06-02T22:52:23.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.761+0000 7f5ac207e640 1 --2- 172.21.15.82:0/767611382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5abc0b2430 0x7f5abc09aea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009dc0 tx=0x7f5ab402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabe6f428dfe912d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:23.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.761+0000 7f5ac087b640 1 -- 172.21.15.82:0/767611382 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4007740 con 0x7f5abc0b2430 2024-06-02T22:52:23.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.761+0000 7f5ac087b640 1 -- 172.21.15.82:0/767611382 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab40078e0 con 0x7f5abc0b2430 2024-06-02T22:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.761+0000 7f5ac087b640 1 -- 172.21.15.82:0/767611382 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4007cb0 con 0x7f5abc0b2430 2024-06-02T22:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.761+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/767611382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5abc0b2430 msgr2=0x7f5abc09aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.761+0000 7f5ac3ae1640 1 --2- 172.21.15.82:0/767611382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5abc0b2430 0x7f5abc09aea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009dc0 tx=0x7f5ab402a6d0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.762+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/767611382 shutdown_connections 2024-06-02T22:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.762+0000 7f5ac3ae1640 1 --2- 172.21.15.82:0/767611382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5abc0b2430 0x7f5abc09aea0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.762+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/767611382 >> 172.21.15.82:0/767611382 conn(0x7f5abc0b7270 msgr2=0x7f5abc0b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.762+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/767611382 shutdown_connections 2024-06-02T22:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.762+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/767611382 wait complete. 2024-06-02T22:52:23.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.763+0000 7f5ac3ae1640 1 Processor -- start 2024-06-02T22:52:23.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.763+0000 7f5ac3ae1640 1 -- start start 2024-06-02T22:52:23.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac3ae1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5abc09aa10 0x7f5abc1e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac3ae1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5abc0b2430 0x7f5abc1f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac3ae1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc15e1f0 0x7f5abc1f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac3ae1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc0d2b80 con 0x7f5abc09aa10 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac3ae1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc0b60a0 con 0x7f5abc15e1f0 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac3ae1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5abc0d1e50 con 0x7f5abc0b2430 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac187d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5abc09aa10 0x7f5abc1e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac187d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5abc09aa10 0x7f5abc1e8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34282/0 (socket says 172.21.15.82:34282) 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac187d640 1 -- 172.21.15.82:0/1704705907 learned_addr learned my addr 172.21.15.82:0/1704705907 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac207e640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc15e1f0 0x7f5abc1f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac107c640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5abc0b2430 0x7f5abc1f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac187d640 1 -- 172.21.15.82:0/1704705907 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5abc0b2430 msgr2=0x7f5abc1f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac187d640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5abc0b2430 0x7f5abc1f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac187d640 1 -- 172.21.15.82:0/1704705907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc15e1f0 msgr2=0x7f5abc1f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac187d640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc15e1f0 0x7f5abc1f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac187d640 1 -- 172.21.15.82:0/1704705907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc1f6010 con 0x7f5abc09aa10 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac107c640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5abc0b2430 0x7f5abc1f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:23.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac187d640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5abc09aa10 0x7f5abc1e8c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800c3f0 tx=0x7f5ab800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:23.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ab27fc640 1 -- 172.21.15.82:0/1704705907 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8017070 con 0x7f5abc09aa10 2024-06-02T22:52:23.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ab27fc640 1 -- 172.21.15.82:0/1704705907 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab8005ce0 con 0x7f5abc09aa10 2024-06-02T22:52:23.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ab27fc640 1 -- 172.21.15.82:0/1704705907 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80072f0 con 0x7f5abc09aa10 2024-06-02T22:52:23.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/1704705907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5abc1f62f0 con 0x7f5abc09aa10 2024-06-02T22:52:23.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.764+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/1704705907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5abc1f68b0 con 0x7f5abc09aa10 2024-06-02T22:52:23.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.765+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/1704705907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5abc068ad0 con 0x7f5abc09aa10 2024-06-02T22:52:23.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.766+0000 7f5ab27fc640 1 -- 172.21.15.82:0/1704705907 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ab801a070 con 0x7f5abc09aa10 2024-06-02T22:52:23.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.766+0000 7f5ab27fc640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aa006be30 0x7f5aa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:23.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.766+0000 7f5ab27fc640 1 -- 172.21.15.82:0/1704705907 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5ab808a470 con 0x7f5abc09aa10 2024-06-02T22:52:23.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.766+0000 7f5ac107c640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aa006be30 0x7f5aa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:23.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.767+0000 7f5ac107c640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aa006be30 0x7f5aa006e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5abc1f7990 tx=0x7f5aac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:23.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.771+0000 7f5ab27fc640 1 -- 172.21.15.82:0/1704705907 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5ab8058b70 con 0x7f5abc09aa10 2024-06-02T22:52:23.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.948+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/1704705907 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5abc15d9a0 con 0x7f5aa006be30 2024-06-02T22:52:23.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.956+0000 7f5ab27fc640 1 -- 172.21.15.82:0/1704705907 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f5aac069310 con 0x7f5aa006be30 2024-06-02T22:52:23.959 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:52:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/1704705907 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aa006be30 msgr2=0x7f5aa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aa006be30 0x7f5aa006e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5abc1f7990 tx=0x7f5aac009040 comp rx=0 tx=0).stop 2024-06-02T22:52:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/1704705907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5abc09aa10 msgr2=0x7f5abc1e8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5abc09aa10 0x7f5abc1e8c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800c3f0 tx=0x7f5ab800c8b0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/1704705907 shutdown_connections 2024-06-02T22:52:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aa006be30 0x7f5aa006e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5abc15e1f0 0x7f5abc1f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5abc0b2430 0x7f5abc1f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 --2- 172.21.15.82:0/1704705907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5abc09aa10 0x7f5abc1e8c50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/1704705907 >> 172.21.15.82:0/1704705907 conn(0x7f5abc0b7270 msgr2=0x7f5abc0b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/1704705907 shutdown_connections 2024-06-02T22:52:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:23.960+0000 7f5ac3ae1640 1 -- 172.21.15.82:0/1704705907 wait complete. 2024-06-02T22:52:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-06-02T22:52:23.826584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002521"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867448+0000","last_change":"2024-06-02T22:52:02.575295+0000","last_active":"2024-06-02T22:52:09.867448+0000","last_peered":"2024-06-02T22:52:09.867448+0000","last_clean":"2024-06-02T22:52:09.867448+0000","last_became_active":"2024-06-02T22:52:02.575023+0000","last_became_peered":"2024-06-02T22:52:02.575023+0000","last_unstale":"2024-06-02T22:52:09.867448+0000","last_undegraded":"2024-06-02T22:52:09.867448+0000","last_fullsized":"2024-06-02T22:52:09.867448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:31:16.566686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802284+0000","last_change":"2024-06-02T22:52:03.580611+0000","last_active":"2024-06-02T22:52:09.802284+0000","last_peered":"2024-06-02T22:52:09.802284+0000","last_clean":"2024-06-02T22:52:09.802284+0000","last_became_active":"2024-06-02T22:52:03.580225+0000","last_became_peered":"2024-06-02T22:52:03.580225+0000","last_unstale":"2024-06-02T22:52:09.802284+0000","last_undegraded":"2024-06-02T22:52:09.802284+0000","last_fullsized":"2024-06-02T22:52:09.802284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801869+0000","last_change":"2024-06-02T22:52:07.615955+0000","last_active":"2024-06-02T22:52:09.801869+0000","last_peered":"2024-06-02T22:52:09.801869+0000","last_clean":"2024-06-02T22:52:09.801869+0000","last_became_active":"2024-06-02T22:52:07.615566+0000","last_became_peered":"2024-06-02T22:52:07.615566+0000","last_unstale":"2024-06-02T22:52:09.801869+0000","last_undegraded":"2024-06-02T22:52:09.801869+0000","last_fullsized":"2024-06-02T22:52:09.801869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:27:30.054564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802388+0000","last_change":"2024-06-02T22:52:02.574379+0000","last_active":"2024-06-02T22:52:09.802388+0000","last_peered":"2024-06-02T22:52:09.802388+0000","last_clean":"2024-06-02T22:52:09.802388+0000","last_became_active":"2024-06-02T22:52:02.574045+0000","last_became_peered":"2024-06-02T22:52:02.574045+0000","last_unstale":"2024-06-02T22:52:09.802388+0000","last_undegraded":"2024-06-02T22:52:09.802388+0000","last_fullsized":"2024-06-02T22:52:09.802388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867282+0000","last_change":"2024-06-02T22:52:03.576563+0000","last_active":"2024-06-02T22:52:09.867282+0000","last_peered":"2024-06-02T22:52:09.867282+0000","last_clean":"2024-06-02T22:52:09.867282+0000","last_became_active":"2024-06-02T22:52:03.576270+0000","last_became_peered":"2024-06-02T22:52:03.576270+0000","last_unstale":"2024-06-02T22:52:09.867282+0000","last_undegraded":"2024-06-02T22:52:09.867282+0000","last_fullsized":"2024-06-02T22:52:09.867282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:18:18.561237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608375+0000","last_change":"2024-06-02T22:52:07.602568+0000","last_active":"2024-06-02T22:52:08.608375+0000","last_peered":"2024-06-02T22:52:08.608375+0000","last_clean":"2024-06-02T22:52:08.608375+0000","last_became_active":"2024-06-02T22:52:07.602120+0000","last_became_peered":"2024-06-02T22:52:07.602120+0000","last_unstale":"2024-06-02T22:52:08.608375+0000","last_undegraded":"2024-06-02T22:52:08.608375+0000","last_fullsized":"2024-06-02T22:52:08.608375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:47.081866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366155+0000","last_change":"2024-06-02T22:52:02.571940+0000","last_active":"2024-06-02T22:52:09.366155+0000","last_peered":"2024-06-02T22:52:09.366155+0000","last_clean":"2024-06-02T22:52:09.366155+0000","last_became_active":"2024-06-02T22:52:02.571659+0000","last_became_peered":"2024-06-02T22:52:02.571659+0000","last_unstale":"2024-06-02T22:52:09.366155+0000","last_undegraded":"2024-06-02T22:52:09.366155+0000","last_fullsized":"2024-06-02T22:52:09.366155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:38:20.818313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866687+0000","last_change":"2024-06-02T22:52:03.585947+0000","last_active":"2024-06-02T22:52:09.866687+0000","last_peered":"2024-06-02T22:52:09.866687+0000","last_clean":"2024-06-02T22:52:09.866687+0000","last_became_active":"2024-06-02T22:52:03.585500+0000","last_became_peered":"2024-06-02T22:52:03.585500+0000","last_unstale":"2024-06-02T22:52:09.866687+0000","last_undegraded":"2024-06-02T22:52:09.866687+0000","last_fullsized":"2024-06-02T22:52:09.866687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609695+0000","last_change":"2024-06-02T22:52:07.601710+0000","last_active":"2024-06-02T22:52:08.609695+0000","last_peered":"2024-06-02T22:52:08.609695+0000","last_clean":"2024-06-02T22:52:08.609695+0000","last_became_active":"2024-06-02T22:52:07.601102+0000","last_became_peered":"2024-06-02T22:52:07.601102+0000","last_unstale":"2024-06-02T22:52:08.609695+0000","last_undegraded":"2024-06-02T22:52:08.609695+0000","last_fullsized":"2024-06-02T22:52:08.609695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365966+0000","last_change":"2024-06-02T22:52:02.571116+0000","last_active":"2024-06-02T22:52:09.365966+0000","last_peered":"2024-06-02T22:52:09.365966+0000","last_clean":"2024-06-02T22:52:09.365966+0000","last_became_active":"2024-06-02T22:52:02.570844+0000","last_became_peered":"2024-06-02T22:52:02.570844+0000","last_unstale":"2024-06-02T22:52:09.365966+0000","last_undegraded":"2024-06-02T22:52:09.365966+0000","last_fullsized":"2024-06-02T22:52:09.365966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:29.459302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866964+0000","last_change":"2024-06-02T22:52:03.586616+0000","last_active":"2024-06-02T22:52:09.866964+0000","last_peered":"2024-06-02T22:52:09.866964+0000","last_clean":"2024-06-02T22:52:09.866964+0000","last_became_active":"2024-06-02T22:52:03.586329+0000","last_became_peered":"2024-06-02T22:52:03.586329+0000","last_unstale":"2024-06-02T22:52:09.866964+0000","last_undegraded":"2024-06-02T22:52:09.866964+0000","last_fullsized":"2024-06-02T22:52:09.866964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:53.784824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608637+0000","last_change":"2024-06-02T22:52:07.601892+0000","last_active":"2024-06-02T22:52:08.608637+0000","last_peered":"2024-06-02T22:52:08.608637+0000","last_clean":"2024-06-02T22:52:08.608637+0000","last_became_active":"2024-06-02T22:52:07.601456+0000","last_became_peered":"2024-06-02T22:52:07.601456+0000","last_unstale":"2024-06-02T22:52:08.608637+0000","last_undegraded":"2024-06-02T22:52:08.608637+0000","last_fullsized":"2024-06-02T22:52:08.608637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:36.100904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609102+0000","last_change":"2024-06-02T22:52:03.565750+0000","last_active":"2024-06-02T22:52:08.609102+0000","last_peered":"2024-06-02T22:52:08.609102+0000","last_clean":"2024-06-02T22:52:08.609102+0000","last_became_active":"2024-06-02T22:52:03.565467+0000","last_became_peered":"2024-06-02T22:52:03.565467+0000","last_unstale":"2024-06-02T22:52:08.609102+0000","last_undegraded":"2024-06-02T22:52:08.609102+0000","last_fullsized":"2024-06-02T22:52:08.609102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365983+0000","last_change":"2024-06-02T22:52:02.570379+0000","last_active":"2024-06-02T22:52:09.365983+0000","last_peered":"2024-06-02T22:52:09.365983+0000","last_clean":"2024-06-02T22:52:09.365983+0000","last_became_active":"2024-06-02T22:52:02.570030+0000","last_became_peered":"2024-06-02T22:52:02.570030+0000","last_unstale":"2024-06-02T22:52:09.365983+0000","last_undegraded":"2024-06-02T22:52:09.365983+0000","last_fullsized":"2024-06-02T22:52:09.365983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:22.565230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609584+0000","last_change":"2024-06-02T22:52:07.595784+0000","last_active":"2024-06-02T22:52:08.609584+0000","last_peered":"2024-06-02T22:52:08.609584+0000","last_clean":"2024-06-02T22:52:08.609584+0000","last_became_active":"2024-06-02T22:52:07.595380+0000","last_became_peered":"2024-06-02T22:52:07.595380+0000","last_unstale":"2024-06-02T22:52:08.609584+0000","last_undegraded":"2024-06-02T22:52:08.609584+0000","last_fullsized":"2024-06-02T22:52:08.609584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:58.268207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802173+0000","last_change":"2024-06-02T22:52:03.576639+0000","last_active":"2024-06-02T22:52:09.802173+0000","last_peered":"2024-06-02T22:52:09.802173+0000","last_clean":"2024-06-02T22:52:09.802173+0000","last_became_active":"2024-06-02T22:52:03.576309+0000","last_became_peered":"2024-06-02T22:52:03.576309+0000","last_unstale":"2024-06-02T22:52:09.802173+0000","last_undegraded":"2024-06-02T22:52:09.802173+0000","last_fullsized":"2024-06-02T22:52:09.802173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:12.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867086+0000","last_change":"2024-06-02T22:52:02.571697+0000","last_active":"2024-06-02T22:52:09.867086+0000","last_peered":"2024-06-02T22:52:09.867086+0000","last_clean":"2024-06-02T22:52:09.867086+0000","last_became_active":"2024-06-02T22:52:02.571334+0000","last_became_peered":"2024-06-02T22:52:02.571334+0000","last_unstale":"2024-06-02T22:52:09.867086+0000","last_undegraded":"2024-06-02T22:52:09.867086+0000","last_fullsized":"2024-06-02T22:52:09.867086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608904+0000","last_change":"2024-06-02T22:52:07.602282+0000","last_active":"2024-06-02T22:52:08.608904+0000","last_peered":"2024-06-02T22:52:08.608904+0000","last_clean":"2024-06-02T22:52:08.608904+0000","last_became_active":"2024-06-02T22:52:07.601727+0000","last_became_peered":"2024-06-02T22:52:07.601727+0000","last_unstale":"2024-06-02T22:52:08.608904+0000","last_undegraded":"2024-06-02T22:52:08.608904+0000","last_fullsized":"2024-06-02T22:52:08.608904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:16.624490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802324+0000","last_change":"2024-06-02T22:52:03.581537+0000","last_active":"2024-06-02T22:52:09.802324+0000","last_peered":"2024-06-02T22:52:09.802324+0000","last_clean":"2024-06-02T22:52:09.802324+0000","last_became_active":"2024-06-02T22:52:03.581246+0000","last_became_peered":"2024-06-02T22:52:03.581246+0000","last_unstale":"2024-06-02T22:52:09.802324+0000","last_undegraded":"2024-06-02T22:52:09.802324+0000","last_fullsized":"2024-06-02T22:52:09.802324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866507+0000","last_change":"2024-06-02T22:52:02.572402+0000","last_active":"2024-06-02T22:52:09.866507+0000","last_peered":"2024-06-02T22:52:09.866507+0000","last_clean":"2024-06-02T22:52:09.866507+0000","last_became_active":"2024-06-02T22:52:02.572115+0000","last_became_peered":"2024-06-02T22:52:02.572115+0000","last_unstale":"2024-06-02T22:52:09.866507+0000","last_undegraded":"2024-06-02T22:52:09.866507+0000","last_fullsized":"2024-06-02T22:52:09.866507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866967+0000","last_change":"2024-06-02T22:52:07.612631+0000","last_active":"2024-06-02T22:52:09.866967+0000","last_peered":"2024-06-02T22:52:09.866967+0000","last_clean":"2024-06-02T22:52:09.866967+0000","last_became_active":"2024-06-02T22:52:07.612232+0000","last_became_peered":"2024-06-02T22:52:07.612232+0000","last_unstale":"2024-06-02T22:52:09.866967+0000","last_undegraded":"2024-06-02T22:52:09.866967+0000","last_fullsized":"2024-06-02T22:52:09.866967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:06.782146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609382+0000","last_change":"2024-06-02T22:52:03.572261+0000","last_active":"2024-06-02T22:52:08.609382+0000","last_peered":"2024-06-02T22:52:08.609382+0000","last_clean":"2024-06-02T22:52:08.609382+0000","last_became_active":"2024-06-02T22:52:03.571880+0000","last_became_peered":"2024-06-02T22:52:03.571880+0000","last_unstale":"2024-06-02T22:52:08.609382+0000","last_undegraded":"2024-06-02T22:52:08.609382+0000","last_fullsized":"2024-06-02T22:52:08.609382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:12.138755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365549+0000","last_change":"2024-06-02T22:52:02.577529+0000","last_active":"2024-06-02T22:52:09.365549+0000","last_peered":"2024-06-02T22:52:09.365549+0000","last_clean":"2024-06-02T22:52:09.365549+0000","last_became_active":"2024-06-02T22:52:02.577284+0000","last_became_peered":"2024-06-02T22:52:02.577284+0000","last_unstale":"2024-06-02T22:52:09.365549+0000","last_undegraded":"2024-06-02T22:52:09.365549+0000","last_fullsized":"2024-06-02T22:52:09.365549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608462+0000","last_change":"2024-06-02T22:52:07.602336+0000","last_active":"2024-06-02T22:52:08.608462+0000","last_peered":"2024-06-02T22:52:08.608462+0000","last_clean":"2024-06-02T22:52:08.608462+0000","last_became_active":"2024-06-02T22:52:07.601622+0000","last_became_peered":"2024-06-02T22:52:07.601622+0000","last_unstale":"2024-06-02T22:52:08.608462+0000","last_undegraded":"2024-06-02T22:52:08.608462+0000","last_fullsized":"2024-06-02T22:52:08.608462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:51.634356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867716+0000","last_change":"2024-06-02T22:52:03.572653+0000","last_active":"2024-06-02T22:52:09.867716+0000","last_peered":"2024-06-02T22:52:09.867716+0000","last_clean":"2024-06-02T22:52:09.867716+0000","last_became_active":"2024-06-02T22:52:03.570668+0000","last_became_peered":"2024-06-02T22:52:03.570668+0000","last_unstale":"2024-06-02T22:52:09.867716+0000","last_undegraded":"2024-06-02T22:52:09.867716+0000","last_fullsized":"2024-06-02T22:52:09.867716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609605+0000","last_change":"2024-06-02T22:52:02.567590+0000","last_active":"2024-06-02T22:52:08.609605+0000","last_peered":"2024-06-02T22:52:08.609605+0000","last_clean":"2024-06-02T22:52:08.609605+0000","last_became_active":"2024-06-02T22:52:02.567282+0000","last_became_peered":"2024-06-02T22:52:02.567282+0000","last_unstale":"2024-06-02T22:52:08.609605+0000","last_undegraded":"2024-06-02T22:52:08.609605+0000","last_fullsized":"2024-06-02T22:52:08.609605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609106+0000","last_change":"2024-06-02T22:52:07.612665+0000","last_active":"2024-06-02T22:52:08.609106+0000","last_peered":"2024-06-02T22:52:08.609106+0000","last_clean":"2024-06-02T22:52:08.609106+0000","last_became_active":"2024-06-02T22:52:07.612285+0000","last_became_peered":"2024-06-02T22:52:07.612285+0000","last_unstale":"2024-06-02T22:52:08.609106+0000","last_undegraded":"2024-06-02T22:52:08.609106+0000","last_fullsized":"2024-06-02T22:52:08.609106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:16.674095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802607+0000","last_change":"2024-06-02T22:52:03.582904+0000","last_active":"2024-06-02T22:52:09.802607+0000","last_peered":"2024-06-02T22:52:09.802607+0000","last_clean":"2024-06-02T22:52:09.802607+0000","last_became_active":"2024-06-02T22:52:03.582518+0000","last_became_peered":"2024-06-02T22:52:03.582518+0000","last_unstale":"2024-06-02T22:52:09.802607+0000","last_undegraded":"2024-06-02T22:52:09.802607+0000","last_fullsized":"2024-06-02T22:52:09.802607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866796+0000","last_change":"2024-06-02T22:52:02.573748+0000","last_active":"2024-06-02T22:52:09.866796+0000","last_peered":"2024-06-02T22:52:09.866796+0000","last_clean":"2024-06-02T22:52:09.866796+0000","last_became_active":"2024-06-02T22:52:02.573176+0000","last_became_peered":"2024-06-02T22:52:02.573176+0000","last_unstale":"2024-06-02T22:52:09.866796+0000","last_undegraded":"2024-06-02T22:52:09.866796+0000","last_fullsized":"2024-06-02T22:52:09.866796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801791+0000","last_change":"2024-06-02T22:52:07.616184+0000","last_active":"2024-06-02T22:52:09.801791+0000","last_peered":"2024-06-02T22:52:09.801791+0000","last_clean":"2024-06-02T22:52:09.801791+0000","last_became_active":"2024-06-02T22:52:07.615819+0000","last_became_peered":"2024-06-02T22:52:07.615819+0000","last_unstale":"2024-06-02T22:52:09.801791+0000","last_undegraded":"2024-06-02T22:52:09.801791+0000","last_fullsized":"2024-06-02T22:52:09.801791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:19.408730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867127+0000","last_change":"2024-06-02T22:52:03.569758+0000","last_active":"2024-06-02T22:52:09.867127+0000","last_peered":"2024-06-02T22:52:09.867127+0000","last_clean":"2024-06-02T22:52:09.867127+0000","last_became_active":"2024-06-02T22:52:03.569452+0000","last_became_peered":"2024-06-02T22:52:03.569452+0000","last_unstale":"2024-06-02T22:52:09.867127+0000","last_undegraded":"2024-06-02T22:52:09.867127+0000","last_fullsized":"2024-06-02T22:52:09.867127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366261+0000","last_change":"2024-06-02T22:52:02.580385+0000","last_active":"2024-06-02T22:52:09.366261+0000","last_peered":"2024-06-02T22:52:09.366261+0000","last_clean":"2024-06-02T22:52:09.366261+0000","last_became_active":"2024-06-02T22:52:02.580155+0000","last_became_peered":"2024-06-02T22:52:02.580155+0000","last_unstale":"2024-06-02T22:52:09.366261+0000","last_undegraded":"2024-06-02T22:52:09.366261+0000","last_fullsized":"2024-06-02T22:52:09.366261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:13:02.259557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866547+0000","last_change":"2024-06-02T22:52:07.613087+0000","last_active":"2024-06-02T22:52:09.866547+0000","last_peered":"2024-06-02T22:52:09.866547+0000","last_clean":"2024-06-02T22:52:09.866547+0000","last_became_active":"2024-06-02T22:52:07.612654+0000","last_became_peered":"2024-06-02T22:52:07.612654+0000","last_unstale":"2024-06-02T22:52:09.866547+0000","last_undegraded":"2024-06-02T22:52:09.866547+0000","last_fullsized":"2024-06-02T22:52:09.866547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867078+0000","last_change":"2024-06-02T22:52:03.582326+0000","last_active":"2024-06-02T22:52:09.867078+0000","last_peered":"2024-06-02T22:52:09.867078+0000","last_clean":"2024-06-02T22:52:09.867078+0000","last_became_active":"2024-06-02T22:52:03.581989+0000","last_became_peered":"2024-06-02T22:52:03.581989+0000","last_unstale":"2024-06-02T22:52:09.867078+0000","last_undegraded":"2024-06-02T22:52:09.867078+0000","last_fullsized":"2024-06-02T22:52:09.867078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:32.545502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867218+0000","last_change":"2024-06-02T22:52:02.574632+0000","last_active":"2024-06-02T22:52:09.867218+0000","last_peered":"2024-06-02T22:52:09.867218+0000","last_clean":"2024-06-02T22:52:09.867218+0000","last_became_active":"2024-06-02T22:52:02.573272+0000","last_became_peered":"2024-06-02T22:52:02.573272+0000","last_unstale":"2024-06-02T22:52:09.867218+0000","last_undegraded":"2024-06-02T22:52:09.867218+0000","last_fullsized":"2024-06-02T22:52:09.867218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:29.459302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866384+0000","last_change":"2024-06-02T22:52:07.598965+0000","last_active":"2024-06-02T22:52:09.866384+0000","last_peered":"2024-06-02T22:52:09.866384+0000","last_clean":"2024-06-02T22:52:09.866384+0000","last_became_active":"2024-06-02T22:52:07.597987+0000","last_became_peered":"2024-06-02T22:52:07.597987+0000","last_unstale":"2024-06-02T22:52:09.866384+0000","last_undegraded":"2024-06-02T22:52:09.866384+0000","last_fullsized":"2024-06-02T22:52:09.866384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609823+0000","last_change":"2024-06-02T22:52:03.566069+0000","last_active":"2024-06-02T22:52:08.609823+0000","last_peered":"2024-06-02T22:52:08.609823+0000","last_clean":"2024-06-02T22:52:08.609823+0000","last_became_active":"2024-06-02T22:52:03.565771+0000","last_became_peered":"2024-06-02T22:52:03.565771+0000","last_unstale":"2024-06-02T22:52:08.609823+0000","last_undegraded":"2024-06-02T22:52:08.609823+0000","last_fullsized":"2024-06-02T22:52:08.609823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:21.517626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866865+0000","last_change":"2024-06-02T22:52:02.568991+0000","last_active":"2024-06-02T22:52:09.866865+0000","last_peered":"2024-06-02T22:52:09.866865+0000","last_clean":"2024-06-02T22:52:09.866865+0000","last_became_active":"2024-06-02T22:52:02.568707+0000","last_became_peered":"2024-06-02T22:52:02.568707+0000","last_unstale":"2024-06-02T22:52:09.866865+0000","last_undegraded":"2024-06-02T22:52:09.866865+0000","last_fullsized":"2024-06-02T22:52:09.866865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867124+0000","last_change":"2024-06-02T22:52:07.599911+0000","last_active":"2024-06-02T22:52:09.867124+0000","last_peered":"2024-06-02T22:52:09.867124+0000","last_clean":"2024-06-02T22:52:09.867124+0000","last_became_active":"2024-06-02T22:52:07.599511+0000","last_became_peered":"2024-06-02T22:52:07.599511+0000","last_unstale":"2024-06-02T22:52:09.867124+0000","last_undegraded":"2024-06-02T22:52:09.867124+0000","last_fullsized":"2024-06-02T22:52:09.867124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:12.840435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867482+0000","last_change":"2024-06-02T22:52:03.569708+0000","last_active":"2024-06-02T22:52:09.867482+0000","last_peered":"2024-06-02T22:52:09.867482+0000","last_clean":"2024-06-02T22:52:09.867482+0000","last_became_active":"2024-06-02T22:52:03.568694+0000","last_became_peered":"2024-06-02T22:52:03.568694+0000","last_unstale":"2024-06-02T22:52:09.867482+0000","last_undegraded":"2024-06-02T22:52:09.867482+0000","last_fullsized":"2024-06-02T22:52:09.867482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610009+0000","last_change":"2024-06-02T22:52:02.567971+0000","last_active":"2024-06-02T22:52:08.610009+0000","last_peered":"2024-06-02T22:52:08.610009+0000","last_clean":"2024-06-02T22:52:08.610009+0000","last_became_active":"2024-06-02T22:52:02.567623+0000","last_became_peered":"2024-06-02T22:52:02.567623+0000","last_unstale":"2024-06-02T22:52:08.610009+0000","last_undegraded":"2024-06-02T22:52:08.610009+0000","last_fullsized":"2024-06-02T22:52:08.610009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866990+0000","last_change":"2024-06-02T22:52:07.602117+0000","last_active":"2024-06-02T22:52:09.866990+0000","last_peered":"2024-06-02T22:52:09.866990+0000","last_clean":"2024-06-02T22:52:09.866990+0000","last_became_active":"2024-06-02T22:52:07.599651+0000","last_became_peered":"2024-06-02T22:52:07.599651+0000","last_unstale":"2024-06-02T22:52:09.866990+0000","last_undegraded":"2024-06-02T22:52:09.866990+0000","last_fullsized":"2024-06-02T22:52:09.866990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:36.573360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866296+0000","last_change":"2024-06-02T22:52:03.563190+0000","last_active":"2024-06-02T22:52:09.866296+0000","last_peered":"2024-06-02T22:52:09.866296+0000","last_clean":"2024-06-02T22:52:09.866296+0000","last_became_active":"2024-06-02T22:52:03.562873+0000","last_became_peered":"2024-06-02T22:52:03.562873+0000","last_unstale":"2024-06-02T22:52:09.866296+0000","last_undegraded":"2024-06-02T22:52:09.866296+0000","last_fullsized":"2024-06-02T22:52:09.866296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:31.146827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365584+0000","last_change":"2024-06-02T22:52:02.570735+0000","last_active":"2024-06-02T22:52:09.365584+0000","last_peered":"2024-06-02T22:52:09.365584+0000","last_clean":"2024-06-02T22:52:09.365584+0000","last_became_active":"2024-06-02T22:52:02.570459+0000","last_became_peered":"2024-06-02T22:52:02.570459+0000","last_unstale":"2024-06-02T22:52:09.365584+0000","last_undegraded":"2024-06-02T22:52:09.365584+0000","last_fullsized":"2024-06-02T22:52:09.365584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867640+0000","last_change":"2024-06-02T22:52:07.612607+0000","last_active":"2024-06-02T22:52:09.867640+0000","last_peered":"2024-06-02T22:52:09.867640+0000","last_clean":"2024-06-02T22:52:09.867640+0000","last_became_active":"2024-06-02T22:52:07.612210+0000","last_became_peered":"2024-06-02T22:52:07.612210+0000","last_unstale":"2024-06-02T22:52:09.867640+0000","last_undegraded":"2024-06-02T22:52:09.867640+0000","last_fullsized":"2024-06-02T22:52:09.867640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:12.840435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802134+0000","last_change":"2024-06-02T22:52:03.581959+0000","last_active":"2024-06-02T22:52:09.802134+0000","last_peered":"2024-06-02T22:52:09.802134+0000","last_clean":"2024-06-02T22:52:09.802134+0000","last_became_active":"2024-06-02T22:52:03.581625+0000","last_became_peered":"2024-06-02T22:52:03.581625+0000","last_unstale":"2024-06-02T22:52:09.802134+0000","last_undegraded":"2024-06-02T22:52:09.802134+0000","last_fullsized":"2024-06-02T22:52:09.802134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866575+0000","last_change":"2024-06-02T22:52:02.565526+0000","last_active":"2024-06-02T22:52:09.866575+0000","last_peered":"2024-06-02T22:52:09.866575+0000","last_clean":"2024-06-02T22:52:09.866575+0000","last_became_active":"2024-06-02T22:52:02.565197+0000","last_became_peered":"2024-06-02T22:52:02.565197+0000","last_unstale":"2024-06-02T22:52:09.866575+0000","last_undegraded":"2024-06-02T22:52:09.866575+0000","last_fullsized":"2024-06-02T22:52:09.866575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365701+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:52:09.365701+0000","last_peered":"2024-06-02T22:52:09.365701+0000","last_clean":"2024-06-02T22:52:09.365701+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:52:09.365701+0000","last_undegraded":"2024-06-02T22:52:09.365701+0000","last_fullsized":"2024-06-02T22:52:09.365701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608822+0000","last_change":"2024-06-02T22:52:07.615952+0000","last_active":"2024-06-02T22:52:08.608822+0000","last_peered":"2024-06-02T22:52:08.608822+0000","last_clean":"2024-06-02T22:52:08.608822+0000","last_became_active":"2024-06-02T22:52:07.615538+0000","last_became_peered":"2024-06-02T22:52:07.615538+0000","last_unstale":"2024-06-02T22:52:08.608822+0000","last_undegraded":"2024-06-02T22:52:08.608822+0000","last_fullsized":"2024-06-02T22:52:08.608822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:11.213283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366025+0000","last_change":"2024-06-02T22:52:03.577819+0000","last_active":"2024-06-02T22:52:09.366025+0000","last_peered":"2024-06-02T22:52:09.366025+0000","last_clean":"2024-06-02T22:52:09.366025+0000","last_became_active":"2024-06-02T22:52:03.577525+0000","last_became_peered":"2024-06-02T22:52:03.577525+0000","last_unstale":"2024-06-02T22:52:09.366025+0000","last_undegraded":"2024-06-02T22:52:09.366025+0000","last_fullsized":"2024-06-02T22:52:09.366025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:02.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610185+0000","last_change":"2024-06-02T22:52:02.565482+0000","last_active":"2024-06-02T22:52:08.610185+0000","last_peered":"2024-06-02T22:52:08.610185+0000","last_clean":"2024-06-02T22:52:08.610185+0000","last_became_active":"2024-06-02T22:52:02.565172+0000","last_became_peered":"2024-06-02T22:52:02.565172+0000","last_unstale":"2024-06-02T22:52:08.610185+0000","last_undegraded":"2024-06-02T22:52:08.610185+0000","last_fullsized":"2024-06-02T22:52:08.610185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:37:05.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608322+0000","last_change":"2024-06-02T22:52:07.612701+0000","last_active":"2024-06-02T22:52:08.608322+0000","last_peered":"2024-06-02T22:52:08.608322+0000","last_clean":"2024-06-02T22:52:08.608322+0000","last_became_active":"2024-06-02T22:52:07.612260+0000","last_became_peered":"2024-06-02T22:52:07.612260+0000","last_unstale":"2024-06-02T22:52:08.608322+0000","last_undegraded":"2024-06-02T22:52:08.608322+0000","last_fullsized":"2024-06-02T22:52:08.608322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:47.081866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866731+0000","last_change":"2024-06-02T22:52:03.587460+0000","last_active":"2024-06-02T22:52:09.866731+0000","last_peered":"2024-06-02T22:52:09.866731+0000","last_clean":"2024-06-02T22:52:09.866731+0000","last_became_active":"2024-06-02T22:52:03.587183+0000","last_became_peered":"2024-06-02T22:52:03.587183+0000","last_unstale":"2024-06-02T22:52:09.866731+0000","last_undegraded":"2024-06-02T22:52:09.866731+0000","last_fullsized":"2024-06-02T22:52:09.866731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:43.054007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866861+0000","last_change":"2024-06-02T22:52:02.570822+0000","last_active":"2024-06-02T22:52:09.866861+0000","last_peered":"2024-06-02T22:52:09.866861+0000","last_clean":"2024-06-02T22:52:09.866861+0000","last_became_active":"2024-06-02T22:52:02.570425+0000","last_became_peered":"2024-06-02T22:52:02.570425+0000","last_unstale":"2024-06-02T22:52:09.866861+0000","last_undegraded":"2024-06-02T22:52:09.866861+0000","last_fullsized":"2024-06-02T22:52:09.866861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:22.565230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866793+0000","last_change":"2024-06-02T22:52:07.596605+0000","last_active":"2024-06-02T22:52:09.866793+0000","last_peered":"2024-06-02T22:52:09.866793+0000","last_clean":"2024-06-02T22:52:09.866793+0000","last_became_active":"2024-06-02T22:52:07.596062+0000","last_became_peered":"2024-06-02T22:52:07.596062+0000","last_unstale":"2024-06-02T22:52:09.866793+0000","last_undegraded":"2024-06-02T22:52:09.866793+0000","last_fullsized":"2024-06-02T22:52:09.866793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:57.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366406+0000","last_change":"2024-06-02T22:52:03.583665+0000","last_active":"2024-06-02T22:52:09.366406+0000","last_peered":"2024-06-02T22:52:09.366406+0000","last_clean":"2024-06-02T22:52:09.366406+0000","last_became_active":"2024-06-02T22:52:03.583405+0000","last_became_peered":"2024-06-02T22:52:03.583405+0000","last_unstale":"2024-06-02T22:52:09.366406+0000","last_undegraded":"2024-06-02T22:52:09.366406+0000","last_fullsized":"2024-06-02T22:52:09.366406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.055543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610318+0000","last_change":"2024-06-02T22:52:02.568513+0000","last_active":"2024-06-02T22:52:08.610318+0000","last_peered":"2024-06-02T22:52:08.610318+0000","last_clean":"2024-06-02T22:52:08.610318+0000","last_became_active":"2024-06-02T22:52:02.567653+0000","last_became_peered":"2024-06-02T22:52:02.567653+0000","last_unstale":"2024-06-02T22:52:08.610318+0000","last_undegraded":"2024-06-02T22:52:08.610318+0000","last_fullsized":"2024-06-02T22:52:08.610318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866292+0000","last_change":"2024-06-02T22:52:07.612655+0000","last_active":"2024-06-02T22:52:09.866292+0000","last_peered":"2024-06-02T22:52:09.866292+0000","last_clean":"2024-06-02T22:52:09.866292+0000","last_became_active":"2024-06-02T22:52:07.612255+0000","last_became_peered":"2024-06-02T22:52:07.612255+0000","last_unstale":"2024-06-02T22:52:09.866292+0000","last_undegraded":"2024-06-02T22:52:09.866292+0000","last_fullsized":"2024-06-02T22:52:09.866292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:19.408730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366212+0000","last_change":"2024-06-02T22:52:03.584406+0000","last_active":"2024-06-02T22:52:09.366212+0000","last_peered":"2024-06-02T22:52:09.366212+0000","last_clean":"2024-06-02T22:52:09.366212+0000","last_became_active":"2024-06-02T22:52:03.584128+0000","last_became_peered":"2024-06-02T22:52:03.584128+0000","last_unstale":"2024-06-02T22:52:09.366212+0000","last_undegraded":"2024-06-02T22:52:09.366212+0000","last_fullsized":"2024-06-02T22:52:09.366212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:02.241694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608660+0000","last_change":"2024-06-02T22:52:02.567072+0000","last_active":"2024-06-02T22:52:08.608660+0000","last_peered":"2024-06-02T22:52:08.608660+0000","last_clean":"2024-06-02T22:52:08.608660+0000","last_became_active":"2024-06-02T22:52:02.566757+0000","last_became_peered":"2024-06-02T22:52:02.566757+0000","last_unstale":"2024-06-02T22:52:08.608660+0000","last_undegraded":"2024-06-02T22:52:08.608660+0000","last_fullsized":"2024-06-02T22:52:08.608660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:57.107796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609128+0000","last_change":"2024-06-02T22:52:07.601781+0000","last_active":"2024-06-02T22:52:08.609128+0000","last_peered":"2024-06-02T22:52:08.609128+0000","last_clean":"2024-06-02T22:52:08.609128+0000","last_became_active":"2024-06-02T22:52:07.601121+0000","last_became_peered":"2024-06-02T22:52:07.601121+0000","last_unstale":"2024-06-02T22:52:08.609128+0000","last_undegraded":"2024-06-02T22:52:08.609128+0000","last_fullsized":"2024-06-02T22:52:08.609128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:40.819611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365745+0000","last_change":"2024-06-02T22:52:03.583571+0000","last_active":"2024-06-02T22:52:09.365745+0000","last_peered":"2024-06-02T22:52:09.365745+0000","last_clean":"2024-06-02T22:52:09.365745+0000","last_became_active":"2024-06-02T22:52:03.583035+0000","last_became_peered":"2024-06-02T22:52:03.583035+0000","last_unstale":"2024-06-02T22:52:09.365745+0000","last_undegraded":"2024-06-02T22:52:09.365745+0000","last_fullsized":"2024-06-02T22:52:09.365745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609832+0000","last_change":"2024-06-02T22:52:02.568253+0000","last_active":"2024-06-02T22:52:08.609832+0000","last_peered":"2024-06-02T22:52:08.609832+0000","last_clean":"2024-06-02T22:52:08.609832+0000","last_became_active":"2024-06-02T22:52:02.567725+0000","last_became_peered":"2024-06-02T22:52:02.567725+0000","last_unstale":"2024-06-02T22:52:08.609832+0000","last_undegraded":"2024-06-02T22:52:08.609832+0000","last_fullsized":"2024-06-02T22:52:08.609832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867536+0000","last_change":"2024-06-02T22:52:07.601097+0000","last_active":"2024-06-02T22:52:09.867536+0000","last_peered":"2024-06-02T22:52:09.867536+0000","last_clean":"2024-06-02T22:52:09.867536+0000","last_became_active":"2024-06-02T22:52:07.600696+0000","last_became_peered":"2024-06-02T22:52:07.600696+0000","last_unstale":"2024-06-02T22:52:09.867536+0000","last_undegraded":"2024-06-02T22:52:09.867536+0000","last_fullsized":"2024-06-02T22:52:09.867536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:36.573360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608536+0000","last_change":"2024-06-02T22:52:03.579404+0000","last_active":"2024-06-02T22:52:08.608536+0000","last_peered":"2024-06-02T22:52:08.608536+0000","last_clean":"2024-06-02T22:52:08.608536+0000","last_became_active":"2024-06-02T22:52:03.579057+0000","last_became_peered":"2024-06-02T22:52:03.579057+0000","last_unstale":"2024-06-02T22:52:08.608536+0000","last_undegraded":"2024-06-02T22:52:08.608536+0000","last_fullsized":"2024-06-02T22:52:08.608536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609446+0000","last_change":"2024-06-02T22:52:02.566374+0000","last_active":"2024-06-02T22:52:08.609446+0000","last_peered":"2024-06-02T22:52:08.609446+0000","last_clean":"2024-06-02T22:52:08.609446+0000","last_became_active":"2024-06-02T22:52:02.566091+0000","last_became_peered":"2024-06-02T22:52:02.566091+0000","last_unstale":"2024-06-02T22:52:08.609446+0000","last_undegraded":"2024-06-02T22:52:08.609446+0000","last_fullsized":"2024-06-02T22:52:08.609446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802585+0000","last_change":"2024-06-02T22:52:07.615876+0000","last_active":"2024-06-02T22:52:09.802585+0000","last_peered":"2024-06-02T22:52:09.802585+0000","last_clean":"2024-06-02T22:52:09.802585+0000","last_became_active":"2024-06-02T22:52:07.615423+0000","last_became_peered":"2024-06-02T22:52:07.615423+0000","last_unstale":"2024-06-02T22:52:09.802585+0000","last_undegraded":"2024-06-02T22:52:09.802585+0000","last_fullsized":"2024-06-02T22:52:09.802585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:20:08.691545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365895+0000","last_change":"2024-06-02T22:52:03.579077+0000","last_active":"2024-06-02T22:52:09.365895+0000","last_peered":"2024-06-02T22:52:09.365895+0000","last_clean":"2024-06-02T22:52:09.365895+0000","last_became_active":"2024-06-02T22:52:03.578126+0000","last_became_peered":"2024-06-02T22:52:03.578126+0000","last_unstale":"2024-06-02T22:52:09.365895+0000","last_undegraded":"2024-06-02T22:52:09.365895+0000","last_fullsized":"2024-06-02T22:52:09.365895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:43.054007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866722+0000","last_change":"2024-06-02T22:52:02.570439+0000","last_active":"2024-06-02T22:52:09.866722+0000","last_peered":"2024-06-02T22:52:09.866722+0000","last_clean":"2024-06-02T22:52:09.866722+0000","last_became_active":"2024-06-02T22:52:02.569937+0000","last_became_peered":"2024-06-02T22:52:02.569937+0000","last_unstale":"2024-06-02T22:52:09.866722+0000","last_undegraded":"2024-06-02T22:52:09.866722+0000","last_fullsized":"2024-06-02T22:52:09.866722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802494+0000","last_change":"2024-06-02T22:52:07.612603+0000","last_active":"2024-06-02T22:52:09.802494+0000","last_peered":"2024-06-02T22:52:09.802494+0000","last_clean":"2024-06-02T22:52:09.802494+0000","last_became_active":"2024-06-02T22:52:07.612214+0000","last_became_peered":"2024-06-02T22:52:07.612214+0000","last_unstale":"2024-06-02T22:52:09.802494+0000","last_undegraded":"2024-06-02T22:52:09.802494+0000","last_fullsized":"2024-06-02T22:52:09.802494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:20:19.247700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867054+0000","last_change":"2024-06-02T22:52:03.579566+0000","last_active":"2024-06-02T22:52:09.867054+0000","last_peered":"2024-06-02T22:52:09.867054+0000","last_clean":"2024-06-02T22:52:09.867054+0000","last_became_active":"2024-06-02T22:52:03.579295+0000","last_became_peered":"2024-06-02T22:52:03.579295+0000","last_unstale":"2024-06-02T22:52:09.867054+0000","last_undegraded":"2024-06-02T22:52:09.867054+0000","last_fullsized":"2024-06-02T22:52:09.867054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867327+0000","last_change":"2024-06-02T22:52:02.563970+0000","last_active":"2024-06-02T22:52:09.867327+0000","last_peered":"2024-06-02T22:52:09.867327+0000","last_clean":"2024-06-02T22:52:09.867327+0000","last_became_active":"2024-06-02T22:52:02.563675+0000","last_became_peered":"2024-06-02T22:52:02.563675+0000","last_unstale":"2024-06-02T22:52:09.867327+0000","last_undegraded":"2024-06-02T22:52:09.867327+0000","last_fullsized":"2024-06-02T22:52:09.867327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:31.842742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866976+0000","last_change":"2024-06-02T22:52:07.615973+0000","last_active":"2024-06-02T22:52:09.866976+0000","last_peered":"2024-06-02T22:52:09.866976+0000","last_clean":"2024-06-02T22:52:09.866976+0000","last_became_active":"2024-06-02T22:52:07.615586+0000","last_became_peered":"2024-06-02T22:52:07.615586+0000","last_unstale":"2024-06-02T22:52:09.866976+0000","last_undegraded":"2024-06-02T22:52:09.866976+0000","last_fullsized":"2024-06-02T22:52:09.866976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:27:30.054564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365923+0000","last_change":"2024-06-02T22:52:03.584686+0000","last_active":"2024-06-02T22:52:09.365923+0000","last_peered":"2024-06-02T22:52:09.365923+0000","last_clean":"2024-06-02T22:52:09.365923+0000","last_became_active":"2024-06-02T22:52:03.584398+0000","last_became_peered":"2024-06-02T22:52:03.584398+0000","last_unstale":"2024-06-02T22:52:09.365923+0000","last_undegraded":"2024-06-02T22:52:09.365923+0000","last_fullsized":"2024-06-02T22:52:09.365923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:07.185424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:12.944886+0000","last_change":"2024-06-02T22:52:02.568278+0000","last_active":"2024-06-02T22:52:12.944886+0000","last_peered":"2024-06-02T22:52:12.944886+0000","last_clean":"2024-06-02T22:52:12.944886+0000","last_became_active":"2024-06-02T22:52:02.567915+0000","last_became_peered":"2024-06-02T22:52:02.567915+0000","last_unstale":"2024-06-02T22:52:12.944886+0000","last_undegraded":"2024-06-02T22:52:12.944886+0000","last_fullsized":"2024-06-02T22:52:12.944886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866737+0000","last_change":"2024-06-02T22:52:07.596273+0000","last_active":"2024-06-02T22:52:09.866737+0000","last_peered":"2024-06-02T22:52:09.866737+0000","last_clean":"2024-06-02T22:52:09.866737+0000","last_became_active":"2024-06-02T22:52:07.595893+0000","last_became_peered":"2024-06-02T22:52:07.595893+0000","last_unstale":"2024-06-02T22:52:09.866737+0000","last_undegraded":"2024-06-02T22:52:09.866737+0000","last_fullsized":"2024-06-02T22:52:09.866737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:57.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609245+0000","last_change":"2024-06-02T22:52:03.576403+0000","last_active":"2024-06-02T22:52:08.609245+0000","last_peered":"2024-06-02T22:52:08.609245+0000","last_clean":"2024-06-02T22:52:08.609245+0000","last_became_active":"2024-06-02T22:52:03.574665+0000","last_became_peered":"2024-06-02T22:52:03.574665+0000","last_unstale":"2024-06-02T22:52:08.609245+0000","last_undegraded":"2024-06-02T22:52:08.609245+0000","last_fullsized":"2024-06-02T22:52:08.609245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:30.466832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866748+0000","last_change":"2024-06-02T22:52:02.572661+0000","last_active":"2024-06-02T22:52:09.866748+0000","last_peered":"2024-06-02T22:52:09.866748+0000","last_clean":"2024-06-02T22:52:09.866748+0000","last_became_active":"2024-06-02T22:52:02.571128+0000","last_became_peered":"2024-06-02T22:52:02.571128+0000","last_unstale":"2024-06-02T22:52:09.866748+0000","last_undegraded":"2024-06-02T22:52:09.866748+0000","last_fullsized":"2024-06-02T22:52:09.866748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609673+0000","last_change":"2024-06-02T22:52:07.595758+0000","last_active":"2024-06-02T22:52:08.609673+0000","last_peered":"2024-06-02T22:52:08.609673+0000","last_clean":"2024-06-02T22:52:08.609673+0000","last_became_active":"2024-06-02T22:52:07.595359+0000","last_became_peered":"2024-06-02T22:52:07.595359+0000","last_unstale":"2024-06-02T22:52:08.609673+0000","last_undegraded":"2024-06-02T22:52:08.609673+0000","last_fullsized":"2024-06-02T22:52:08.609673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:11.213283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867361+0000","last_change":"2024-06-02T22:52:03.575977+0000","last_active":"2024-06-02T22:52:09.867361+0000","last_peered":"2024-06-02T22:52:09.867361+0000","last_clean":"2024-06-02T22:52:09.867361+0000","last_became_active":"2024-06-02T22:52:03.575690+0000","last_became_peered":"2024-06-02T22:52:03.575690+0000","last_unstale":"2024-06-02T22:52:09.867361+0000","last_undegraded":"2024-06-02T22:52:09.867361+0000","last_fullsized":"2024-06-02T22:52:09.867361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866849+0000","last_change":"2024-06-02T22:52:02.571504+0000","last_active":"2024-06-02T22:52:09.866849+0000","last_peered":"2024-06-02T22:52:09.866849+0000","last_clean":"2024-06-02T22:52:09.866849+0000","last_became_active":"2024-06-02T22:52:02.571227+0000","last_became_peered":"2024-06-02T22:52:02.571227+0000","last_unstale":"2024-06-02T22:52:09.866849+0000","last_undegraded":"2024-06-02T22:52:09.866849+0000","last_fullsized":"2024-06-02T22:52:09.866849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801961+0000","last_change":"2024-06-02T22:52:07.599829+0000","last_active":"2024-06-02T22:52:09.801961+0000","last_peered":"2024-06-02T22:52:09.801961+0000","last_clean":"2024-06-02T22:52:09.801961+0000","last_became_active":"2024-06-02T22:52:07.599407+0000","last_became_peered":"2024-06-02T22:52:07.599407+0000","last_unstale":"2024-06-02T22:52:09.801961+0000","last_undegraded":"2024-06-02T22:52:09.801961+0000","last_fullsized":"2024-06-02T22:52:09.801961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:33:49.412166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866795+0000","last_change":"2024-06-02T22:52:03.585466+0000","last_active":"2024-06-02T22:52:09.866795+0000","last_peered":"2024-06-02T22:52:09.866795+0000","last_clean":"2024-06-02T22:52:09.866795+0000","last_became_active":"2024-06-02T22:52:03.584977+0000","last_became_peered":"2024-06-02T22:52:03.584977+0000","last_unstale":"2024-06-02T22:52:09.866795+0000","last_undegraded":"2024-06-02T22:52:09.866795+0000","last_fullsized":"2024-06-02T22:52:09.866795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:07.185424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609512+0000","last_change":"2024-06-02T22:52:02.566185+0000","last_active":"2024-06-02T22:52:08.609512+0000","last_peered":"2024-06-02T22:52:08.609512+0000","last_clean":"2024-06-02T22:52:08.609512+0000","last_became_active":"2024-06-02T22:52:02.565884+0000","last_became_peered":"2024-06-02T22:52:02.565884+0000","last_unstale":"2024-06-02T22:52:08.609512+0000","last_undegraded":"2024-06-02T22:52:08.609512+0000","last_fullsized":"2024-06-02T22:52:08.609512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801946+0000","last_change":"2024-06-02T22:52:07.613267+0000","last_active":"2024-06-02T22:52:09.801946+0000","last_peered":"2024-06-02T22:52:09.801946+0000","last_clean":"2024-06-02T22:52:09.801946+0000","last_became_active":"2024-06-02T22:52:07.612830+0000","last_became_peered":"2024-06-02T22:52:07.612830+0000","last_unstale":"2024-06-02T22:52:09.801946+0000","last_undegraded":"2024-06-02T22:52:09.801946+0000","last_fullsized":"2024-06-02T22:52:09.801946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:08:51.327311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867496+0000","last_change":"2024-06-02T22:52:07.615985+0000","last_active":"2024-06-02T22:52:09.867496+0000","last_peered":"2024-06-02T22:52:09.867496+0000","last_clean":"2024-06-02T22:52:09.867496+0000","last_became_active":"2024-06-02T22:52:07.615499+0000","last_became_peered":"2024-06-02T22:52:07.615499+0000","last_unstale":"2024-06-02T22:52:09.867496+0000","last_undegraded":"2024-06-02T22:52:09.867496+0000","last_fullsized":"2024-06-02T22:52:09.867496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:06.782146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866321+0000","last_change":"2024-06-02T22:52:03.582276+0000","last_active":"2024-06-02T22:52:09.866321+0000","last_peered":"2024-06-02T22:52:09.866321+0000","last_clean":"2024-06-02T22:52:09.866321+0000","last_became_active":"2024-06-02T22:52:03.582024+0000","last_became_peered":"2024-06-02T22:52:03.582024+0000","last_unstale":"2024-06-02T22:52:09.866321+0000","last_undegraded":"2024-06-02T22:52:09.866321+0000","last_fullsized":"2024-06-02T22:52:09.866321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866520+0000","last_change":"2024-06-02T22:52:02.566673+0000","last_active":"2024-06-02T22:52:09.866520+0000","last_peered":"2024-06-02T22:52:09.866520+0000","last_clean":"2024-06-02T22:52:09.866520+0000","last_became_active":"2024-06-02T22:52:02.566382+0000","last_became_peered":"2024-06-02T22:52:02.566382+0000","last_unstale":"2024-06-02T22:52:09.866520+0000","last_undegraded":"2024-06-02T22:52:09.866520+0000","last_fullsized":"2024-06-02T22:52:09.866520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609482+0000","last_change":"2024-06-02T22:52:07.595868+0000","last_active":"2024-06-02T22:52:08.609482+0000","last_peered":"2024-06-02T22:52:08.609482+0000","last_clean":"2024-06-02T22:52:08.609482+0000","last_became_active":"2024-06-02T22:52:07.595443+0000","last_became_peered":"2024-06-02T22:52:07.595443+0000","last_unstale":"2024-06-02T22:52:08.609482+0000","last_undegraded":"2024-06-02T22:52:08.609482+0000","last_fullsized":"2024-06-02T22:52:08.609482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801957+0000","last_change":"2024-06-02T22:52:03.577756+0000","last_active":"2024-06-02T22:52:09.801957+0000","last_peered":"2024-06-02T22:52:09.801957+0000","last_clean":"2024-06-02T22:52:09.801957+0000","last_became_active":"2024-06-02T22:52:03.577464+0000","last_became_peered":"2024-06-02T22:52:03.577464+0000","last_unstale":"2024-06-02T22:52:09.801957+0000","last_undegraded":"2024-06-02T22:52:09.801957+0000","last_fullsized":"2024-06-02T22:52:09.801957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802322+0000","last_change":"2024-06-02T22:52:02.573076+0000","last_active":"2024-06-02T22:52:09.802322+0000","last_peered":"2024-06-02T22:52:09.802322+0000","last_clean":"2024-06-02T22:52:09.802322+0000","last_became_active":"2024-06-02T22:52:02.572774+0000","last_became_peered":"2024-06-02T22:52:02.572774+0000","last_unstale":"2024-06-02T22:52:09.802322+0000","last_undegraded":"2024-06-02T22:52:09.802322+0000","last_fullsized":"2024-06-02T22:52:09.802322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:37:05.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609292+0000","last_change":"2024-06-02T22:52:02.567544+0000","last_active":"2024-06-02T22:52:08.609292+0000","last_peered":"2024-06-02T22:52:08.609292+0000","last_clean":"2024-06-02T22:52:08.609292+0000","last_became_active":"2024-06-02T22:52:02.566808+0000","last_became_peered":"2024-06-02T22:52:02.566808+0000","last_unstale":"2024-06-02T22:52:08.609292+0000","last_undegraded":"2024-06-02T22:52:08.609292+0000","last_fullsized":"2024-06-02T22:52:08.609292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867244+0000","last_change":"2024-06-02T22:52:03.562967+0000","last_active":"2024-06-02T22:52:09.867244+0000","last_peered":"2024-06-02T22:52:09.867244+0000","last_clean":"2024-06-02T22:52:09.867244+0000","last_became_active":"2024-06-02T22:52:03.562081+0000","last_became_peered":"2024-06-02T22:52:03.562081+0000","last_unstale":"2024-06-02T22:52:09.867244+0000","last_undegraded":"2024-06-02T22:52:09.867244+0000","last_fullsized":"2024-06-02T22:52:09.867244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610074+0000","last_change":"2024-06-02T22:52:07.601119+0000","last_active":"2024-06-02T22:52:08.610074+0000","last_peered":"2024-06-02T22:52:08.610074+0000","last_clean":"2024-06-02T22:52:08.610074+0000","last_became_active":"2024-06-02T22:52:07.600750+0000","last_became_peered":"2024-06-02T22:52:07.600750+0000","last_unstale":"2024-06-02T22:52:08.610074+0000","last_undegraded":"2024-06-02T22:52:08.610074+0000","last_fullsized":"2024-06-02T22:52:08.610074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:35.174685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802437+0000","last_change":"2024-06-02T22:52:02.571567+0000","last_active":"2024-06-02T22:52:09.802437+0000","last_peered":"2024-06-02T22:52:09.802437+0000","last_clean":"2024-06-02T22:52:09.802437+0000","last_became_active":"2024-06-02T22:52:02.571287+0000","last_became_peered":"2024-06-02T22:52:02.571287+0000","last_unstale":"2024-06-02T22:52:09.802437+0000","last_undegraded":"2024-06-02T22:52:09.802437+0000","last_fullsized":"2024-06-02T22:52:09.802437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:31:16.566686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608886+0000","last_change":"2024-06-02T22:52:03.570359+0000","last_active":"2024-06-02T22:52:08.608886+0000","last_peered":"2024-06-02T22:52:08.608886+0000","last_clean":"2024-06-02T22:52:08.608886+0000","last_became_active":"2024-06-02T22:52:03.570078+0000","last_became_peered":"2024-06-02T22:52:03.570078+0000","last_unstale":"2024-06-02T22:52:08.608886+0000","last_undegraded":"2024-06-02T22:52:08.608886+0000","last_fullsized":"2024-06-02T22:52:08.608886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:23.572760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802391+0000","last_change":"2024-06-02T22:52:07.599308+0000","last_active":"2024-06-02T22:52:09.802391+0000","last_peered":"2024-06-02T22:52:09.802391+0000","last_clean":"2024-06-02T22:52:09.802391+0000","last_became_active":"2024-06-02T22:52:07.598853+0000","last_became_peered":"2024-06-02T22:52:07.598853+0000","last_unstale":"2024-06-02T22:52:09.802391+0000","last_undegraded":"2024-06-02T22:52:09.802391+0000","last_fullsized":"2024-06-02T22:52:09.802391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:58:51.080840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608325+0000","last_change":"2024-06-02T22:52:03.579154+0000","last_active":"2024-06-02T22:52:08.608325+0000","last_peered":"2024-06-02T22:52:08.608325+0000","last_clean":"2024-06-02T22:52:08.608325+0000","last_became_active":"2024-06-02T22:52:03.578832+0000","last_became_peered":"2024-06-02T22:52:03.578832+0000","last_unstale":"2024-06-02T22:52:08.608325+0000","last_undegraded":"2024-06-02T22:52:08.608325+0000","last_fullsized":"2024-06-02T22:52:08.608325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609855+0000","last_change":"2024-06-02T22:52:03.575695+0000","last_active":"2024-06-02T22:52:08.609855+0000","last_peered":"2024-06-02T22:52:08.609855+0000","last_clean":"2024-06-02T22:52:08.609855+0000","last_became_active":"2024-06-02T22:52:03.575447+0000","last_became_peered":"2024-06-02T22:52:03.575447+0000","last_unstale":"2024-06-02T22:52:08.609855+0000","last_undegraded":"2024-06-02T22:52:08.609855+0000","last_fullsized":"2024-06-02T22:52:08.609855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:23.572760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866720+0000","last_change":"2024-06-02T22:52:03.579412+0000","last_active":"2024-06-02T22:52:09.866720+0000","last_peered":"2024-06-02T22:52:09.866720+0000","last_clean":"2024-06-02T22:52:09.866720+0000","last_became_active":"2024-06-02T22:52:03.578767+0000","last_became_peered":"2024-06-02T22:52:03.578767+0000","last_unstale":"2024-06-02T22:52:09.866720+0000","last_undegraded":"2024-06-02T22:52:09.866720+0000","last_fullsized":"2024-06-02T22:52:09.866720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867151+0000","last_change":"2024-06-02T22:52:03.578192+0000","last_active":"2024-06-02T22:52:09.867151+0000","last_peered":"2024-06-02T22:52:09.867151+0000","last_clean":"2024-06-02T22:52:09.867151+0000","last_became_active":"2024-06-02T22:52:03.577899+0000","last_became_peered":"2024-06-02T22:52:03.577899+0000","last_unstale":"2024-06-02T22:52:09.867151+0000","last_undegraded":"2024-06-02T22:52:09.867151+0000","last_fullsized":"2024-06-02T22:52:09.867151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802510+0000","last_change":"2024-06-02T22:52:03.585412+0000","last_active":"2024-06-02T22:52:09.802510+0000","last_peered":"2024-06-02T22:52:09.802510+0000","last_clean":"2024-06-02T22:52:09.802510+0000","last_became_active":"2024-06-02T22:52:03.585003+0000","last_became_peered":"2024-06-02T22:52:03.585003+0000","last_unstale":"2024-06-02T22:52:09.802510+0000","last_undegraded":"2024-06-02T22:52:09.802510+0000","last_fullsized":"2024-06-02T22:52:09.802510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866492+0000","last_change":"2024-06-02T22:52:03.581743+0000","last_active":"2024-06-02T22:52:09.866492+0000","last_peered":"2024-06-02T22:52:09.866492+0000","last_clean":"2024-06-02T22:52:09.866492+0000","last_became_active":"2024-06-02T22:52:03.581485+0000","last_became_peered":"2024-06-02T22:52:03.581485+0000","last_unstale":"2024-06-02T22:52:09.866492+0000","last_undegraded":"2024-06-02T22:52:09.866492+0000","last_fullsized":"2024-06-02T22:52:09.866492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609761+0000","last_change":"2024-06-02T22:52:03.578703+0000","last_active":"2024-06-02T22:52:08.609761+0000","last_peered":"2024-06-02T22:52:08.609761+0000","last_clean":"2024-06-02T22:52:08.609761+0000","last_became_active":"2024-06-02T22:52:03.578406+0000","last_became_peered":"2024-06-02T22:52:03.578406+0000","last_unstale":"2024-06-02T22:52:08.609761+0000","last_undegraded":"2024-06-02T22:52:08.609761+0000","last_fullsized":"2024-06-02T22:52:08.609761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802540+0000","last_change":"2024-06-02T22:52:03.585351+0000","last_active":"2024-06-02T22:52:09.802540+0000","last_peered":"2024-06-02T22:52:09.802540+0000","last_clean":"2024-06-02T22:52:09.802540+0000","last_became_active":"2024-06-02T22:52:03.585010+0000","last_became_peered":"2024-06-02T22:52:03.585010+0000","last_unstale":"2024-06-02T22:52:09.802540+0000","last_undegraded":"2024-06-02T22:52:09.802540+0000","last_fullsized":"2024-06-02T22:52:09.802540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866426+0000","last_change":"2024-06-02T22:52:03.583268+0000","last_active":"2024-06-02T22:52:09.866426+0000","last_peered":"2024-06-02T22:52:09.866426+0000","last_clean":"2024-06-02T22:52:09.866426+0000","last_became_active":"2024-06-02T22:52:03.582821+0000","last_became_peered":"2024-06-02T22:52:03.582821+0000","last_unstale":"2024-06-02T22:52:09.866426+0000","last_undegraded":"2024-06-02T22:52:09.866426+0000","last_fullsized":"2024-06-02T22:52:09.866426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802429+0000","last_change":"2024-06-02T22:52:03.585232+0000","last_active":"2024-06-02T22:52:09.802429+0000","last_peered":"2024-06-02T22:52:09.802429+0000","last_clean":"2024-06-02T22:52:09.802429+0000","last_became_active":"2024-06-02T22:52:03.584909+0000","last_became_peered":"2024-06-02T22:52:03.584909+0000","last_unstale":"2024-06-02T22:52:09.802429+0000","last_undegraded":"2024-06-02T22:52:09.802429+0000","last_fullsized":"2024-06-02T22:52:09.802429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866614+0000","last_change":"2024-06-02T22:52:03.580413+0000","last_active":"2024-06-02T22:52:09.866614+0000","last_peered":"2024-06-02T22:52:09.866614+0000","last_clean":"2024-06-02T22:52:09.866614+0000","last_became_active":"2024-06-02T22:52:03.580073+0000","last_became_peered":"2024-06-02T22:52:03.580073+0000","last_unstale":"2024-06-02T22:52:09.866614+0000","last_undegraded":"2024-06-02T22:52:09.866614+0000","last_fullsized":"2024-06-02T22:52:09.866614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866640+0000","last_change":"2024-06-02T22:52:03.579729+0000","last_active":"2024-06-02T22:52:09.866640+0000","last_peered":"2024-06-02T22:52:09.866640+0000","last_clean":"2024-06-02T22:52:09.866640+0000","last_became_active":"2024-06-02T22:52:03.578651+0000","last_became_peered":"2024-06-02T22:52:03.578651+0000","last_unstale":"2024-06-02T22:52:09.866640+0000","last_undegraded":"2024-06-02T22:52:09.866640+0000","last_fullsized":"2024-06-02T22:52:09.866640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608916+0000","last_change":"2024-06-02T22:52:03.566626+0000","last_active":"2024-06-02T22:52:08.608916+0000","last_peered":"2024-06-02T22:52:08.608916+0000","last_clean":"2024-06-02T22:52:08.608916+0000","last_became_active":"2024-06-02T22:52:03.566318+0000","last_became_peered":"2024-06-02T22:52:03.566318+0000","last_unstale":"2024-06-02T22:52:08.608916+0000","last_undegraded":"2024-06-02T22:52:08.608916+0000","last_fullsized":"2024-06-02T22:52:08.608916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366167+0000","last_change":"2024-06-02T22:52:03.576084+0000","last_active":"2024-06-02T22:52:09.366167+0000","last_peered":"2024-06-02T22:52:09.366167+0000","last_clean":"2024-06-02T22:52:09.366167+0000","last_became_active":"2024-06-02T22:52:03.574965+0000","last_became_peered":"2024-06-02T22:52:03.574965+0000","last_unstale":"2024-06-02T22:52:09.366167+0000","last_undegraded":"2024-06-02T22:52:09.366167+0000","last_fullsized":"2024-06-02T22:52:09.366167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:08.812577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610259+0000","last_change":"2024-06-02T22:52:03.566226+0000","last_active":"2024-06-02T22:52:08.610259+0000","last_peered":"2024-06-02T22:52:08.610259+0000","last_clean":"2024-06-02T22:52:08.610259+0000","last_became_active":"2024-06-02T22:52:03.565402+0000","last_became_peered":"2024-06-02T22:52:03.565402+0000","last_unstale":"2024-06-02T22:52:08.610259+0000","last_undegraded":"2024-06-02T22:52:08.610259+0000","last_fullsized":"2024-06-02T22:52:08.610259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:30.466832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867094+0000","last_change":"2024-06-02T22:52:03.586071+0000","last_active":"2024-06-02T22:52:09.867094+0000","last_peered":"2024-06-02T22:52:09.867094+0000","last_clean":"2024-06-02T22:52:09.867094+0000","last_became_active":"2024-06-02T22:52:03.585280+0000","last_became_peered":"2024-06-02T22:52:03.585280+0000","last_unstale":"2024-06-02T22:52:09.867094+0000","last_undegraded":"2024-06-02T22:52:09.867094+0000","last_fullsized":"2024-06-02T22:52:09.867094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:02.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866301+0000","last_change":"2024-06-02T22:52:03.579486+0000","last_active":"2024-06-02T22:52:09.866301+0000","last_peered":"2024-06-02T22:52:09.866301+0000","last_clean":"2024-06-02T22:52:09.866301+0000","last_became_active":"2024-06-02T22:52:03.579239+0000","last_became_peered":"2024-06-02T22:52:03.579239+0000","last_unstale":"2024-06-02T22:52:09.866301+0000","last_undegraded":"2024-06-02T22:52:09.866301+0000","last_fullsized":"2024-06-02T22:52:09.866301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866412+0000","last_change":"2024-06-02T22:52:03.575434+0000","last_active":"2024-06-02T22:52:09.866412+0000","last_peered":"2024-06-02T22:52:09.866412+0000","last_clean":"2024-06-02T22:52:09.866412+0000","last_became_active":"2024-06-02T22:52:03.575156+0000","last_became_peered":"2024-06-02T22:52:03.575156+0000","last_unstale":"2024-06-02T22:52:09.866412+0000","last_undegraded":"2024-06-02T22:52:09.866412+0000","last_fullsized":"2024-06-02T22:52:09.866412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867007+0000","last_change":"2024-06-02T22:52:03.573576+0000","last_active":"2024-06-02T22:52:09.867007+0000","last_peered":"2024-06-02T22:52:09.867007+0000","last_clean":"2024-06-02T22:52:09.867007+0000","last_became_active":"2024-06-02T22:52:03.573309+0000","last_became_peered":"2024-06-02T22:52:03.573309+0000","last_unstale":"2024-06-02T22:52:09.867007+0000","last_undegraded":"2024-06-02T22:52:09.867007+0000","last_fullsized":"2024-06-02T22:52:09.867007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:16.007531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802158+0000","last_change":"2024-06-02T22:52:03.581040+0000","last_active":"2024-06-02T22:52:09.802158+0000","last_peered":"2024-06-02T22:52:09.802158+0000","last_clean":"2024-06-02T22:52:09.802158+0000","last_became_active":"2024-06-02T22:52:03.580786+0000","last_became_peered":"2024-06-02T22:52:03.580786+0000","last_unstale":"2024-06-02T22:52:09.802158+0000","last_undegraded":"2024-06-02T22:52:09.802158+0000","last_fullsized":"2024-06-02T22:52:09.802158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609154+0000","last_change":"2024-06-02T22:52:03.564691+0000","last_active":"2024-06-02T22:52:08.609154+0000","last_peered":"2024-06-02T22:52:08.609154+0000","last_clean":"2024-06-02T22:52:08.609154+0000","last_became_active":"2024-06-02T22:52:03.564367+0000","last_became_peered":"2024-06-02T22:52:03.564367+0000","last_unstale":"2024-06-02T22:52:08.609154+0000","last_undegraded":"2024-06-02T22:52:08.609154+0000","last_fullsized":"2024-06-02T22:52:08.609154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:32.549919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609176+0000","last_change":"2024-06-02T22:52:03.579026+0000","last_active":"2024-06-02T22:52:08.609176+0000","last_peered":"2024-06-02T22:52:08.609176+0000","last_clean":"2024-06-02T22:52:08.609176+0000","last_became_active":"2024-06-02T22:52:03.578719+0000","last_became_peered":"2024-06-02T22:52:03.578719+0000","last_unstale":"2024-06-02T22:52:08.609176+0000","last_undegraded":"2024-06-02T22:52:08.609176+0000","last_fullsized":"2024-06-02T22:52:08.609176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609690+0000","last_change":"2024-06-02T22:52:03.576967+0000","last_active":"2024-06-02T22:52:08.609690+0000","last_peered":"2024-06-02T22:52:08.609690+0000","last_clean":"2024-06-02T22:52:08.609690+0000","last_became_active":"2024-06-02T22:52:03.576347+0000","last_became_peered":"2024-06-02T22:52:03.576347+0000","last_unstale":"2024-06-02T22:52:08.609690+0000","last_undegraded":"2024-06-02T22:52:08.609690+0000","last_fullsized":"2024-06-02T22:52:08.609690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366345+0000","last_change":"2024-06-02T22:52:03.582428+0000","last_active":"2024-06-02T22:52:09.366345+0000","last_peered":"2024-06-02T22:52:09.366345+0000","last_clean":"2024-06-02T22:52:09.366345+0000","last_became_active":"2024-06-02T22:52:03.582154+0000","last_became_peered":"2024-06-02T22:52:03.582154+0000","last_unstale":"2024-06-02T22:52:09.366345+0000","last_undegraded":"2024-06-02T22:52:09.366345+0000","last_fullsized":"2024-06-02T22:52:09.366345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:32.545502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801844+0000","last_change":"2024-06-02T22:52:03.577725+0000","last_active":"2024-06-02T22:52:09.801844+0000","last_peered":"2024-06-02T22:52:09.801844+0000","last_clean":"2024-06-02T22:52:09.801844+0000","last_became_active":"2024-06-02T22:52:03.577449+0000","last_became_peered":"2024-06-02T22:52:03.577449+0000","last_unstale":"2024-06-02T22:52:09.801844+0000","last_undegraded":"2024-06-02T22:52:09.801844+0000","last_fullsized":"2024-06-02T22:52:09.801844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365700+0000","last_change":"2024-06-02T22:52:03.578806+0000","last_active":"2024-06-02T22:52:09.365700+0000","last_peered":"2024-06-02T22:52:09.365700+0000","last_clean":"2024-06-02T22:52:09.365700+0000","last_became_active":"2024-06-02T22:52:03.578505+0000","last_became_peered":"2024-06-02T22:52:03.578505+0000","last_unstale":"2024-06-02T22:52:09.365700+0000","last_undegraded":"2024-06-02T22:52:09.365700+0000","last_fullsized":"2024-06-02T22:52:09.365700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866425+0000","last_change":"2024-06-02T22:52:03.579621+0000","last_active":"2024-06-02T22:52:09.866425+0000","last_peered":"2024-06-02T22:52:09.866425+0000","last_clean":"2024-06-02T22:52:09.866425+0000","last_became_active":"2024-06-02T22:52:03.579140+0000","last_became_peered":"2024-06-02T22:52:03.579140+0000","last_unstale":"2024-06-02T22:52:09.866425+0000","last_undegraded":"2024-06-02T22:52:09.866425+0000","last_fullsized":"2024-06-02T22:52:09.866425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:12.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365766+0000","last_change":"2024-06-02T22:52:03.575446+0000","last_active":"2024-06-02T22:52:09.365766+0000","last_peered":"2024-06-02T22:52:09.365766+0000","last_clean":"2024-06-02T22:52:09.365766+0000","last_became_active":"2024-06-02T22:52:03.573953+0000","last_became_peered":"2024-06-02T22:52:03.573953+0000","last_unstale":"2024-06-02T22:52:09.365766+0000","last_undegraded":"2024-06-02T22:52:09.365766+0000","last_fullsized":"2024-06-02T22:52:09.365766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866605+0000","last_change":"2024-06-02T22:52:03.585130+0000","last_active":"2024-06-02T22:52:09.866605+0000","last_peered":"2024-06-02T22:52:09.866605+0000","last_clean":"2024-06-02T22:52:09.866605+0000","last_became_active":"2024-06-02T22:52:03.584816+0000","last_became_peered":"2024-06-02T22:52:03.584816+0000","last_unstale":"2024-06-02T22:52:09.866605+0000","last_undegraded":"2024-06-02T22:52:09.866605+0000","last_fullsized":"2024-06-02T22:52:09.866605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:02.241694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867276+0000","last_change":"2024-06-02T22:52:03.571403+0000","last_active":"2024-06-02T22:52:09.867276+0000","last_peered":"2024-06-02T22:52:09.867276+0000","last_clean":"2024-06-02T22:52:09.867276+0000","last_became_active":"2024-06-02T22:52:03.568977+0000","last_became_peered":"2024-06-02T22:52:03.568977+0000","last_unstale":"2024-06-02T22:52:09.867276+0000","last_undegraded":"2024-06-02T22:52:09.867276+0000","last_fullsized":"2024-06-02T22:52:09.867276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866695+0000","last_change":"2024-06-02T22:52:03.577758+0000","last_active":"2024-06-02T22:52:09.866695+0000","last_peered":"2024-06-02T22:52:09.866695+0000","last_clean":"2024-06-02T22:52:09.866695+0000","last_became_active":"2024-06-02T22:52:03.577260+0000","last_became_peered":"2024-06-02T22:52:03.577260+0000","last_unstale":"2024-06-02T22:52:09.866695+0000","last_undegraded":"2024-06-02T22:52:09.866695+0000","last_fullsized":"2024-06-02T22:52:09.866695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366256+0000","last_change":"2024-06-02T22:52:03.576942+0000","last_active":"2024-06-02T22:52:09.366256+0000","last_peered":"2024-06-02T22:52:09.366256+0000","last_clean":"2024-06-02T22:52:09.366256+0000","last_became_active":"2024-06-02T22:52:03.576652+0000","last_became_peered":"2024-06-02T22:52:03.576652+0000","last_unstale":"2024-06-02T22:52:09.366256+0000","last_undegraded":"2024-06-02T22:52:09.366256+0000","last_fullsized":"2024-06-02T22:52:09.366256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:53.784824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:52:23.975 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T22:52:23.975 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-02T22:52:23.976 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-06-02T22:52:23.976 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-06-02T22:52:23.976 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-06-02T22:52:24.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.112+0000 7fbaa4161640 1 Processor -- start 2024-06-02T22:52:24.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.113+0000 7fbaa4161640 1 -- start start 2024-06-02T22:52:24.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.113+0000 7fbaa4161640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fba9c0d2680 0x7fba9c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.113+0000 7fbaa4161640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba9c0cef70 0x7fba9c0cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.113+0000 7fbaa4161640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba9c0d0ad0 con 0x7fba9c0d1fc0 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.113+0000 7fbaa4161640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fba9c0d13e0 con 0x7fba9c0cef70 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.113+0000 7fbaa4161640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fba9c15f890 con 0x7fba9c0d2680 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.114+0000 7fbaa16fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fba9c0d1fc0 0x7fba9c0d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48064/0 (socket says 172.21.15.82:48064) 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.114+0000 7fbaa16fc640 1 -- 172.21.15.82:0/4289048367 learned_addr learned my addr 172.21.15.82:0/4289048367 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.114+0000 7fbaa26fe640 1 --2- 172.21.15.82:0/4289048367 >> v2:172.21.15.82:3300/0 conn(0x7fba9c0cef70 0x7fba9c0cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.114+0000 7fbaa1efd640 1 --2- 172.21.15.82:0/4289048367 >> v2:172.21.15.184:3300/0 conn(0x7fba9c0d2680 0x7fba9c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.114+0000 7fbaa0efb640 1 -- 172.21.15.82:0/4289048367 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3606266470 0 0) 0x7fba9c0d0ad0 con 0x7fba9c0d1fc0 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.114+0000 7fbaa0efb640 1 -- 172.21.15.82:0/4289048367 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba88003520 con 0x7fba9c0d1fc0 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.114+0000 7fbaa26fe640 1 -- 172.21.15.82:0/4289048367 >> v2:172.21.15.184:3300/0 conn(0x7fba9c0d2680 msgr2=0x7fba9c15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.114+0000 7fbaa26fe640 1 --2- 172.21.15.82:0/4289048367 >> v2:172.21.15.184:3300/0 conn(0x7fba9c0d2680 0x7fba9c15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.114+0000 7fbaa26fe640 1 -- 172.21.15.82:0/4289048367 >> v1:172.21.15.82:6789/0 conn(0x7fba9c0d1fc0 legacy=0x7fba9c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.114+0000 7fbaa26fe640 1 -- 172.21.15.82:0/4289048367 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c0d0d90 con 0x7fba9c0cef70 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa26fe640 1 --2- 172.21.15.82:0/4289048367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c0cef70 0x7fba9c0cf3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0d1560 tx=0x7fba9402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2a8345ef7ce8f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:24.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa0efb640 1 -- 172.21.15.82:0/4289048367 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94007740 con 0x7fba9c0cef70 2024-06-02T22:52:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa0efb640 1 -- 172.21.15.82:0/4289048367 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba940078e0 con 0x7fba9c0cef70 2024-06-02T22:52:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa0efb640 1 -- 172.21.15.82:0/4289048367 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94007cb0 con 0x7fba9c0cef70 2024-06-02T22:52:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa4161640 1 -- 172.21.15.82:0/4289048367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c0cef70 msgr2=0x7fba9c0cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa4161640 1 --2- 172.21.15.82:0/4289048367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c0cef70 0x7fba9c0cf3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0d1560 tx=0x7fba9402a660 comp rx=0 tx=0).stop 2024-06-02T22:52:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa4161640 1 -- 172.21.15.82:0/4289048367 shutdown_connections 2024-06-02T22:52:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa4161640 1 --2- 172.21.15.82:0/4289048367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c0cef70 0x7fba9c0cf3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa4161640 1 --2- 172.21.15.82:0/4289048367 >> v2:172.21.15.184:3300/0 conn(0x7fba9c0d2680 0x7fba9c15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa4161640 1 -- 172.21.15.82:0/4289048367 >> 172.21.15.82:0/4289048367 conn(0x7fba9c09d3f0 msgr2=0x7fba9c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa4161640 1 -- 172.21.15.82:0/4289048367 shutdown_connections 2024-06-02T22:52:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.115+0000 7fbaa4161640 1 -- 172.21.15.82:0/4289048367 wait complete. 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.117+0000 7fbaa4161640 1 Processor -- start 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.117+0000 7fbaa4161640 1 -- start start 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.117+0000 7fbaa4161640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0cef70 0x7fba9c09de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.117+0000 7fbaa4161640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9c0d1fc0 0x7fba9c09e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.117+0000 7fbaa4161640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c0d2680 0x7fba9c09f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.117+0000 7fbaa4161640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c0d4f00 con 0x7fba9c0d2680 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.117+0000 7fbaa4161640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c0d2400 con 0x7fba9c0cef70 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.117+0000 7fbaa4161640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fba9c0d1870 con 0x7fba9c0d1fc0 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.117+0000 7fbaa26fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c0d2680 0x7fba9c09f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.117+0000 7fbaa26fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c0d2680 0x7fba9c09f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34298/0 (socket says 172.21.15.82:34298) 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.117+0000 7fbaa26fe640 1 -- 172.21.15.82:0/4274137032 learned_addr learned my addr 172.21.15.82:0/4274137032 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fbaa16fc640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9c0d1fc0 0x7fba9c09e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fbaa1efd640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0cef70 0x7fba9c09de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fbaa26fe640 1 -- 172.21.15.82:0/4274137032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9c0d1fc0 msgr2=0x7fba9c09e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fbaa26fe640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9c0d1fc0 0x7fba9c09e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fbaa26fe640 1 -- 172.21.15.82:0/4274137032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0cef70 msgr2=0x7fba9c09de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fbaa26fe640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0cef70 0x7fba9c09de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fbaa26fe640 1 -- 172.21.15.82:0/4274137032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c09fd00 con 0x7fba9c0d2680 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fbaa1efd640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0cef70 0x7fba9c09de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fbaa26fe640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c0d2680 0x7fba9c09f080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fba9c08ca40 tx=0x7fba94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fba927fc640 1 -- 172.21.15.82:0/4274137032 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9403f070 con 0x7fba9c0d2680 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fba927fc640 1 -- 172.21.15.82:0/4274137032 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba94031bf0 con 0x7fba9c0d2680 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fbaa4161640 1 -- 172.21.15.82:0/4274137032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9c09ffe0 con 0x7fba9c0d2680 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fba927fc640 1 -- 172.21.15.82:0/4274137032 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94009450 con 0x7fba9c0d2680 2024-06-02T22:52:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.118+0000 7fbaa4161640 1 -- 172.21.15.82:0/4274137032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9c0a05a0 con 0x7fba9c0d2680 2024-06-02T22:52:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.119+0000 7fbaa4161640 1 -- 172.21.15.82:0/4274137032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba9c068430 con 0x7fba9c0d2680 2024-06-02T22:52:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.120+0000 7fba927fc640 1 -- 172.21.15.82:0/4274137032 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba9403b410 con 0x7fba9c0d2680 2024-06-02T22:52:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.120+0000 7fba927fc640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba8006be30 0x7fba8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.120+0000 7fba927fc640 1 -- 172.21.15.82:0/4274137032 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fba940ac910 con 0x7fba9c0d2680 2024-06-02T22:52:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.120+0000 7fbaa1efd640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba8006be30 0x7fba8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.120+0000 7fbaa1efd640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba8006be30 0x7fba8006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fba8c006fd0 tx=0x7fba8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:24.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.128+0000 7fba927fc640 1 -- 172.21.15.82:0/4274137032 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fba9407b010 con 0x7fba9c0d2680 2024-06-02T22:52:24.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.357+0000 7fbaa4161640 1 -- 172.21.15.82:0/4274137032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fba9c0d04e0 con 0x7fba9c0d2680 2024-06-02T22:52:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.362+0000 7fba927fc640 1 -- 172.21.15.82:0/4274137032 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172939 (secure 0 0 0) 0x7fba9407a910 con 0x7fba9c0d2680 2024-06-02T22:52:24.363 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.364+0000 7fbaa4161640 1 -- 172.21.15.82:0/4274137032 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba8006be30 msgr2=0x7fba8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.364+0000 7fbaa4161640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba8006be30 0x7fba8006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fba8c006fd0 tx=0x7fba8c008040 comp rx=0 tx=0).stop 2024-06-02T22:52:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.364+0000 7fbaa4161640 1 -- 172.21.15.82:0/4274137032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c0d2680 msgr2=0x7fba9c09f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.364+0000 7fbaa4161640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c0d2680 0x7fba9c09f080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fba9c08ca40 tx=0x7fba94004a40 comp rx=0 tx=0).stop 2024-06-02T22:52:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.365+0000 7fbaa4161640 1 -- 172.21.15.82:0/4274137032 shutdown_connections 2024-06-02T22:52:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.365+0000 7fbaa4161640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba8006be30 0x7fba8006e2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.365+0000 7fbaa4161640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba9c0d2680 0x7fba9c09f080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.365+0000 7fbaa4161640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba9c0d1fc0 0x7fba9c09e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.365+0000 7fbaa4161640 1 --2- 172.21.15.82:0/4274137032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba9c0cef70 0x7fba9c09de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.365+0000 7fbaa4161640 1 -- 172.21.15.82:0/4274137032 >> 172.21.15.82:0/4274137032 conn(0x7fba9c09d3f0 msgr2=0x7fba9c0c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.365+0000 7fbaa4161640 1 -- 172.21.15.82:0/4274137032 shutdown_connections 2024-06-02T22:52:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.365+0000 7fbaa4161640 1 -- 172.21.15.82:0/4274137032 wait complete. 2024-06-02T22:52:24.375 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2392286815},{"type":"v1","addr":"172.21.15.82:6833","nonce":2392286815}]},"active_addr":"172.21.15.82:6833/2392286815","active_change":"2024-06-02T22:51:43.815541+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3236027840}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2291940053}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3418704120}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2786112534}]}]} 2024-06-02T22:52:24.378 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-06-02T22:52:24.378 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-06-02T22:52:24.379 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:24.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.479+0000 7fd40cbc1640 1 Processor -- start 2024-06-02T22:52:24.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.479+0000 7fd40cbc1640 1 -- start start 2024-06-02T22:52:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.480+0000 7fd40cbc1640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd40815f970 0x7fd40809aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.480+0000 7fd40cbc1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4080703f0 0x7fd40809af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.480+0000 7fd40cbc1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40815fd50 con 0x7fd4080711b0 2024-06-02T22:52:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.480+0000 7fd40cbc1640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fd40809b9c0 con 0x7fd40815f970 2024-06-02T22:52:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.480+0000 7fd40cbc1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd4080d06c0 con 0x7fd4080703f0 2024-06-02T22:52:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.480+0000 7fd405d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd4080711b0 0x7fd4080cd3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48076/0 (socket says 172.21.15.82:48076) 2024-06-02T22:52:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.480+0000 7fd405d9b640 1 -- 172.21.15.82:0/915030682 learned_addr learned my addr 172.21.15.82:0/915030682 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.480+0000 7fd40659c640 1 --2- 172.21.15.82:0/915030682 >> v2:172.21.15.184:3300/0 conn(0x7fd40815f970 0x7fd40809aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.481+0000 7fd406d9d640 1 --2- 172.21.15.82:0/915030682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4080703f0 0x7fd40809af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.481+0000 7fd40559a640 1 -- 172.21.15.82:0/915030682 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1921340925 0 0) 0x7fd3f0001110 con 0x7fd4080711b0 2024-06-02T22:52:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.481+0000 7fd40559a640 1 -- 172.21.15.82:0/915030682 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3f4003520 con 0x7fd4080711b0 2024-06-02T22:52:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.481+0000 7fd406d9d640 1 -- 172.21.15.82:0/915030682 >> v2:172.21.15.184:3300/0 conn(0x7fd40815f970 msgr2=0x7fd40809aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.481+0000 7fd406d9d640 1 --2- 172.21.15.82:0/915030682 >> v2:172.21.15.184:3300/0 conn(0x7fd40815f970 0x7fd40809aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.481+0000 7fd406d9d640 1 -- 172.21.15.82:0/915030682 >> v1:172.21.15.82:6789/0 conn(0x7fd4080711b0 legacy=0x7fd4080cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.481+0000 7fd406d9d640 1 -- 172.21.15.82:0/915030682 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4080708e0 con 0x7fd4080703f0 2024-06-02T22:52:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.481+0000 7fd40659c640 1 --2- 172.21.15.82:0/915030682 >> v2:172.21.15.184:3300/0 conn(0x7fd40815f970 0x7fd40809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.482+0000 7fd406d9d640 1 --2- 172.21.15.82:0/915030682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4080703f0 0x7fd40809af50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd400009d90 tx=0x7fd40002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=858b2384cd67666 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.482+0000 7fd40559a640 1 -- 172.21.15.82:0/915030682 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400007740 con 0x7fd4080703f0 2024-06-02T22:52:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.482+0000 7fd40559a640 1 -- 172.21.15.82:0/915030682 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4000078e0 con 0x7fd4080703f0 2024-06-02T22:52:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.482+0000 7fd40559a640 1 -- 172.21.15.82:0/915030682 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400007cb0 con 0x7fd4080703f0 2024-06-02T22:52:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.483+0000 7fd40cbc1640 1 -- 172.21.15.82:0/915030682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4080703f0 msgr2=0x7fd40809af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.483+0000 7fd40cbc1640 1 --2- 172.21.15.82:0/915030682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4080703f0 0x7fd40809af50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd400009d90 tx=0x7fd40002a660 comp rx=0 tx=0).stop 2024-06-02T22:52:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.483+0000 7fd40cbc1640 1 -- 172.21.15.82:0/915030682 shutdown_connections 2024-06-02T22:52:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.483+0000 7fd40cbc1640 1 --2- 172.21.15.82:0/915030682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4080703f0 0x7fd40809af50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.483+0000 7fd40cbc1640 1 --2- 172.21.15.82:0/915030682 >> v2:172.21.15.184:3300/0 conn(0x7fd40815f970 0x7fd40809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.483+0000 7fd40cbc1640 1 -- 172.21.15.82:0/915030682 >> 172.21.15.82:0/915030682 conn(0x7fd4080d1eb0 msgr2=0x7fd4080d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.483+0000 7fd40cbc1640 1 -- 172.21.15.82:0/915030682 shutdown_connections 2024-06-02T22:52:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.483+0000 7fd40cbc1640 1 -- 172.21.15.82:0/915030682 wait complete. 2024-06-02T22:52:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.484+0000 7fd40cbc1640 1 Processor -- start 2024-06-02T22:52:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.484+0000 7fd40cbc1640 1 -- start start 2024-06-02T22:52:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd40cbc1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4080703f0 0x7fd4080c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd40cbc1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4080711b0 0x7fd408156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd40cbc1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40815f970 0x7fd4080b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd40cbc1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd408070d00 con 0x7fd40815f970 2024-06-02T22:52:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd40cbc1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd40809b490 con 0x7fd4080703f0 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd40cbc1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd408070e80 con 0x7fd4080711b0 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40815f970 0x7fd4080b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40815f970 0x7fd4080b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34300/0 (socket says 172.21.15.82:34300) 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd406d9d640 1 -- 172.21.15.82:0/1005198030 learned_addr learned my addr 172.21.15.82:0/1005198030 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd40659c640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4080703f0 0x7fd4080c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd405d9b640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4080711b0 0x7fd408156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd406d9d640 1 -- 172.21.15.82:0/1005198030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4080711b0 msgr2=0x7fd408156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd406d9d640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4080711b0 0x7fd408156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd406d9d640 1 -- 172.21.15.82:0/1005198030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4080703f0 msgr2=0x7fd4080c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd406d9d640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4080703f0 0x7fd4080c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd406d9d640 1 -- 172.21.15.82:0/1005198030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4080c9810 con 0x7fd40815f970 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.485+0000 7fd406d9d640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40815f970 0x7fd4080b19f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd40002ac50 tx=0x7fd400004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.486+0000 7fd3feffd640 1 -- 172.21.15.82:0/1005198030 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400040070 con 0x7fd40815f970 2024-06-02T22:52:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.486+0000 7fd3feffd640 1 -- 172.21.15.82:0/1005198030 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd400031bc0 con 0x7fd40815f970 2024-06-02T22:52:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.486+0000 7fd40cbc1640 1 -- 172.21.15.82:0/1005198030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4080c9af0 con 0x7fd40815f970 2024-06-02T22:52:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.486+0000 7fd3feffd640 1 -- 172.21.15.82:0/1005198030 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400009450 con 0x7fd40815f970 2024-06-02T22:52:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.486+0000 7fd40cbc1640 1 -- 172.21.15.82:0/1005198030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4080ca0b0 con 0x7fd40815f970 2024-06-02T22:52:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.487+0000 7fd40cbc1640 1 -- 172.21.15.82:0/1005198030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd408068430 con 0x7fd40815f970 2024-06-02T22:52:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.487+0000 7fd3feffd640 1 -- 172.21.15.82:0/1005198030 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd400039040 con 0x7fd40815f970 2024-06-02T22:52:24.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.488+0000 7fd3feffd640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3e806be30 0x7fd3e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.488+0000 7fd3feffd640 1 -- 172.21.15.82:0/1005198030 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd4000ac920 con 0x7fd40815f970 2024-06-02T22:52:24.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.488+0000 7fd40659c640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3e806be30 0x7fd3e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.488+0000 7fd40659c640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3e806be30 0x7fd3e806e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009a30 tx=0x7fd3f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:24.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.492+0000 7fd3feffd640 1 -- 172.21.15.82:0/1005198030 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd40007b0b0 con 0x7fd40815f970 2024-06-02T22:52:24.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.670+0000 7fd40cbc1640 1 -- 172.21.15.82:0/1005198030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4080b3630 con 0x7fd40815f970 2024-06-02T22:52:24.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.671+0000 7fd3feffd640 1 -- 172.21.15.82:0/1005198030 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7fd40007a9b0 con 0x7fd40815f970 2024-06-02T22:52:24.671 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:24.672 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:07.942945+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.673+0000 7fd40cbc1640 1 -- 172.21.15.82:0/1005198030 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3e806be30 msgr2=0x7fd3e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.673+0000 7fd40cbc1640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3e806be30 0x7fd3e806e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009a30 tx=0x7fd3f8008040 comp rx=0 tx=0).stop 2024-06-02T22:52:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.673+0000 7fd40cbc1640 1 -- 172.21.15.82:0/1005198030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40815f970 msgr2=0x7fd4080b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.673+0000 7fd40cbc1640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40815f970 0x7fd4080b19f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd40002ac50 tx=0x7fd400004a40 comp rx=0 tx=0).stop 2024-06-02T22:52:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.673+0000 7fd40cbc1640 1 -- 172.21.15.82:0/1005198030 shutdown_connections 2024-06-02T22:52:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.673+0000 7fd40cbc1640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3e806be30 0x7fd3e806e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.673+0000 7fd40cbc1640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40815f970 0x7fd4080b19f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.673+0000 7fd40cbc1640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4080711b0 0x7fd408156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.673+0000 7fd40cbc1640 1 --2- 172.21.15.82:0/1005198030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4080703f0 0x7fd4080c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.673+0000 7fd40cbc1640 1 -- 172.21.15.82:0/1005198030 >> 172.21.15.82:0/1005198030 conn(0x7fd4080d1eb0 msgr2=0x7fd4080b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.674+0000 7fd40cbc1640 1 -- 172.21.15.82:0/1005198030 shutdown_connections 2024-06-02T22:52:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.674+0000 7fd40cbc1640 1 -- 172.21.15.82:0/1005198030 wait complete. 2024-06-02T22:52:24.684 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-06-02T22:52:24.684 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:24.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.784+0000 7f95ce609640 1 Processor -- start 2024-06-02T22:52:24.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.784+0000 7f95ce609640 1 -- start start 2024-06-02T22:52:24.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.785+0000 7f95ce609640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f95c80cc6d0 0x7f95c80ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.785+0000 7f95ce609640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95c8072110 0x7f95c80b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.785+0000 7f95ce609640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c8072580 con 0x7f95c8071c60 2024-06-02T22:52:24.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.785+0000 7f95ce609640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f95c80ccff0 con 0x7f95c80cc6d0 2024-06-02T22:52:24.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.785+0000 7f95ce609640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f95c8072820 con 0x7f95c8072110 2024-06-02T22:52:24.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.785+0000 7f95c77fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f95c8071c60 0x7f95c80b36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48084/0 (socket says 172.21.15.82:48084) 2024-06-02T22:52:24.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.785+0000 7f95c77fe640 1 -- 172.21.15.82:0/4004673850 learned_addr learned my addr 172.21.15.82:0/4004673850 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:24.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931578634 0 0) 0x7f95c8072580 con 0x7f95c8071c60 2024-06-02T22:52:24.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95b0003520 con 0x7f95c8071c60 2024-06-02T22:52:24.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c7fff640 1 --2- 172.21.15.82:0/4004673850 >> v2:172.21.15.184:3300/0 conn(0x7f95c80cc6d0 0x7f95c80ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95ccba6640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95c8072110 0x7f95c80b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3057994346 0 0) 0x7f95b0003520 con 0x7f95c8071c60 2024-06-02T22:52:24.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95c8072110 msgr2=0x7f95c80b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:24.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95c8072110 0x7f95c80b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 >> v2:172.21.15.184:3300/0 conn(0x7f95c80cc6d0 msgr2=0x7f95c80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:24.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 --2- 172.21.15.82:0/4004673850 >> v2:172.21.15.184:3300/0 conn(0x7f95c80cc6d0 0x7f95c80ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c8072b00 con 0x7f95c8071c60 2024-06-02T22:52:24.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f95bc001670 con 0x7f95c8071c60 2024-06-02T22:52:24.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 >> v1:172.21.15.82:6789/0 conn(0x7f95c8071c60 legacy=0x7f95c80b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95c8072110 0x7f95b00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95b0003f30 0x7f95b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95b0004d40 0x7f95b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95c80ccff0 con 0x7f95b0003f30 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8072820 con 0x7f95b0004d40 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f95b000b9c0 con 0x7f95c8072110 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c77fe640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95b0003f30 0x7f95b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c7fff640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95c8072110 0x7f95b00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95ccba6640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95b0004d40 0x7f95b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c77fe640 1 -- 172.21.15.82:0/4004673850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95c8072110 msgr2=0x7f95b00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c77fe640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95c8072110 0x7f95b00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c77fe640 1 -- 172.21.15.82:0/4004673850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95b0004d40 msgr2=0x7f95b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c77fe640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95b0004d40 0x7f95b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.786+0000 7f95c77fe640 1 -- 172.21.15.82:0/4004673850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b0003520 con 0x7f95b0003f30 2024-06-02T22:52:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.787+0000 7f95c77fe640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95b0003f30 0x7f95b0004800 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f95bc001050 tx=0x7f95b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2278ad76b7a66e69 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.787+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc007d70 con 0x7f95b0003f30 2024-06-02T22:52:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.787+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc005af0 con 0x7f95b0003f30 2024-06-02T22:52:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.787+0000 7f95c6ffd640 1 -- 172.21.15.82:0/4004673850 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc007070 con 0x7f95b0003f30 2024-06-02T22:52:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.788+0000 7f95ce609640 1 -- 172.21.15.82:0/4004673850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95b0003f30 msgr2=0x7f95b0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.788+0000 7f95ce609640 1 --2- 172.21.15.82:0/4004673850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95b0003f30 0x7f95b0004800 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f95bc001050 tx=0x7f95b0005830 comp rx=0 tx=0).stop 2024-06-02T22:52:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.788+0000 7f95ccba6640 1 -- 172.21.15.82:0/4004673850 reap_dead start 2024-06-02T22:52:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.788+0000 7f95ce609640 1 -- 172.21.15.82:0/4004673850 shutdown_connections 2024-06-02T22:52:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.788+0000 7f95ce609640 1 -- 172.21.15.82:0/4004673850 >> 172.21.15.82:0/4004673850 conn(0x7f95c80b19f0 msgr2=0x7f95c80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.788+0000 7f95ce609640 1 -- 172.21.15.82:0/4004673850 shutdown_connections 2024-06-02T22:52:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.788+0000 7f95ce609640 1 -- 172.21.15.82:0/4004673850 wait complete. 2024-06-02T22:52:24.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.789+0000 7f95ce609640 1 Processor -- start 2024-06-02T22:52:24.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.789+0000 7f95ce609640 1 -- start start 2024-06-02T22:52:24.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95ce609640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95b0003f30 0x7f95c81500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95ce609640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95c81506e0 0x7f95c81f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95ce609640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95c815e780 0x7f95c815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95ce609640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95c815c890 con 0x7f95c81506e0 2024-06-02T22:52:24.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95ce609640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f95c80b31a0 con 0x7f95c815e780 2024-06-02T22:52:24.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95ce609640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f95c8159f60 con 0x7f95b0003f30 2024-06-02T22:52:24.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95c77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95c81506e0 0x7f95c81f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95c77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95c81506e0 0x7f95c81f3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34324/0 (socket says 172.21.15.82:34324) 2024-06-02T22:52:24.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95c77fe640 1 -- 172.21.15.82:0/963056654 learned_addr learned my addr 172.21.15.82:0/963056654 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:24.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95c7fff640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95b0003f30 0x7f95c81500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95ccba6640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95c815e780 0x7f95c815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95c77fe640 1 -- 172.21.15.82:0/963056654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95b0003f30 msgr2=0x7f95c81500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95c77fe640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95b0003f30 0x7f95c81500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95c77fe640 1 -- 172.21.15.82:0/963056654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95c815e780 msgr2=0x7f95c815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95c77fe640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95c815e780 0x7f95c815ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.790+0000 7f95c77fe640 1 -- 172.21.15.82:0/963056654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c81f3ae0 con 0x7f95c81506e0 2024-06-02T22:52:24.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.791+0000 7f95c77fe640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95c81506e0 0x7f95c81f3400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00c2d0 tx=0x7f95bc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:24.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.791+0000 7f95c4ff9640 1 -- 172.21.15.82:0/963056654 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc042070 con 0x7f95c81506e0 2024-06-02T22:52:24.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.791+0000 7f95c4ff9640 1 -- 172.21.15.82:0/963056654 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc007480 con 0x7f95c81506e0 2024-06-02T22:52:24.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.791+0000 7f95c4ff9640 1 -- 172.21.15.82:0/963056654 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc007d50 con 0x7f95c81506e0 2024-06-02T22:52:24.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.791+0000 7f95ce609640 1 -- 172.21.15.82:0/963056654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c81f3dc0 con 0x7f95c81506e0 2024-06-02T22:52:24.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.791+0000 7f95ce609640 1 -- 172.21.15.82:0/963056654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c806d800 con 0x7f95c81506e0 2024-06-02T22:52:24.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.792+0000 7f95ce609640 1 -- 172.21.15.82:0/963056654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c80b4fe0 con 0x7f95c81506e0 2024-06-02T22:52:24.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.792+0000 7f95c4ff9640 1 -- 172.21.15.82:0/963056654 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95bc03b050 con 0x7f95c81506e0 2024-06-02T22:52:24.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.793+0000 7f95c4ff9640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f95b406be60 0x7f95b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:24.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.793+0000 7f95c7fff640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f95b406be60 0x7f95b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:24.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.793+0000 7f95c4ff9640 1 -- 172.21.15.82:0/963056654 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f95bc0ab700 con 0x7f95c81506e0 2024-06-02T22:52:24.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.793+0000 7f95c7fff640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f95b406be60 0x7f95b406e320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009bc0 tx=0x7f95b8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:24.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.797+0000 7f95c4ff9640 1 -- 172.21.15.82:0/963056654 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f95c80b4fe0 con 0x7f95c81506e0 2024-06-02T22:52:24.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.972+0000 7f95ce609640 1 -- 172.21.15.82:0/963056654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95c8068430 con 0x7f95c81506e0 2024-06-02T22:52:24.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.973+0000 7f95c4ff9640 1 -- 172.21.15.82:0/963056654 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f95bc005ac0 con 0x7f95c81506e0 2024-06-02T22:52:24.974 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:24.974 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:07.942945+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:24.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 -- 172.21.15.82:0/963056654 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f95b406be60 msgr2=0x7f95b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f95b406be60 0x7f95b406e320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009bc0 tx=0x7f95b8009190 comp rx=0 tx=0).stop 2024-06-02T22:52:24.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 -- 172.21.15.82:0/963056654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95c81506e0 msgr2=0x7f95c81f3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:24.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95c81506e0 0x7f95c81f3400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00c2d0 tx=0x7f95bc000fe0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 -- 172.21.15.82:0/963056654 shutdown_connections 2024-06-02T22:52:24.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f95b406be60 0x7f95b406e320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95c815e780 0x7f95c815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95c81506e0 0x7f95c81f3400 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 --2- 172.21.15.82:0/963056654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f95b0003f30 0x7f95c81500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 -- 172.21.15.82:0/963056654 >> 172.21.15.82:0/963056654 conn(0x7f95c80b19f0 msgr2=0x7f95c815cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 -- 172.21.15.82:0/963056654 shutdown_connections 2024-06-02T22:52:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:24.975+0000 7f95ce609640 1 -- 172.21.15.82:0/963056654 wait complete. 2024-06-02T22:52:24.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-06-02T22:52:24.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-06-02T22:52:24.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-06-02T22:52:24.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-06-02T22:52:24.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-06-02T22:52:24.989 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-06-02T22:52:24.989 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-06-02T22:52:24.989 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-06-02T22:52:25.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.160+0000 7f045b59e640 1 Processor -- start 2024-06-02T22:52:25.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.160+0000 7f045b59e640 1 -- start start 2024-06-02T22:52:25.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.161+0000 7fcdfee58640 1 Processor -- start 2024-06-02T22:52:25.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.161+0000 7f396aa78640 1 Processor -- start 2024-06-02T22:52:25.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.161+0000 7fcdfee58640 1 -- start start 2024-06-02T22:52:25.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.161+0000 7f045b59e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540e7880 0x7f0454050440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.161+0000 7f045b59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f04540071e0 0x7f0454050980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.161+0000 7f045b59e640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04540510c0 con 0x7f04540e74a0 2024-06-02T22:52:25.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.161+0000 7f045b59e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f04540539d0 con 0x7f04540071e0 2024-06-02T22:52:25.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.161+0000 7f045b59e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f04540513a0 con 0x7f04540e7880 2024-06-02T22:52:25.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7f3c449c8640 1 Processor -- start 2024-06-02T22:52:25.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7f3c449c8640 1 -- start start 2024-06-02T22:52:25.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7f045ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f04540071e0 0x7f0454050980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7f0459d9b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540e7880 0x7f0454050440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7f0459d9b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540e7880 0x7f0454050440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42538/0 (socket says 172.21.15.82:42538) 2024-06-02T22:52:25.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7f0459d9b640 1 -- 172.21.15.82:0/3944989065 learned_addr learned my addr 172.21.15.82:0/3944989065 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7fbba14a7640 1 Processor -- start 2024-06-02T22:52:25.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7f396aa78640 1 -- start start 2024-06-02T22:52:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f3c449c8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3c4015a3b0 0x7f3c4015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f3c449c8640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3c400af4e0 0x7f3c400cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f3c449c8640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4006dfd0 con 0x7f3c400cdb40 2024-06-02T22:52:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f3c449c8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3c400b4050 con 0x7f3c4015a3b0 2024-06-02T22:52:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f3c449c8640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f3c400ce930 con 0x7f3c400af4e0 2024-06-02T22:52:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f3c3dd9b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3c400af4e0 0x7f3c400cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3c3e59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3c4015a3b0 0x7f3c4015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3c3dd9b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3c400af4e0 0x7f3c400cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45510/0 (socket says 172.21.15.82:45510) 2024-06-02T22:52:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3c3dd9b640 1 -- 172.21.15.82:0/3693473453 learned_addr learned my addr 172.21.15.82:0/3693473453 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7fbba14a7640 1 -- start start 2024-06-02T22:52:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7fcdfde56640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcdf00df220 0x7fcdf003a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48096/0 (socket says 172.21.15.82:48096) 2024-06-02T22:52:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7fcdfde56640 1 -- 172.21.15.82:0/3939401773 learned_addr learned my addr 172.21.15.82:0/3939401773 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7fcdfee58640 1 --2- 172.21.15.82:0/3939401773 >> v2:172.21.15.82:3300/0 conn(0x7fcdf00e2d80 0x7fcdf00e31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7fcdfee58640 1 --2- 172.21.15.82:0/3939401773 >> v2:172.21.15.184:3300/0 conn(0x7fcdf0006ae0 0x7fcdf0006f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7fcdfd655640 1 --2- 172.21.15.82:0/3939401773 >> v2:172.21.15.82:3300/0 conn(0x7fcdf00e2d80 0x7fcdf00e31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7fcdfee58640 1 -- 172.21.15.82:0/3939401773 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf0054640 con 0x7fcdf00df220 2024-06-02T22:52:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7fcdfee58640 1 -- 172.21.15.82:0/3939401773 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fcdf00e3720 con 0x7fcdf00e2d80 2024-06-02T22:52:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7fcdfee58640 1 -- 172.21.15.82:0/3939401773 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fcdf00543f0 con 0x7fcdf0006ae0 2024-06-02T22:52:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7fbd52343640 1 Processor -- start 2024-06-02T22:52:25.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7fbd52343640 1 -- start start 2024-06-02T22:52:25.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7f0459d9b640 1 -- 172.21.15.82:0/3944989065 >> v2:172.21.15.82:3300/0 conn(0x7f04540071e0 msgr2=0x7f0454050980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7f0459d9b640 1 --2- 172.21.15.82:0/3944989065 >> v2:172.21.15.82:3300/0 conn(0x7f04540071e0 0x7f0454050980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7f0459d9b640 1 -- 172.21.15.82:0/3944989065 >> v1:172.21.15.184:6789/0 conn(0x7f04540e74a0 legacy=0x7f0454006ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7f0459d9b640 1 -- 172.21.15.82:0/3944989065 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0454051680 con 0x7f04540e7880 2024-06-02T22:52:25.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f0459d9b640 1 --2- 172.21.15.82:0/3944989065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540e7880 0x7f0454050440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f044c009870 tx=0x7f044c02a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44ac56b08a2ead8f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.162+0000 7ff68abf1640 1 Processor -- start 2024-06-02T22:52:25.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7fdcb862c640 1 Processor -- start 2024-06-02T22:52:25.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7fdcb862c640 1 -- start start 2024-06-02T22:52:25.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7fcdfe657640 1 --2- 172.21.15.82:0/3939401773 >> v2:172.21.15.184:3300/0 conn(0x7fcdf0006ae0 0x7fcdf0006f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7ff68abf1640 1 -- start start 2024-06-02T22:52:25.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7ff68abf1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff67c0dfef0 0x7ff67c0085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f396aa78640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964144610 0x7f39640b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f396aa78640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f396406faf0 0x7f39640d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f396aa78640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3964072e90 0x7f39640d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f396aa78640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f396406df90 con 0x7f396406faf0 2024-06-02T22:52:25.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f396aa78640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f396415f6a0 con 0x7f3964072e90 2024-06-02T22:52:25.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.163+0000 7f396aa78640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f39640cea40 con 0x7f3964144610 2024-06-02T22:52:25.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3969275640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f396406faf0 0x7f39640d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3969275640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f396406faf0 0x7f39640d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34354/0 (socket says 172.21.15.82:34354) 2024-06-02T22:52:25.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3969275640 1 -- 172.21.15.82:0/4001916679 learned_addr learned my addr 172.21.15.82:0/4001916679 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f396a277640 1 --2- 172.21.15.82:0/4001916679 >> v2:172.21.15.184:3300/0 conn(0x7f3964072e90 0x7f39640d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3969a76640 1 --2- 172.21.15.82:0/4001916679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964144610 0x7f39640b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3c3dd9b640 1 -- 172.21.15.82:0/3693473453 >> v2:172.21.15.82:3300/0 conn(0x7f3c4015a3b0 msgr2=0x7f3c4015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3c3dd9b640 1 --2- 172.21.15.82:0/3693473453 >> v2:172.21.15.82:3300/0 conn(0x7f3c4015a3b0 0x7f3c4015ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3c3dd9b640 1 -- 172.21.15.82:0/3693473453 >> v1:172.21.15.184:6789/0 conn(0x7f3c400cdb40 legacy=0x7f3c400b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3c3dd9b640 1 -- 172.21.15.82:0/3693473453 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4006e2b0 con 0x7f3c400af4e0 2024-06-02T22:52:25.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7ff68abf1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff67c0e02d0 0x7ff67c0e3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7ff68abf1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67c056590 con 0x7ff67c0e4100 2024-06-02T22:52:25.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7ff68abf1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff67c0e4550 con 0x7ff67c0e02d0 2024-06-02T22:52:25.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7ff68abf1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff67c0094b0 con 0x7ff67c0dfef0 2024-06-02T22:52:25.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7fbba14a7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb9c144610 0x7fbb9c0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3969a76640 1 -- 172.21.15.82:0/4001916679 >> v2:172.21.15.184:3300/0 conn(0x7f3964072e90 msgr2=0x7f39640d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3969a76640 1 --2- 172.21.15.82:0/4001916679 >> v2:172.21.15.184:3300/0 conn(0x7f3964072e90 0x7f39640d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3969a76640 1 -- 172.21.15.82:0/4001916679 >> v2:172.21.15.82:3300/0 conn(0x7f396406faf0 msgr2=0x7f39640d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3969a76640 1 --2- 172.21.15.82:0/4001916679 >> v2:172.21.15.82:3300/0 conn(0x7f396406faf0 0x7f39640d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7fbba14a7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb9c0d11e0 0x7fbb9c06e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.164+0000 7f3969a76640 1 -- 172.21.15.82:0/4001916679 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39640ced20 con 0x7f3964144610 2024-06-02T22:52:25.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7ff6893ee640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff67c0e02d0 0x7ff67c0e3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7ff6893ee640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff67c0e02d0 0x7ff67c0e3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34368/0 (socket says 172.21.15.82:34368) 2024-06-02T22:52:25.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7ff6893ee640 1 -- 172.21.15.82:0/81426484 learned_addr learned my addr 172.21.15.82:0/81426484 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7ff689bef640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff67c0dfef0 0x7ff67c0085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbba14a7640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb9c06df90 con 0x7fbb9c06faf0 2024-06-02T22:52:25.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbba14a7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbb9c15f6a0 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbba14a7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9c0cea40 con 0x7fbb9c144610 2024-06-02T22:52:25.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbba0ca6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb9c0d11e0 0x7fbb9c06e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbba0ca6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb9c0d11e0 0x7fbb9c06e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34384/0 (socket says 172.21.15.82:34384) 2024-06-02T22:52:25.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbba0ca6640 1 -- 172.21.15.82:0/1551254897 learned_addr learned my addr 172.21.15.82:0/1551254897 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fcdfe657640 1 -- 172.21.15.82:0/3939401773 >> v2:172.21.15.82:3300/0 conn(0x7fcdf00e2d80 msgr2=0x7fcdf00e31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fcdfe657640 1 --2- 172.21.15.82:0/3939401773 >> v2:172.21.15.82:3300/0 conn(0x7fcdf00e2d80 0x7fcdf00e31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fcdfe657640 1 -- 172.21.15.82:0/3939401773 >> v1:172.21.15.82:6789/0 conn(0x7fcdf00df220 legacy=0x7fcdf003a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fcdfe657640 1 -- 172.21.15.82:0/3939401773 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf0054920 con 0x7fcdf0006ae0 2024-06-02T22:52:25.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbd52343640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd4c06d920 0x7fbd4c163030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbd52343640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd4c06cba0 con 0x7fbd4c0d0510 2024-06-02T22:52:25.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbd52343640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd4c0cf7a0 con 0x7fbd4c0cf3c0 2024-06-02T22:52:25.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbd52343640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbd4c06d490 con 0x7fbd4c06d920 2024-06-02T22:52:25.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7ff6893ee640 1 -- 172.21.15.82:0/81426484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff67c0dfef0 msgr2=0x7ff67c0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7ff6893ee640 1 --2- 172.21.15.82:0/81426484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff67c0dfef0 0x7ff67c0085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7ff6893ee640 1 -- 172.21.15.82:0/81426484 >> v1:172.21.15.82:6789/0 conn(0x7ff67c0e4100 legacy=0x7ff67c03a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7ff6893ee640 1 -- 172.21.15.82:0/81426484 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c056870 con 0x7ff67c0e02d0 2024-06-02T22:52:25.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7f3c3dd9b640 1 --2- 172.21.15.82:0/3693473453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c400af4e0 0x7f3c400cc6d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c400b2a30 tx=0x7f3c3402c6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5110448ec205534 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbd50b40640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbd4c0d0510 0x7fbd4c162920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48110/0 (socket says 172.21.15.82:48110) 2024-06-02T22:52:25.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbd50b40640 1 -- 172.21.15.82:0/1534600069 learned_addr learned my addr 172.21.15.82:0/1534600069 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:25.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbd51b42640 1 --2- 172.21.15.82:0/1534600069 >> v2:172.21.15.82:3300/0 conn(0x7fbd4c06d920 0x7fbd4c163030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.165+0000 7fbb9bfff640 1 --2- 172.21.15.82:0/1551254897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb9c144610 0x7fbb9c0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fbb9bfff640 1 -- 172.21.15.82:0/1551254897 >> v2:172.21.15.82:3300/0 conn(0x7fbb9c0d11e0 msgr2=0x7fbb9c06e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fdcb862c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdca80df410 0x7fdca8038170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7f045959a640 1 -- 172.21.15.82:0/3944989065 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c037070 con 0x7f04540e7880 2024-06-02T22:52:25.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7f045959a640 1 -- 172.21.15.82:0/3944989065 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044c032440 con 0x7f04540e7880 2024-06-02T22:52:25.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7f045959a640 1 -- 172.21.15.82:0/3944989065 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c032830 con 0x7f04540e7880 2024-06-02T22:52:25.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7f3c3d59a640 1 -- 172.21.15.82:0/3693473453 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3403a070 con 0x7f3c400af4e0 2024-06-02T22:52:25.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fdcb862c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca8005f60 con 0x7fdca8050140 2024-06-02T22:52:25.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fdcb862c640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca80e38e0 con 0x7fdca80df030 2024-06-02T22:52:25.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fbb9bfff640 1 --2- 172.21.15.82:0/1551254897 >> v2:172.21.15.82:3300/0 conn(0x7fbb9c0d11e0 0x7fbb9c06e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fbb9bfff640 1 -- 172.21.15.82:0/1551254897 >> v1:172.21.15.184:6789/0 conn(0x7fbb9c06faf0 legacy=0x7fbb9c0d0ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:52:25.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7f3969a76640 1 --2- 172.21.15.82:0/4001916679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964144610 0x7f39640b3ad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f39640cf830 tx=0x7f396002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=104e081724b26e06 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fbb9bfff640 1 -- 172.21.15.82:0/1551254897 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c0ced20 con 0x7fbb9c144610 2024-06-02T22:52:25.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fdcb6bc9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdca80df410 0x7fdca8038170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fdcb6bc9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdca80df410 0x7fdca8038170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42582/0 (socket says 172.21.15.82:42582) 2024-06-02T22:52:25.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fdcb6bc9640 1 -- 172.21.15.82:0/315086613 learned_addr learned my addr 172.21.15.82:0/315086613 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fdcb862c640 1 -- 172.21.15.82:0/315086613 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdca8006200 con 0x7fdca80df410 2024-06-02T22:52:25.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7f3c3d59a640 1 -- 172.21.15.82:0/3693473453 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c34032480 con 0x7f3c400af4e0 2024-06-02T22:52:25.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7f3c3d59a640 1 -- 172.21.15.82:0/3693473453 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34032850 con 0x7f3c400af4e0 2024-06-02T22:52:25.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fcdfe657640 1 --2- 172.21.15.82:0/3939401773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdf0006ae0 0x7fcdf0006f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcdf004f6a0 tx=0x7fcde802c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9677b258bf19b4d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fbd51b42640 1 -- 172.21.15.82:0/1534600069 >> v1:172.21.15.184:6789/0 conn(0x7fbd4c0cf3c0 legacy=0x7fbd4c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fbd51b42640 1 -- 172.21.15.82:0/1534600069 >> v1:172.21.15.82:6789/0 conn(0x7fbd4c0d0510 legacy=0x7fbd4c162920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fbd51b42640 1 -- 172.21.15.82:0/1534600069 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4c1636a0 con 0x7fbd4c06d920 2024-06-02T22:52:25.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7ff6893ee640 1 --2- 172.21.15.82:0/81426484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0e02d0 0x7ff67c0e3bc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff684069a30 tx=0x7ff6840a5870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7204aae2d8cd4bd1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7fdcb53c6640 1 -- 172.21.15.82:0/315086613 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848371881 0 0) 0x7fdca80e38e0 con 0x7fdca80df030 2024-06-02T22:52:25.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7fbb9bfff640 1 --2- 172.21.15.82:0/1551254897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb9c144610 0x7fbb9c0b3ad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0d09d0 tx=0x7fbb8c02c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36b441888da4865e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fcdfce54640 1 -- 172.21.15.82:0/3939401773 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8039070 con 0x7fcdf0006ae0 2024-06-02T22:52:25.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fcdfce54640 1 -- 172.21.15.82:0/3939401773 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde8034640 con 0x7fcdf0006ae0 2024-06-02T22:52:25.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7fcdfce54640 1 -- 172.21.15.82:0/3939401773 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8034a10 con 0x7fcdf0006ae0 2024-06-02T22:52:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f045b59e640 1 -- 172.21.15.82:0/3944989065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540e7880 msgr2=0x7f0454050440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f045b59e640 1 --2- 172.21.15.82:0/3944989065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540e7880 0x7f0454050440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f044c009870 tx=0x7f044c02a290 comp rx=0 tx=0).stop 2024-06-02T22:52:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7ff688bed640 1 -- 172.21.15.82:0/81426484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68406d440 con 0x7ff67c0e02d0 2024-06-02T22:52:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7ff688bed640 1 -- 172.21.15.82:0/81426484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68406d5e0 con 0x7ff67c0e02d0 2024-06-02T22:52:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7ff688bed640 1 -- 172.21.15.82:0/81426484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68406da50 con 0x7ff67c0e02d0 2024-06-02T22:52:25.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7fdcb53c6640 1 -- 172.21.15.82:0/315086613 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc9c003520 con 0x7fdca80df030 2024-06-02T22:52:25.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7fdcb6bc9640 1 -- 172.21.15.82:0/315086613 >> v1:172.21.15.184:6789/0 conn(0x7fdca80df030 legacy=0x7fdca804fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7fdcb6bc9640 1 -- 172.21.15.82:0/315086613 >> v1:172.21.15.82:6789/0 conn(0x7fdca8050140 legacy=0x7fdca8006a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7fdcb6bc9640 1 -- 172.21.15.82:0/315086613 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca80064e0 con 0x7fdca80df410 2024-06-02T22:52:25.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f3c449c8640 1 -- 172.21.15.82:0/3693473453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c400af4e0 msgr2=0x7f3c400cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f3c449c8640 1 --2- 172.21.15.82:0/3693473453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c400af4e0 0x7f3c400cc6d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c400b2a30 tx=0x7f3c3402c6b0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f045b59e640 1 -- 172.21.15.82:0/3944989065 shutdown_connections 2024-06-02T22:52:25.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f045b59e640 1 --2- 172.21.15.82:0/3944989065 >> v2:172.21.15.82:3300/0 conn(0x7f04540071e0 0x7f0454050980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f045b59e640 1 --2- 172.21.15.82:0/3944989065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540e7880 0x7f0454050440 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f045b59e640 1 -- 172.21.15.82:0/3944989065 >> 172.21.15.82:0/3944989065 conn(0x7f0454055bd0 msgr2=0x7f0454055fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.166+0000 7f3968a74640 1 -- 172.21.15.82:0/4001916679 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960037070 con 0x7f3964144610 2024-06-02T22:52:25.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f3968a74640 1 -- 172.21.15.82:0/4001916679 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396002ae50 con 0x7f3964144610 2024-06-02T22:52:25.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f3968a74640 1 -- 172.21.15.82:0/4001916679 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960032660 con 0x7f3964144610 2024-06-02T22:52:25.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7fbb9affd640 1 -- 172.21.15.82:0/1551254897 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c039070 con 0x7fbb9c144610 2024-06-02T22:52:25.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7fbb9affd640 1 -- 172.21.15.82:0/1551254897 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb8c034640 con 0x7fbb9c144610 2024-06-02T22:52:25.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f396aa78640 1 -- 172.21.15.82:0/4001916679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964144610 msgr2=0x7f39640b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f396aa78640 1 --2- 172.21.15.82:0/4001916679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964144610 0x7f39640b3ad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f39640cf830 tx=0x7f396002a100 comp rx=0 tx=0).stop 2024-06-02T22:52:25.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7fbd51b42640 1 --2- 172.21.15.82:0/1534600069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4c06d920 0x7fbd4c163030 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009d90 tx=0x7fbd4402a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8942a38446f2287e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f396aa78640 1 -- 172.21.15.82:0/4001916679 shutdown_connections 2024-06-02T22:52:25.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f396aa78640 1 --2- 172.21.15.82:0/4001916679 >> v2:172.21.15.184:3300/0 conn(0x7f3964072e90 0x7f39640d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f396aa78640 1 --2- 172.21.15.82:0/4001916679 >> v2:172.21.15.82:3300/0 conn(0x7f396406faf0 0x7f39640d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f396aa78640 1 --2- 172.21.15.82:0/4001916679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964144610 0x7f39640b3ad0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f396aa78640 1 -- 172.21.15.82:0/4001916679 >> 172.21.15.82:0/4001916679 conn(0x7f39640b27d0 msgr2=0x7f39640b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f3c449c8640 1 -- 172.21.15.82:0/3693473453 shutdown_connections 2024-06-02T22:52:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f3c449c8640 1 --2- 172.21.15.82:0/3693473453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c400af4e0 0x7f3c400cc6d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f3c449c8640 1 --2- 172.21.15.82:0/3693473453 >> v2:172.21.15.82:3300/0 conn(0x7f3c4015a3b0 0x7f3c4015ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7f396aa78640 1 -- 172.21.15.82:0/4001916679 shutdown_connections 2024-06-02T22:52:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7f396aa78640 1 -- 172.21.15.82:0/4001916679 wait complete. 2024-06-02T22:52:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fcdfee58640 1 -- 172.21.15.82:0/3939401773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdf0006ae0 msgr2=0x7fcdf0006f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fcdfee58640 1 --2- 172.21.15.82:0/3939401773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdf0006ae0 0x7fcdf0006f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcdf004f6a0 tx=0x7fcde802c3b0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.167+0000 7f3c449c8640 1 -- 172.21.15.82:0/3693473453 >> 172.21.15.82:0/3693473453 conn(0x7f3c400b19f0 msgr2=0x7f3c400b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fbd3ffff640 1 -- 172.21.15.82:0/1534600069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44007740 con 0x7fbd4c06d920 2024-06-02T22:52:25.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fbb9affd640 1 -- 172.21.15.82:0/1551254897 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c034a10 con 0x7fbb9c144610 2024-06-02T22:52:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7f3c449c8640 1 -- 172.21.15.82:0/3693473453 shutdown_connections 2024-06-02T22:52:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fdcb6bc9640 1 --2- 172.21.15.82:0/315086613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdca80df410 0x7fdca8038170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdca00098a0 tx=0x7fdca002a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788b7220b3b7a46f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7ff68abf1640 1 -- 172.21.15.82:0/81426484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0e02d0 msgr2=0x7ff67c0e3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7ff68abf1640 1 --2- 172.21.15.82:0/81426484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0e02d0 0x7ff67c0e3bc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff684069a30 tx=0x7ff6840a5870 comp rx=0 tx=0).stop 2024-06-02T22:52:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fbd3ffff640 1 -- 172.21.15.82:0/1534600069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd440078e0 con 0x7fbd4c06d920 2024-06-02T22:52:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7ff68abf1640 1 -- 172.21.15.82:0/81426484 shutdown_connections 2024-06-02T22:52:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7ff68abf1640 1 --2- 172.21.15.82:0/81426484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0e02d0 0x7ff67c0e3bc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7ff68abf1640 1 --2- 172.21.15.82:0/81426484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff67c0dfef0 0x7ff67c0085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7f045b59e640 1 -- 172.21.15.82:0/3944989065 shutdown_connections 2024-06-02T22:52:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7ff68abf1640 1 -- 172.21.15.82:0/81426484 >> 172.21.15.82:0/81426484 conn(0x7ff67c01ef40 msgr2=0x7ff67c055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7f3c449c8640 1 -- 172.21.15.82:0/3693473453 wait complete. 2024-06-02T22:52:25.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fdcb53c6640 1 -- 172.21.15.82:0/315086613 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0037070 con 0x7fdca80df410 2024-06-02T22:52:25.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fdcb53c6640 1 -- 172.21.15.82:0/315086613 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca0032440 con 0x7fdca80df410 2024-06-02T22:52:25.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fdcb53c6640 1 -- 172.21.15.82:0/315086613 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0032850 con 0x7fdca80df410 2024-06-02T22:52:25.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7ff68abf1640 1 -- 172.21.15.82:0/81426484 shutdown_connections 2024-06-02T22:52:25.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7fbba14a7640 1 -- 172.21.15.82:0/1551254897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb9c144610 msgr2=0x7fbb9c0b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7fbba14a7640 1 --2- 172.21.15.82:0/1551254897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb9c144610 0x7fbb9c0b3ad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0d09d0 tx=0x7fbb8c02c330 comp rx=0 tx=0).stop 2024-06-02T22:52:25.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7fbd52343640 1 -- 172.21.15.82:0/1534600069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4c06d920 msgr2=0x7fbd4c163030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7fbd52343640 1 --2- 172.21.15.82:0/1534600069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4c06d920 0x7fbd4c163030 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009d90 tx=0x7fbd4402a580 comp rx=0 tx=0).stop 2024-06-02T22:52:25.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7ff68abf1640 1 -- 172.21.15.82:0/81426484 wait complete. 2024-06-02T22:52:25.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7f045b59e640 1 -- 172.21.15.82:0/3944989065 wait complete. 2024-06-02T22:52:25.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7f396aa78640 1 Processor -- start 2024-06-02T22:52:25.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7f396aa78640 1 -- start start 2024-06-02T22:52:25.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7fbba14a7640 1 -- 172.21.15.82:0/1551254897 shutdown_connections 2024-06-02T22:52:25.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7fbba14a7640 1 --2- 172.21.15.82:0/1551254897 >> v2:172.21.15.82:3300/0 conn(0x7fbb9c0d11e0 0x7fbb9c06e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7fbba14a7640 1 --2- 172.21.15.82:0/1551254897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb9c144610 0x7fbb9c0b3ad0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7fbba14a7640 1 -- 172.21.15.82:0/1551254897 >> 172.21.15.82:0/1551254897 conn(0x7fbb9c0b27d0 msgr2=0x7fbb9c0b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fcdfee58640 1 -- 172.21.15.82:0/3939401773 shutdown_connections 2024-06-02T22:52:25.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fcdfee58640 1 --2- 172.21.15.82:0/3939401773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdf0006ae0 0x7fcdf0006f70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fcdfee58640 1 --2- 172.21.15.82:0/3939401773 >> v2:172.21.15.82:3300/0 conn(0x7fcdf00e2d80 0x7fcdf00e31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.168+0000 7fcdfee58640 1 -- 172.21.15.82:0/3939401773 >> 172.21.15.82:0/3939401773 conn(0x7fcdf000a400 msgr2=0x7fcdf000a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7fcdfee58640 1 -- 172.21.15.82:0/3939401773 shutdown_connections 2024-06-02T22:52:25.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.169+0000 7fcdfee58640 1 -- 172.21.15.82:0/3939401773 wait complete. 2024-06-02T22:52:25.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7f3c449c8640 1 Processor -- start 2024-06-02T22:52:25.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7f3c449c8640 1 -- start start 2024-06-02T22:52:25.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7fdcb862c640 1 -- 172.21.15.82:0/315086613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdca80df410 msgr2=0x7fdca8038170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7fdcb862c640 1 --2- 172.21.15.82:0/315086613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdca80df410 0x7fdca8038170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdca00098a0 tx=0x7fdca002a2c0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7fbd52343640 1 -- 172.21.15.82:0/1534600069 shutdown_connections 2024-06-02T22:52:25.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7fbd52343640 1 --2- 172.21.15.82:0/1534600069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4c06d920 0x7fbd4c163030 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7fbd52343640 1 -- 172.21.15.82:0/1534600069 >> 172.21.15.82:0/1534600069 conn(0x7fbd4c06b7b0 msgr2=0x7fbd4c06bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3c449c8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c400af4e0 0x7f3c40150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3c449c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c400cdb40 0x7f3c401589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3c449c8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c4015a3b0 0x7f3c40158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3c449c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c400cfa80 con 0x7f3c400cdb40 2024-06-02T22:52:25.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3c449c8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4006ee30 con 0x7f3c400af4e0 2024-06-02T22:52:25.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3c449c8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4006e870 con 0x7f3c4015a3b0 2024-06-02T22:52:25.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3c3e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c400af4e0 0x7f3c40150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3c3e59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c400af4e0 0x7f3c40150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45534/0 (socket says 172.21.15.82:45534) 2024-06-02T22:52:25.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3c3e59c640 1 -- 172.21.15.82:0/3018509572 learned_addr learned my addr 172.21.15.82:0/3018509572 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3c3ed9d640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c4015a3b0 0x7f3c40158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3c3dd9b640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c400cdb40 0x7f3c401589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7fbba14a7640 1 -- 172.21.15.82:0/1551254897 shutdown_connections 2024-06-02T22:52:25.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7fbba14a7640 1 -- 172.21.15.82:0/1551254897 wait complete. 2024-06-02T22:52:25.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7f396aa78640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396406faf0 0x7f39641355a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7f396aa78640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964072e90 0x7f3964129b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7f396aa78640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964144610 0x7f39641328a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7f396aa78640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f39641449f0 con 0x7f3964144610 2024-06-02T22:52:25.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7f396aa78640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f39640b4010 con 0x7f396406faf0 2024-06-02T22:52:25.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7f396aa78640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f396415f300 con 0x7f3964072e90 2024-06-02T22:52:25.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f396a277640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964144610 0x7f39641328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f396a277640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964144610 0x7f39641328a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34394/0 (socket says 172.21.15.82:34394) 2024-06-02T22:52:25.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f396a277640 1 -- 172.21.15.82:0/2886722914 learned_addr learned my addr 172.21.15.82:0/2886722914 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7fcdfee58640 1 Processor -- start 2024-06-02T22:52:25.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7fcdfee58640 1 -- start start 2024-06-02T22:52:25.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7fbd52343640 1 -- 172.21.15.82:0/1534600069 shutdown_connections 2024-06-02T22:52:25.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7f045b59e640 1 Processor -- start 2024-06-02T22:52:25.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7f045b59e640 1 -- start start 2024-06-02T22:52:25.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7ff68abf1640 1 Processor -- start 2024-06-02T22:52:25.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7ff68abf1640 1 -- start start 2024-06-02T22:52:25.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7ff68abf1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff67c0dfef0 0x7ff67c049650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7ff68abf1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0e4100 0x7ff67c052b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7ff68abf1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff67c033880 0x7ff67c033d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7ff68abf1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c056b50 con 0x7ff67c0e4100 2024-06-02T22:52:25.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7ff68abf1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c009140 con 0x7ff67c033880 2024-06-02T22:52:25.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7ff68abf1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff67c008b10 con 0x7ff67c0dfef0 2024-06-02T22:52:25.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.170+0000 7fbd52343640 1 -- 172.21.15.82:0/1534600069 wait complete. 2024-06-02T22:52:25.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7ff68a3f0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff67c033880 0x7ff67c033d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7fbd52343640 1 Processor -- start 2024-06-02T22:52:25.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7ff68a3f0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff67c033880 0x7ff67c033d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45548/0 (socket says 172.21.15.82:45548) 2024-06-02T22:52:25.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f3c3e59c640 1 -- 172.21.15.82:0/3018509572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c4015a3b0 msgr2=0x7f3c40158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f3c3e59c640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c4015a3b0 0x7f3c40158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f3c3e59c640 1 -- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c400cdb40 msgr2=0x7f3c401589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f3c3e59c640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c400cdb40 0x7f3c401589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f3c3e59c640 1 -- 172.21.15.82:0/3018509572 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c40150fe0 con 0x7f3c400af4e0 2024-06-02T22:52:25.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7fbd52343640 1 -- start start 2024-06-02T22:52:25.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7ff68a3f0640 1 -- 172.21.15.82:0/4080223466 learned_addr learned my addr 172.21.15.82:0/4080223466 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3969275640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964072e90 0x7f3964129b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3969a76640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396406faf0 0x7f39641355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3969275640 1 -- 172.21.15.82:0/2886722914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396406faf0 msgr2=0x7f39641355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3969275640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396406faf0 0x7f39641355a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3969275640 1 -- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964144610 msgr2=0x7f39641328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3969275640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964144610 0x7f39641328a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7f3969275640 1 -- 172.21.15.82:0/2886722914 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396412a4f0 con 0x7f3964072e90 2024-06-02T22:52:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f3969275640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964072e90 0x7f3964129b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f395400d5d0 tx=0x7f395400da90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f395a7fc640 1 -- 172.21.15.82:0/2886722914 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954018020 con 0x7f3964072e90 2024-06-02T22:52:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7fbba14a7640 1 Processor -- start 2024-06-02T22:52:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f395a7fc640 1 -- 172.21.15.82:0/2886722914 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3954014620 con 0x7f3964072e90 2024-06-02T22:52:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f395a7fc640 1 -- 172.21.15.82:0/2886722914 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954018020 con 0x7f3964072e90 2024-06-02T22:52:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f3c3e59c640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c400af4e0 0x7f3c40150aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000dbc0 tx=0x7f3c3000b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7f3c2effd640 1 -- 172.21.15.82:0/3018509572 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000a650 con 0x7f3c400af4e0 2024-06-02T22:52:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fcdfee58640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdf0006ae0 0x7fcdf00d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7f3c2effd640 1 -- 172.21.15.82:0/3018509572 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3000a7f0 con 0x7f3c400af4e0 2024-06-02T22:52:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7f3c2effd640 1 -- 172.21.15.82:0/3018509572 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000abc0 con 0x7f3c400af4e0 2024-06-02T22:52:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7f3c449c8640 1 -- 172.21.15.82:0/3018509572 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c40153400 con 0x7f3c400af4e0 2024-06-02T22:52:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7f3c449c8640 1 -- 172.21.15.82:0/3018509572 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c401539c0 con 0x7f3c400af4e0 2024-06-02T22:52:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fbba14a7640 1 -- start start 2024-06-02T22:52:25.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fcdfee58640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdf00df220 0x7fcdf00e0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fcdfee58640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00e2d80 0x7fcdf0036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fcdfe657640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00e2d80 0x7fcdf0036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fcdfe657640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00e2d80 0x7fcdf0036ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34426/0 (socket says 172.21.15.82:34426) 2024-06-02T22:52:25.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fcdfe657640 1 -- 172.21.15.82:0/3552180388 learned_addr learned my addr 172.21.15.82:0/3552180388 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf00065c0 con 0x7fcdf00e2d80 2024-06-02T22:52:25.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf00062e0 con 0x7fcdf0006ae0 2024-06-02T22:52:25.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf00df600 con 0x7fcdf00df220 2024-06-02T22:52:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fbd52343640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd4c06d920 0x7fbd4c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fbd52343640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4c0cf3c0 0x7fbd4c152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbd52343640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd4c0d0510 0x7fbd4c157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbd52343640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c16cf90 con 0x7fbd4c0cf3c0 2024-06-02T22:52:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbd52343640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c06d120 con 0x7fbd4c0d0510 2024-06-02T22:52:25.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbd52343640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbd4c16d110 con 0x7fbd4c06d920 2024-06-02T22:52:25.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7ff6893ee640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0e4100 0x7ff67c052b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7ff6893ee640 1 -- 172.21.15.82:0/4080223466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff67c0dfef0 msgr2=0x7ff67c049650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:52:25.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7ff6893ee640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff67c0dfef0 0x7ff67c049650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7ff6893ee640 1 -- 172.21.15.82:0/4080223466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff67c033880 msgr2=0x7ff67c033d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7ff6893ee640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff67c033880 0x7ff67c033d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7ff6893ee640 1 -- 172.21.15.82:0/4080223466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c050460 con 0x7ff67c0e4100 2024-06-02T22:52:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7fdcb862c640 1 -- 172.21.15.82:0/315086613 shutdown_connections 2024-06-02T22:52:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7fdcb862c640 1 --2- 172.21.15.82:0/315086613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdca80df410 0x7fdca8038170 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7fdcb862c640 1 -- 172.21.15.82:0/315086613 >> 172.21.15.82:0/315086613 conn(0x7fdca8009fe0 msgr2=0x7fdca800a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7fdcb862c640 1 -- 172.21.15.82:0/315086613 shutdown_connections 2024-06-02T22:52:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.171+0000 7fdcb862c640 1 -- 172.21.15.82:0/315086613 wait complete. 2024-06-02T22:52:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fdcb862c640 1 Processor -- start 2024-06-02T22:52:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7fdcb862c640 1 -- start start 2024-06-02T22:52:25.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbd51341640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd4c06d920 0x7fbd4c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbd50b40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4c0cf3c0 0x7fbd4c152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbba14a7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb9c06faf0 0x7fbb9c13c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7f3c2cff9640 1 -- 172.21.15.82:0/3018509572 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c18001030 con 0x7f3c400af4e0 2024-06-02T22:52:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbba14a7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c0d11e0 0x7fbb9c13d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbba14a7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb9c144610 0x7fbb9c13dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbba14a7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c1449f0 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbba14a7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c0b4010 con 0x7fbb9c06faf0 2024-06-02T22:52:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbba14a7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9c15f300 con 0x7fbb9c144610 2024-06-02T22:52:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fcdfe657640 1 -- 172.21.15.82:0/3552180388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdf00df220 msgr2=0x7fcdf00e0a90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:52:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fcdfe657640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdf00df220 0x7fcdf00e0a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fcdfe657640 1 -- 172.21.15.82:0/3552180388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdf0006ae0 msgr2=0x7fcdf00d03d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:52:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fcdfe657640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdf0006ae0 0x7fcdf00d03d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fcdfe657640 1 -- 172.21.15.82:0/3552180388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf00d0910 con 0x7fcdf00e2d80 2024-06-02T22:52:25.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbd50b40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4c0cf3c0 0x7fbd4c152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34440/0 (socket says 172.21.15.82:34440) 2024-06-02T22:52:25.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbd51341640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd4c06d920 0x7fbd4c15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42634/0 (socket says 172.21.15.82:42634) 2024-06-02T22:52:25.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbd51341640 1 -- 172.21.15.82:0/2289334782 learned_addr learned my addr 172.21.15.82:0/2289334782 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7f045b59e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540071e0 0x7f045404f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7f045b59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04540e74a0 0x7f04540cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7f045b59e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04540e7880 0x7f04540e9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7f045b59e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0454054230 con 0x7f04540e74a0 2024-06-02T22:52:25.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7f045b59e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f04540540b0 con 0x7f04540e7880 2024-06-02T22:52:25.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.173+0000 7f045b59e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f04540543b0 con 0x7f04540071e0 2024-06-02T22:52:25.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7f0459d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04540e74a0 0x7f04540cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7f045ad9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04540e7880 0x7f04540e9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7f045ad9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04540e7880 0x7f04540e9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45560/0 (socket says 172.21.15.82:45560) 2024-06-02T22:52:25.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7f045ad9d640 1 -- 172.21.15.82:0/1010101798 learned_addr learned my addr 172.21.15.82:0/1010101798 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7f045a59c640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540071e0 0x7f045404f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fdcb862c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdca8050140 0x7fdca804e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fdcb862c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca80df030 0x7fdca80ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbd51b42640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd4c0d0510 0x7fbd4c157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f396aa78640 1 -- 172.21.15.82:0/2886722914 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396412a7d0 con 0x7f3964072e90 2024-06-02T22:52:25.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.172+0000 7f396aa78640 1 -- 172.21.15.82:0/2886722914 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f396412ad90 con 0x7f3964072e90 2024-06-02T22:52:25.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7f396aa78640 1 -- 172.21.15.82:0/2886722914 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3964135ae0 con 0x7f3964072e90 2024-06-02T22:52:25.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbd51341640 1 -- 172.21.15.82:0/2289334782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd4c0d0510 msgr2=0x7fbd4c157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbb9b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c0d11e0 0x7fbb9c13d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbb9b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c0d11e0 0x7fbb9c13d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34450/0 (socket says 172.21.15.82:34450) 2024-06-02T22:52:25.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.174+0000 7fbb9b7fe640 1 -- 172.21.15.82:0/4123658773 learned_addr learned my addr 172.21.15.82:0/4123658773 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbb9bfff640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb9c06faf0 0x7fbb9c13c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbb9b7fe640 1 -- 172.21.15.82:0/4123658773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb9c144610 msgr2=0x7fbb9c13dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbba0ca6640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb9c144610 0x7fbb9c13dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbb9b7fe640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb9c144610 0x7fbb9c13dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbb9b7fe640 1 -- 172.21.15.82:0/4123658773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb9c06faf0 msgr2=0x7fbb9c13c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbb9b7fe640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb9c06faf0 0x7fbb9c13c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbb9b7fe640 1 -- 172.21.15.82:0/4123658773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c15cfc0 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fdcb862c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdca80df410 0x7fdca804a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fdcb862c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdca80507c0 con 0x7fdca8050140 2024-06-02T22:52:25.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fdcb862c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8050640 con 0x7fdca80df030 2024-06-02T22:52:25.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fdcb862c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdca80546c0 con 0x7fdca80df410 2024-06-02T22:52:25.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fdcb63c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdca8050140 0x7fdca804e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fdcb63c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdca8050140 0x7fdca804e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34466/0 (socket says 172.21.15.82:34466) 2024-06-02T22:52:25.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fdcb63c8640 1 -- 172.21.15.82:0/1959229998 learned_addr learned my addr 172.21.15.82:0/1959229998 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbd51341640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd4c0d0510 0x7fbd4c157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbd51341640 1 -- 172.21.15.82:0/2289334782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4c0cf3c0 msgr2=0x7fbd4c152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbd51341640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4c0cf3c0 0x7fbd4c152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7f395a7fc640 1 -- 172.21.15.82:0/2886722914 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f395401b020 con 0x7f3964072e90 2024-06-02T22:52:25.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7f0459d9b640 1 -- 172.21.15.82:0/1010101798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540071e0 msgr2=0x7f045404f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7f0459d9b640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540071e0 0x7f045404f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7f0459d9b640 1 -- 172.21.15.82:0/1010101798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04540e7880 msgr2=0x7f04540e9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7f0459d9b640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04540e7880 0x7f04540e9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbd51341640 1 -- 172.21.15.82:0/2289334782 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4c159fd0 con 0x7fbd4c06d920 2024-06-02T22:52:25.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7f0459d9b640 1 -- 172.21.15.82:0/1010101798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045404f740 con 0x7f04540e74a0 2024-06-02T22:52:25.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbd50b40640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd4c0cf3c0 0x7fbd4c152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:25.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fbb9b7fe640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c0d11e0 0x7fbb9c13d730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000b450 tx=0x7fbb9000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fcdfe657640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00e2d80 0x7fcdf0036ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcde802c9a0 tx=0x7fcde80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fdcb6bc9640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdca80df410 0x7fdca804a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fdcb5bc7640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca80df030 0x7fdca80ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fbb98ff9640 1 -- 172.21.15.82:0/4123658773 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb90015020 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fbba14a7640 1 -- 172.21.15.82:0/4123658773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9c15d2a0 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fbb98ff9640 1 -- 172.21.15.82:0/4123658773 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb90011890 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fbb98ff9640 1 -- 172.21.15.82:0/4123658773 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb90011c40 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7f395a7fc640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f394806c260 0x7f394806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fdcb63c8640 1 -- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdca80df410 msgr2=0x7fdca804a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fdcb63c8640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdca80df410 0x7fdca804a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fdcb63c8640 1 -- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca80df030 msgr2=0x7fdca80ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fdcb63c8640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca80df030 0x7fdca80ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fdcb63c8640 1 -- 172.21.15.82:0/1959229998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca804d480 con 0x7fdca8050140 2024-06-02T22:52:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fdcb5bc7640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca80df030 0x7fdca80ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:25.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fbd51341640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd4c06d920 0x7fbd4c15b070 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000c780 tx=0x7fbd4000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7f3969a76640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f394806c260 0x7f394806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fdcb63c8640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdca8050140 0x7fdca804e240 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0050510 tx=0x7fdcb0074380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7f3c2effd640 1 -- 172.21.15.82:0/3018509572 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c30017470 con 0x7f3c400af4e0 2024-06-02T22:52:25.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7f3c2effd640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3c2006bf00 0x7f3c2006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7f3c2effd640 1 -- 172.21.15.82:0/3018509572 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3c3008d100 con 0x7f3c400af4e0 2024-06-02T22:52:25.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7f3c2effd640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] conn(0x7f3c20075680 0x7f3c20077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7f3c2effd640 1 -- 172.21.15.82:0/3018509572 --> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c30019e50 con 0x7f3c20075680 2024-06-02T22:52:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7f3c2effd640 1 -- 172.21.15.82:0/3018509572 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3c3008d4f0 con 0x7f3c400af4e0 2024-06-02T22:52:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.175+0000 7fcdee7fc640 1 -- 172.21.15.82:0/3552180388 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8039040 con 0x7fcdf00e2d80 2024-06-02T22:52:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf00df9f0 con 0x7fcdf00e2d80 2024-06-02T22:52:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf00dffb0 con 0x7fcdf00e2d80 2024-06-02T22:52:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fbd3dffb640 1 -- 172.21.15.82:0/2289334782 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40005270 con 0x7fbd4c06d920 2024-06-02T22:52:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7f395a7fc640 1 -- 172.21.15.82:0/2886722914 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f395400f040 con 0x7f3964072e90 2024-06-02T22:52:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7ff6893ee640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0e4100 0x7ff67c052b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff68406a380 tx=0x7ff684065240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7fbd52343640 1 -- 172.21.15.82:0/2289334782 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4c15a2b0 con 0x7fbd4c06d920 2024-06-02T22:52:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7fcdee7fc640 1 -- 172.21.15.82:0/3552180388 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde8042070 con 0x7fcdf00e2d80 2024-06-02T22:52:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7fcdee7fc640 1 -- 172.21.15.82:0/3552180388 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde80328b0 con 0x7fcdf00e2d80 2024-06-02T22:52:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.176+0000 7fbba14a7640 1 -- 172.21.15.82:0/4123658773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9c15d860 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7f3969a76640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f394806c260 0x7f394806e720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3960034000 tx=0x7f396002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7f045a59c640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04540071e0 0x7f045404f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:25.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7f0459d9b640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04540e74a0 0x7f04540cefe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0454053b50 tx=0x7f044c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7fbd52343640 1 -- 172.21.15.82:0/2289334782 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4c15a870 con 0x7fbd4c06d920 2024-06-02T22:52:25.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7fbba14a7640 1 -- 172.21.15.82:0/4123658773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb9c068ad0 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7f395a7fc640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] conn(0x7f3948075850 0x7f3948077c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7f395a7fc640 1 -- 172.21.15.82:0/2886722914 --> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3948078360 con 0x7f3948075850 2024-06-02T22:52:25.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7f396a277640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] conn(0x7f3948075850 0x7f3948077c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7f3c3dd9b640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3c2006bf00 0x7f3c2006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7f3c3ed9d640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] conn(0x7f3c20075680 0x7f3c20077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.177+0000 7f395a7fc640 1 -- 172.21.15.82:0/2886722914 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3954054f80 con 0x7f3964072e90 2024-06-02T22:52:25.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcde0001030 con 0x7fcdf00e2d80 2024-06-02T22:52:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7f3c3dd9b640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3c2006bf00 0x7f3c2006e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c34037000 tx=0x7f3c34030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7f396a277640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] conn(0x7f3948075850 0x7f3948077c90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7fdca6ffd640 1 -- 172.21.15.82:0/1959229998 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb006f9b0 con 0x7fdca8050140 2024-06-02T22:52:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7fdcb862c640 1 -- 172.21.15.82:0/1959229998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca804d760 con 0x7fdca8050140 2024-06-02T22:52:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7ff67a7fc640 1 -- 172.21.15.82:0/4080223466 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68406d440 con 0x7ff67c0e4100 2024-06-02T22:52:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7ff68abf1640 1 -- 172.21.15.82:0/4080223466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c04c320 con 0x7ff67c0e4100 2024-06-02T22:52:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7fdcb862c640 1 -- 172.21.15.82:0/1959229998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca804dd20 con 0x7fdca8050140 2024-06-02T22:52:25.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7fbb98ff9640 1 -- 172.21.15.82:0/4123658773 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb90018020 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7ff68abf1640 1 -- 172.21.15.82:0/4080223466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c0509e0 con 0x7ff67c0e4100 2024-06-02T22:52:25.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7fbb98ff9640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb8806be30 0x7fbb8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7f3c3ed9d640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] conn(0x7f3c20075680 0x7f3c20077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7fbb98ff9640 1 -- 172.21.15.82:0/4123658773 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbb9008b310 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7fbd52343640 1 -- 172.21.15.82:0/2289334782 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd4c0683c0 con 0x7fbd4c06d920 2024-06-02T22:52:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7fbd3dffb640 1 -- 172.21.15.82:0/2289334782 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd40005430 con 0x7fbd4c06d920 2024-06-02T22:52:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.178+0000 7fbd3dffb640 1 -- 172.21.15.82:0/2289334782 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000a880 con 0x7fbd4c06d920 2024-06-02T22:52:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7fbb9bfff640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb8806be30 0x7fbb8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7fbb98ff9640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] conn(0x7fbb88075530 0x7fbb88077970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7fbb98ff9640 1 -- 172.21.15.82:0/4123658773 --> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb88078040 con 0x7fbb88075530 2024-06-02T22:52:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7f3c2effd640 1 -- 172.21.15.82:0/3018509572 <== osd.0 v2:172.21.15.82:6817/377793909 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c30019e50 con 0x7f3c20075680 2024-06-02T22:52:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7f044affd640 1 -- 172.21.15.82:0/1010101798 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c041020 con 0x7f04540e74a0 2024-06-02T22:52:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7f045b59e640 1 -- 172.21.15.82:0/1010101798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04540cf520 con 0x7f04540e74a0 2024-06-02T22:52:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7f045b59e640 1 -- 172.21.15.82:0/1010101798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045404e720 con 0x7f04540e74a0 2024-06-02T22:52:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7ff67a7fc640 1 -- 172.21.15.82:0/4080223466 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6840ad630 con 0x7ff67c0e4100 2024-06-02T22:52:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7ff67a7fc640 1 -- 172.21.15.82:0/4080223466 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68406d440 con 0x7ff67c0e4100 2024-06-02T22:52:25.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.180+0000 7fdcb862c640 1 -- 172.21.15.82:0/1959229998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdca8036390 con 0x7fdca8050140 2024-06-02T22:52:25.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7f395a7fc640 1 -- 172.21.15.82:0/2886722914 <== osd.2 v2:172.21.15.82:6800/2442500293 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3948078360 con 0x7f3948075850 2024-06-02T22:52:25.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.180+0000 7fbb9bfff640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb8806be30 0x7fbb8806e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c036000 tx=0x7fbb8c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.181+0000 7f044affd640 1 -- 172.21.15.82:0/1010101798 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044c032440 con 0x7f04540e74a0 2024-06-02T22:52:25.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.181+0000 7f044affd640 1 -- 172.21.15.82:0/1010101798 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c037040 con 0x7f04540e74a0 2024-06-02T22:52:25.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.181+0000 7f0448ff9640 1 -- 172.21.15.82:0/1010101798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04540057e0 con 0x7f04540e74a0 2024-06-02T22:52:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.179+0000 7ff68abf1640 1 -- 172.21.15.82:0/4080223466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff67c0057e0 con 0x7ff67c0e4100 2024-06-02T22:52:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.180+0000 7fdca6ffd640 1 -- 172.21.15.82:0/1959229998 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb006fb50 con 0x7fdca8050140 2024-06-02T22:52:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.181+0000 7fbd3dffb640 1 -- 172.21.15.82:0/2289334782 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd4000aa20 con 0x7fbd4c06d920 2024-06-02T22:52:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.181+0000 7fbba0ca6640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] conn(0x7fbb88075530 0x7fbb88077970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.181+0000 7fbb98ff9640 1 -- 172.21.15.82:0/4123658773 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbb90092050 con 0x7fbb9c0d11e0 2024-06-02T22:52:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.181+0000 7fbba0ca6640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] conn(0x7fbb88075530 0x7fbb88077970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7fbb98ff9640 1 -- 172.21.15.82:0/4123658773 <== osd.1 v2:172.21.15.82:6808/4009704976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb88078040 con 0x7fbb88075530 2024-06-02T22:52:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.181+0000 7fcdee7fc640 1 -- 172.21.15.82:0/3552180388 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcde8032a50 con 0x7fcdf00e2d80 2024-06-02T22:52:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.181+0000 7fcdee7fc640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcddc06be60 0x7fcddc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.181+0000 7fcdee7fc640 1 -- 172.21.15.82:0/3552180388 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcde80ac120 con 0x7fcdf00e2d80 2024-06-02T22:52:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.182+0000 7fcdee7fc640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] conn(0x7fcddc075560 0x7fcddc0779a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.182+0000 7fcdee7fc640 1 -- 172.21.15.82:0/3552180388 --> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcddc078070 con 0x7fcddc075560 2024-06-02T22:52:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.182+0000 7fcdfde56640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcddc06be60 0x7fcddc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.182+0000 7fdca6ffd640 1 -- 172.21.15.82:0/1959229998 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0073130 con 0x7fdca8050140 2024-06-02T22:52:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.182+0000 7fbd3dffb640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbd3006bf00 0x7fbd3006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7fbd3dffb640 1 -- 172.21.15.82:0/2289334782 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbd4008b960 con 0x7fbd4c06d920 2024-06-02T22:52:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7fdca6ffd640 1 -- 172.21.15.82:0/1959229998 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdcb0073390 con 0x7fdca8050140 2024-06-02T22:52:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7fbd50b40640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbd3006bf00 0x7fbd3006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7fbd3dffb640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] conn(0x7fbd30075670 0x7fbd30077ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7fbd3dffb640 1 -- 172.21.15.82:0/2289334782 --> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd30078180 con 0x7fbd30075670 2024-06-02T22:52:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7fbd3dffb640 1 -- 172.21.15.82:0/2289334782 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd4008bd50 con 0x7fbd4c06d920 2024-06-02T22:52:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7f044affd640 1 -- 172.21.15.82:0/1010101798 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f044c044020 con 0x7f04540e74a0 2024-06-02T22:52:25.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7ff67a7fc640 1 -- 172.21.15.82:0/4080223466 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6840b5070 con 0x7ff67c0e4100 2024-06-02T22:52:25.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7fbd51b42640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] conn(0x7fbd30075670 0x7fbd30077ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7f044affd640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f043c06be30 0x7f043c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7fdca6ffd640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdc9406be30 0x7fdc9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7f044affd640 1 -- 172.21.15.82:0/1010101798 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f044c0ac210 con 0x7f04540e74a0 2024-06-02T22:52:25.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7f044affd640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] conn(0x7f043c0755b0 0x7f043c0779f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7f044affd640 1 -- 172.21.15.82:0/1010101798 --> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f043c0780c0 con 0x7f043c0755b0 2024-06-02T22:52:25.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7f044affd640 1 -- 172.21.15.82:0/1010101798 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f044c0ac600 con 0x7f04540e74a0 2024-06-02T22:52:25.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7fdcb5bc7640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdc9406be30 0x7fdc9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7ff67a7fc640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff66806c030 0x7ff66806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7ff67a7fc640 1 -- 172.21.15.82:0/4080223466 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff6841252e0 con 0x7ff67c0e4100 2024-06-02T22:52:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7fcdfde56640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcddc06be60 0x7fcddc06e320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8051060 tx=0x7fcdf8069140 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.183+0000 7fcdfd655640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] conn(0x7fcddc075560 0x7fcddc0779a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7fcdfd655640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] conn(0x7fcddc075560 0x7fcddc0779a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7fcdee7fc640 1 -- 172.21.15.82:0/3552180388 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcde8076440 con 0x7fcdf00e2d80 2024-06-02T22:52:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7ff67a7fc640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] conn(0x7ff668075730 0x7ff668077b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7ff67a7fc640 1 -- 172.21.15.82:0/4080223466 --> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff668078240 con 0x7ff668075730 2024-06-02T22:52:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7ff67a7fc640 1 -- 172.21.15.82:0/4080223466 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff684125770 con 0x7ff67c0e4100 2024-06-02T22:52:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7f045ad9d640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] conn(0x7f043c0755b0 0x7f043c0779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7ff689bef640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff66806c030 0x7ff66806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7fdca6ffd640 1 -- 172.21.15.82:0/1959229998 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdcb00f4c90 con 0x7fdca8050140 2024-06-02T22:52:25.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.184+0000 7f045a59c640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f043c06be30 0x7f043c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7fdca6ffd640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] conn(0x7fdc94075520 0x7fdc94077960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7fdca6ffd640 1 -- 172.21.15.82:0/1959229998 --> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcb007cec0 con 0x7fdc94075520 2024-06-02T22:52:25.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7fdca6ffd640 1 -- 172.21.15.82:0/1959229998 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdcb00f7290 con 0x7fdca8050140 2024-06-02T22:52:25.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7f045ad9d640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] conn(0x7f043c0755b0 0x7f043c0779f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7ff689bef640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff66806c030 0x7ff66806e4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff6740099d0 tx=0x7ff674009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7fdcb6bc9640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] conn(0x7fdc94075520 0x7fdc94077960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7ff68a3f0640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] conn(0x7ff668075730 0x7ff668077b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7fdcb5bc7640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdc9406be30 0x7fdc9406e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdca80d1160 tx=0x7fdcac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7fbd50b40640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbd3006bf00 0x7fbd3006e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c157f90 tx=0x7fbd48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7fbd51b42640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] conn(0x7fbd30075670 0x7fbd30077ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7f045a59c640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f043c06be30 0x7f043c06e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f045c06a250 tx=0x7f045c069140 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.185+0000 7fcdee7fc640 1 -- 172.21.15.82:0/3552180388 <== osd.3 v2:172.21.15.82:6816/1784876455 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcddc078070 con 0x7fcddc075560 2024-06-02T22:52:25.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.186+0000 7fdcb6bc9640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] conn(0x7fdc94075520 0x7fdc94077960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.186+0000 7ff68a3f0640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] conn(0x7ff668075730 0x7ff668077b70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.186+0000 7f044affd640 1 -- 172.21.15.82:0/1010101798 <== osd.5 v2:172.21.15.184:6800/1215748399 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f043c0780c0 con 0x7f043c0755b0 2024-06-02T22:52:25.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.186+0000 7fbd3dffb640 1 -- 172.21.15.82:0/2289334782 <== osd.4 v2:172.21.15.184:6816/3577676185 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd30078180 con 0x7fbd30075670 2024-06-02T22:52:25.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.186+0000 7fdca6ffd640 1 -- 172.21.15.82:0/1959229998 <== osd.7 v2:172.21.15.184:6824/3753375553 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdcb007cec0 con 0x7fdc94075520 2024-06-02T22:52:25.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.187+0000 7ff67a7fc640 1 -- 172.21.15.82:0/4080223466 <== osd.6 v2:172.21.15.184:6808/4289735887 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff668078240 con 0x7ff668075730 2024-06-02T22:52:25.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.201+0000 7f396aa78640 1 -- 172.21.15.82:0/2886722914 --> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f396412b350 con 0x7f3948075850 2024-06-02T22:52:25.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.201+0000 7f395a7fc640 1 -- 172.21.15.82:0/2886722914 <== osd.2 v2:172.21.15.82:6800/2442500293 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f396412b350 con 0x7f3948075850 2024-06-02T22:52:25.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.205+0000 7f3947fff640 1 -- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] conn(0x7f3948075850 msgr2=0x7f3948077c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.205+0000 7f3947fff640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] conn(0x7f3948075850 0x7f3948077c90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.205+0000 7f3947fff640 1 -- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f394806c260 msgr2=0x7f394806e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.205+0000 7f3947fff640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f394806c260 0x7f394806e720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3960034000 tx=0x7f396002e000 comp rx=0 tx=0).stop 2024-06-02T22:52:25.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.205+0000 7f3947fff640 1 -- 172.21.15.82:0/2886722914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964072e90 msgr2=0x7f3964129b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.205+0000 7f3947fff640 1 --2- 172.21.15.82:0/2886722914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964072e90 0x7f3964129b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f395400d5d0 tx=0x7f395400da90 comp rx=0 tx=0).stop 2024-06-02T22:52:25.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.205+0000 7f396a277640 1 -- 172.21.15.82:0/2886722914 reap_dead start 2024-06-02T22:52:25.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.205+0000 7f3947fff640 1 -- 172.21.15.82:0/2886722914 shutdown_connections 2024-06-02T22:52:25.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.206+0000 7f3947fff640 1 -- 172.21.15.82:0/2886722914 >> 172.21.15.82:0/2886722914 conn(0x7f39640b27d0 msgr2=0x7f39640b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.206+0000 7f3947fff640 1 -- 172.21.15.82:0/2886722914 shutdown_connections 2024-06-02T22:52:25.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.206+0000 7f3947fff640 1 -- 172.21.15.82:0/2886722914 wait complete. 2024-06-02T22:52:25.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.210+0000 7f3c2cff9640 1 -- 172.21.15.82:0/3018509572 --> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c18002dd0 con 0x7f3c20075680 2024-06-02T22:52:25.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.210+0000 7f3c2effd640 1 -- 172.21.15.82:0/3018509572 <== osd.0 v2:172.21.15.82:6817/377793909 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3c18002dd0 con 0x7f3c20075680 2024-06-02T22:52:25.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.211+0000 7f3c449c8640 1 -- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] conn(0x7f3c20075680 msgr2=0x7f3c20077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.211+0000 7f3c449c8640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] conn(0x7f3c20075680 0x7f3c20077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.211+0000 7f3c449c8640 1 -- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3c2006bf00 msgr2=0x7f3c2006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.211+0000 7f3c449c8640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3c2006bf00 0x7f3c2006e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c34037000 tx=0x7f3c34030000 comp rx=0 tx=0).stop 2024-06-02T22:52:25.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.212+0000 7f3c449c8640 1 -- 172.21.15.82:0/3018509572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c400af4e0 msgr2=0x7f3c40150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.212+0000 7f3c449c8640 1 --2- 172.21.15.82:0/3018509572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c400af4e0 0x7f3c40150aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000dbc0 tx=0x7f3c3000b780 comp rx=0 tx=0).stop 2024-06-02T22:52:25.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.212+0000 7f3c3ed9d640 1 -- 172.21.15.82:0/3018509572 reap_dead start 2024-06-02T22:52:25.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.212+0000 7f3c449c8640 1 -- 172.21.15.82:0/3018509572 shutdown_connections 2024-06-02T22:52:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.212+0000 7f3c449c8640 1 -- 172.21.15.82:0/3018509572 >> 172.21.15.82:0/3018509572 conn(0x7f3c400b19f0 msgr2=0x7f3c400b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.212+0000 7f3c449c8640 1 -- 172.21.15.82:0/3018509572 shutdown_connections 2024-06-02T22:52:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.212+0000 7f3c449c8640 1 -- 172.21.15.82:0/3018509572 wait complete. 2024-06-02T22:52:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.216+0000 7fbba14a7640 1 -- 172.21.15.82:0/4123658773 --> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbb9c15da30 con 0x7fbb88075530 2024-06-02T22:52:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.217+0000 7fbb98ff9640 1 -- 172.21.15.82:0/4123658773 <== osd.1 v2:172.21.15.82:6808/4009704976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbb9c15da30 con 0x7fbb88075530 2024-06-02T22:52:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.217+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 --> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcde0002dd0 con 0x7fcddc075560 2024-06-02T22:52:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.217+0000 7fbb827fc640 1 -- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] conn(0x7fbb88075530 msgr2=0x7fbb88077970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.218+0000 7fbb827fc640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] conn(0x7fbb88075530 0x7fbb88077970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.218+0000 7fbb827fc640 1 -- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb8806be30 msgr2=0x7fbb8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.218+0000 7fbb827fc640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb8806be30 0x7fbb8806e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c036000 tx=0x7fbb8c030000 comp rx=0 tx=0).stop 2024-06-02T22:52:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.218+0000 7fbb827fc640 1 -- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c0d11e0 msgr2=0x7fbb9c13d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.218+0000 7fbb827fc640 1 --2- 172.21.15.82:0/4123658773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c0d11e0 0x7fbb9c13d730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000b450 tx=0x7fbb9000b910 comp rx=0 tx=0).stop 2024-06-02T22:52:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.218+0000 7fbba0ca6640 1 -- 172.21.15.82:0/4123658773 reap_dead start 2024-06-02T22:52:25.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.218+0000 7fcdee7fc640 1 -- 172.21.15.82:0/3552180388 <== osd.3 v2:172.21.15.82:6816/1784876455 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcde0002dd0 con 0x7fcddc075560 2024-06-02T22:52:25.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.218+0000 7fbb827fc640 1 -- 172.21.15.82:0/4123658773 shutdown_connections 2024-06-02T22:52:25.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.218+0000 7fbb827fc640 1 -- 172.21.15.82:0/4123658773 >> 172.21.15.82:0/4123658773 conn(0x7fbb9c0b27d0 msgr2=0x7fbb9c0b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.218+0000 7fbb827fc640 1 -- 172.21.15.82:0/4123658773 shutdown_connections 2024-06-02T22:52:25.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.218+0000 7fbb827fc640 1 -- 172.21.15.82:0/4123658773 wait complete. 2024-06-02T22:52:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7f0448ff9640 1 -- 172.21.15.82:0/1010101798 --> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f04540ea3c0 con 0x7f043c0755b0 2024-06-02T22:52:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] conn(0x7fcddc075560 msgr2=0x7fcddc0779a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fbd52343640 1 -- 172.21.15.82:0/2289334782 --> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd4c15fb90 con 0x7fbd30075670 2024-06-02T22:52:25.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fcdfee58640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] conn(0x7fcddc075560 0x7fcddc0779a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcddc06be60 msgr2=0x7fcddc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fcdfee58640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcddc06be60 0x7fcddc06e320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8051060 tx=0x7fcdf8069140 comp rx=0 tx=0).stop 2024-06-02T22:52:25.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fdcb862c640 1 -- 172.21.15.82:0/1959229998 --> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdca800c0d0 con 0x7fdc94075520 2024-06-02T22:52:25.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.220+0000 7fbd3dffb640 1 -- 172.21.15.82:0/2289334782 <== osd.4 v2:172.21.15.184:6816/3577676185 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbd4c15fb90 con 0x7fbd30075670 2024-06-02T22:52:25.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00e2d80 msgr2=0x7fcdf0036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fcdfee58640 1 --2- 172.21.15.82:0/3552180388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00e2d80 0x7fcdf0036ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcde802c9a0 tx=0x7fcde80046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.220+0000 7f044affd640 1 -- 172.21.15.82:0/1010101798 <== osd.5 v2:172.21.15.184:6800/1215748399 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f04540ea3c0 con 0x7f043c0755b0 2024-06-02T22:52:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fcdfe657640 1 -- 172.21.15.82:0/3552180388 reap_dead start 2024-06-02T22:52:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.220+0000 7fdca6ffd640 1 -- 172.21.15.82:0/1959229998 <== osd.7 v2:172.21.15.184:6824/3753375553 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdca800c0d0 con 0x7fdc94075520 2024-06-02T22:52:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 shutdown_connections 2024-06-02T22:52:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 >> 172.21.15.82:0/3552180388 conn(0x7fcdf000a400 msgr2=0x7fcdf0048970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.219+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 shutdown_connections 2024-06-02T22:52:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.220+0000 7fcdfee58640 1 -- 172.21.15.82:0/3552180388 wait complete. 2024-06-02T22:52:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.220+0000 7fbd377fe640 1 -- 172.21.15.82:0/2289334782 >> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] conn(0x7fbd30075670 msgr2=0x7fbd30077ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.220+0000 7fbd377fe640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] conn(0x7fbd30075670 0x7fbd30077ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7fbd377fe640 1 -- 172.21.15.82:0/2289334782 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbd3006bf00 msgr2=0x7fbd3006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7fbd377fe640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbd3006bf00 0x7fbd3006e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c157f90 tx=0x7fbd48009040 comp rx=0 tx=0).stop 2024-06-02T22:52:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7fbd377fe640 1 -- 172.21.15.82:0/2289334782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd4c06d920 msgr2=0x7fbd4c15b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7fbd377fe640 1 --2- 172.21.15.82:0/2289334782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd4c06d920 0x7fbd4c15b070 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000c780 tx=0x7fbd4000cc40 comp rx=0 tx=0).stop 2024-06-02T22:52:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7fbd51b42640 1 -- 172.21.15.82:0/2289334782 reap_dead start 2024-06-02T22:52:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7fbd377fe640 1 -- 172.21.15.82:0/2289334782 shutdown_connections 2024-06-02T22:52:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7fbd377fe640 1 -- 172.21.15.82:0/2289334782 >> 172.21.15.82:0/2289334782 conn(0x7fbd4c06b7b0 msgr2=0x7fbd4c1609e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7f0448ff9640 1 -- 172.21.15.82:0/1010101798 >> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] conn(0x7f043c0755b0 msgr2=0x7f043c0779f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7f0448ff9640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] conn(0x7f043c0755b0 0x7f043c0779f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7f0448ff9640 1 -- 172.21.15.82:0/1010101798 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f043c06be30 msgr2=0x7f043c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7f0448ff9640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f043c06be30 0x7f043c06e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f045c06a250 tx=0x7f045c069140 comp rx=0 tx=0).stop 2024-06-02T22:52:25.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7ff68abf1640 1 -- 172.21.15.82:0/4080223466 --> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff67c00f3c0 con 0x7ff668075730 2024-06-02T22:52:25.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7fdcb862c640 1 -- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] conn(0x7fdc94075520 msgr2=0x7fdc94077960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7fdcb862c640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] conn(0x7fdc94075520 0x7fdc94077960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.274 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:25.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7f0448ff9640 1 -- 172.21.15.82:0/1010101798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04540e74a0 msgr2=0x7f04540cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7f0448ff9640 1 --2- 172.21.15.82:0/1010101798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04540e74a0 0x7f04540cefe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0454053b50 tx=0x7f044c0046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-02T22:52:25.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7f045ad9d640 1 -- 172.21.15.82:0/1010101798 reap_dead start 2024-06-02T22:52:25.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7ff67a7fc640 1 -- 172.21.15.82:0/4080223466 <== osd.6 v2:172.21.15.184:6808/4289735887 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff67c00f3c0 con 0x7ff668075730 2024-06-02T22:52:25.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7f0448ff9640 1 -- 172.21.15.82:0/1010101798 shutdown_connections 2024-06-02T22:52:25.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7f0448ff9640 1 -- 172.21.15.82:0/1010101798 >> 172.21.15.82:0/1010101798 conn(0x7f0454055bd0 msgr2=0x7f0454055fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7fbd377fe640 1 -- 172.21.15.82:0/2289334782 shutdown_connections 2024-06-02T22:52:25.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7fbd377fe640 1 -- 172.21.15.82:0/2289334782 wait complete. 2024-06-02T22:52:25.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7f0448ff9640 1 -- 172.21.15.82:0/1010101798 shutdown_connections 2024-06-02T22:52:25.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.221+0000 7f0448ff9640 1 -- 172.21.15.82:0/1010101798 wait complete. 2024-06-02T22:52:25.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7fdcb862c640 1 -- 172.21.15.82:0/1959229998 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdc9406be30 msgr2=0x7fdc9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7fdcb862c640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdc9406be30 0x7fdc9406e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdca80d1160 tx=0x7fdcac009040 comp rx=0 tx=0).stop 2024-06-02T22:52:25.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7ff667fff640 1 -- 172.21.15.82:0/4080223466 >> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] conn(0x7ff668075730 msgr2=0x7ff668077b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7ff667fff640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] conn(0x7ff668075730 0x7ff668077b70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7fdcb862c640 1 -- 172.21.15.82:0/1959229998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdca8050140 msgr2=0x7fdca804e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7fdcb862c640 1 --2- 172.21.15.82:0/1959229998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdca8050140 0x7fdca804e240 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0050510 tx=0x7fdcb0074380 comp rx=0 tx=0).stop 2024-06-02T22:52:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7fdcb6bc9640 1 -- 172.21.15.82:0/1959229998 reap_dead start 2024-06-02T22:52:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7fdcb862c640 1 -- 172.21.15.82:0/1959229998 shutdown_connections 2024-06-02T22:52:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7fdcb862c640 1 -- 172.21.15.82:0/1959229998 >> 172.21.15.82:0/1959229998 conn(0x7fdca8009fe0 msgr2=0x7fdca80365c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7ff667fff640 1 -- 172.21.15.82:0/4080223466 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff66806c030 msgr2=0x7ff66806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7ff667fff640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff66806c030 0x7ff66806e4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff6740099d0 tx=0x7ff674009190 comp rx=0 tx=0).stop 2024-06-02T22:52:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7ff667fff640 1 -- 172.21.15.82:0/4080223466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0e4100 msgr2=0x7ff67c052b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7ff667fff640 1 --2- 172.21.15.82:0/4080223466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c0e4100 0x7ff67c052b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff68406a380 tx=0x7ff684065240 comp rx=0 tx=0).stop 2024-06-02T22:52:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7ff68a3f0640 1 -- 172.21.15.82:0/4080223466 reap_dead start 2024-06-02T22:52:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7fdcb862c640 1 -- 172.21.15.82:0/1959229998 shutdown_connections 2024-06-02T22:52:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.222+0000 7fdcb862c640 1 -- 172.21.15.82:0/1959229998 wait complete. 2024-06-02T22:52:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.223+0000 7ff667fff640 1 -- 172.21.15.82:0/4080223466 shutdown_connections 2024-06-02T22:52:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.223+0000 7ff667fff640 1 -- 172.21.15.82:0/4080223466 >> 172.21.15.82:0/4080223466 conn(0x7ff67c01ef40 msgr2=0x7ff67c00b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.223+0000 7ff667fff640 1 -- 172.21.15.82:0/4080223466 shutdown_connections 2024-06-02T22:52:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.223+0000 7ff667fff640 1 -- 172.21.15.82:0/4080223466 wait complete. 2024-06-02T22:52:25.281 INFO:teuthology.orchestra.run.smithi082.stdout:55834574859 2024-06-02T22:52:25.282 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-02T22:52:25.283 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:25.283 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-02T22:52:25.284 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:25.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-02T22:52:25.285 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:25.285 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-02T22:52:25.286 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:25.286 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-02T22:52:25.287 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:25.287 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-02T22:52:25.288 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:25.288 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-02T22:52:25.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.491+0000 7f5f6a9eb640 1 Processor -- start 2024-06-02T22:52:25.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.491+0000 7f5f6a9eb640 1 -- start start 2024-06-02T22:52:25.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.492+0000 7f721a451640 1 Processor -- start 2024-06-02T22:52:25.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.493+0000 7f5f6a9eb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f5c0501a0 0x7f5f5c0df1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.493+0000 7f9c5eb4f640 1 Processor -- start 2024-06-02T22:52:25.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.493+0000 7f9c5eb4f640 1 -- start start 2024-06-02T22:52:25.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.492+0000 7f721a451640 1 -- start start 2024-06-02T22:52:25.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.493+0000 7f5f6a9eb640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5f5c0392d0 0x7f5f5c053260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.493+0000 7f5f6a9eb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f5c006dd0 con 0x7f5f5c00aaa0 2024-06-02T22:52:25.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.493+0000 7f5f6a9eb640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f5f5c0068a0 con 0x7f5f5c0392d0 2024-06-02T22:52:25.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.493+0000 7f5f6a9eb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5c0070b0 con 0x7f5f5c0501a0 2024-06-02T22:52:25.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.493+0000 7f5f699e9640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5f5c00aaa0 0x7f5f5c04fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48124/0 (socket says 172.21.15.82:48124) 2024-06-02T22:52:25.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.493+0000 7f721a451640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f720c0e1060 0x7f720c054db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f721a451640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f720c03ca20 0x7f720c051ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f721a451640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f720c0567c0 0x7f720c051ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f721a451640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f720c056330 con 0x7f720c0e1060 2024-06-02T22:52:25.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f721a451640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f720c0e1440 con 0x7f720c0567c0 2024-06-02T22:52:25.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f721a451640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f720c055720 con 0x7f720c03ca20 2024-06-02T22:52:25.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.493+0000 7f5f699e9640 1 -- 172.21.15.82:0/1110568617 learned_addr learned my addr 172.21.15.82:0/1110568617 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:25.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f5f6a1ea640 1 --2- 172.21.15.82:0/1110568617 >> v2:172.21.15.184:3300/0 conn(0x7f5f5c0392d0 0x7f5f5c053260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f7219c50640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f720c0567c0 0x7f720c051ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f721944f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f720c0e1060 0x7f720c054db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f5f691e8640 1 --2- 172.21.15.82:0/1110568617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f5c0501a0 0x7f5f5c0df1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f7219c50640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f720c0567c0 0x7f720c051ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45576/0 (socket says 172.21.15.82:45576) 2024-06-02T22:52:25.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f7219c50640 1 -- 172.21.15.82:0/469873972 learned_addr learned my addr 172.21.15.82:0/469873972 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f5f6a1ea640 1 -- 172.21.15.82:0/1110568617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f5c0501a0 msgr2=0x7f5f5c0df1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f9c5eb4f640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9c581625c0 0x7f9c580d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f5f6a1ea640 1 --2- 172.21.15.82:0/1110568617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f5c0501a0 0x7f5f5c0df1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f9c5eb4f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c580cf920 0x7f9c580cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f9c5eb4f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c580b2120 con 0x7f9c58166b70 2024-06-02T22:52:25.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f9c5eb4f640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f9c5809c6e0 con 0x7f9c581625c0 2024-06-02T22:52:25.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f9c5eb4f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f9c581629a0 con 0x7f9c580cf920 2024-06-02T22:52:25.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f5f6a1ea640 1 -- 172.21.15.82:0/1110568617 >> v1:172.21.15.82:6789/0 conn(0x7f5f5c00aaa0 legacy=0x7f5f5c04fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f7218c4e640 1 --2- 172.21.15.82:0/469873972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f720c03ca20 0x7f720c051ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.494+0000 7f5f6a1ea640 1 -- 172.21.15.82:0/1110568617 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c007390 con 0x7f5f5c0392d0 2024-06-02T22:52:25.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f9c57fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9c58166b70 0x7f9c5809bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48136/0 (socket says 172.21.15.82:48136) 2024-06-02T22:52:25.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f9c57fff640 1 -- 172.21.15.82:0/3011915309 learned_addr learned my addr 172.21.15.82:0/3011915309 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:25.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f48cb59e640 1 Processor -- start 2024-06-02T22:52:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f9c5c8eb640 1 --2- 172.21.15.82:0/3011915309 >> v2:172.21.15.184:3300/0 conn(0x7f9c581625c0 0x7f9c580d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f721944f640 1 -- 172.21.15.82:0/469873972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f720c03ca20 msgr2=0x7f720c051ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f721944f640 1 --2- 172.21.15.82:0/469873972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f720c03ca20 0x7f720c051ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f721944f640 1 -- 172.21.15.82:0/469873972 >> v2:172.21.15.184:3300/0 conn(0x7f720c0567c0 msgr2=0x7f720c051ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f721944f640 1 --2- 172.21.15.82:0/469873972 >> v2:172.21.15.184:3300/0 conn(0x7f720c0567c0 0x7f720c051ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f721944f640 1 -- 172.21.15.82:0/469873972 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720c055a00 con 0x7f720c0e1060 2024-06-02T22:52:25.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f2f48f30640 1 Processor -- start 2024-06-02T22:52:25.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f9c5d0ec640 1 --2- 172.21.15.82:0/3011915309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c580cf920 0x7f9c580cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f1248015640 1 Processor -- start 2024-06-02T22:52:25.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f0569038640 1 Processor -- start 2024-06-02T22:52:25.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f9c577fe640 1 -- 172.21.15.82:0/3011915309 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2747765357 0 0) 0x7f9c580b2120 con 0x7f9c58166b70 2024-06-02T22:52:25.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f9c577fe640 1 -- 172.21.15.82:0/3011915309 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c48003520 con 0x7f9c58166b70 2024-06-02T22:52:25.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f5f6a1ea640 1 --2- 172.21.15.82:0/1110568617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5c0392d0 0x7f5f5c053260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f540097a0 tx=0x7f5f5402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f726237bf532857e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f1248015640 1 -- start start 2024-06-02T22:52:25.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f721944f640 1 --2- 172.21.15.82:0/469873972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f720c0e1060 0x7f720c054db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f720c00fd90 tx=0x7f721002e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110f0e9622d14c82 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f2f48f30640 1 -- start start 2024-06-02T22:52:25.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f5f689e7640 1 -- 172.21.15.82:0/1110568617 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f54037070 con 0x7f5f5c0392d0 2024-06-02T22:52:25.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f48cb59e640 1 -- start start 2024-06-02T22:52:25.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f48cb59e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f48cc0d2810 0x7f48cc0cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f48cb59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48cc0cfdb0 0x7f48cc0b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f5f689e7640 1 -- 172.21.15.82:0/1110568617 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f54032440 con 0x7f5f5c0392d0 2024-06-02T22:52:25.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f48ca59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f48cc0b5130 0x7f48cc0d4810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48138/0 (socket says 172.21.15.82:48138) 2024-06-02T22:52:25.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f5f689e7640 1 -- 172.21.15.82:0/1110568617 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f54037070 con 0x7f5f5c0392d0 2024-06-02T22:52:25.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f1248015640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1240162820 0x7f12400cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f48cad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48cc0cfdb0 0x7f48cc0b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f48cad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48cc0cfdb0 0x7f48cc0b6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34490/0 (socket says 172.21.15.82:34490) 2024-06-02T22:52:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f2f48f30640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2f4414bdb0 0x7f2f440b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f48cb59e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48cc0d2cf0 con 0x7f48cc0b5130 2024-06-02T22:52:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f48cb59e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f48cc0d2fd0 con 0x7f48cc0cfdb0 2024-06-02T22:52:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f48cb59e640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f48cc0ced90 con 0x7f48cc0d2810 2024-06-02T22:52:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f48ca59c640 1 -- 172.21.15.82:0/915527294 learned_addr learned my addr 172.21.15.82:0/915527294 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.495+0000 7f9c5c8eb640 1 -- 172.21.15.82:0/3011915309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c580cf920 msgr2=0x7f9c580cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f9c5c8eb640 1 --2- 172.21.15.82:0/3011915309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c580cf920 0x7f9c580cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f9c5c8eb640 1 -- 172.21.15.82:0/3011915309 >> v1:172.21.15.82:6789/0 conn(0x7f9c58166b70 legacy=0x7f9c5809bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f9c5c8eb640 1 -- 172.21.15.82:0/3011915309 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c580b23c0 con 0x7f9c581625c0 2024-06-02T22:52:25.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f9c5c8eb640 1 --2- 172.21.15.82:0/3011915309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c581625c0 0x7f9c580d2f10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c440097a0 tx=0x7f9c4402a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b6cb5798e49ff67 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f5f6a9eb640 1 -- 172.21.15.82:0/1110568617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5c0392d0 msgr2=0x7f5f5c053260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f1248015640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 0x7f1240071d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f5f6a9eb640 1 --2- 172.21.15.82:0/1110568617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5c0392d0 0x7f5f5c053260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f540097a0 tx=0x7f5f5402a210 comp rx=0 tx=0).stop 2024-06-02T22:52:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f2f48f30640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f4406d440 0x7f2f4406d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f5f6a9eb640 1 -- 172.21.15.82:0/1110568617 shutdown_connections 2024-06-02T22:52:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f5f6a9eb640 1 --2- 172.21.15.82:0/1110568617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5c0392d0 0x7f5f5c053260 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f5f6a9eb640 1 --2- 172.21.15.82:0/1110568617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f5c0501a0 0x7f5f5c0df1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f5f6a9eb640 1 -- 172.21.15.82:0/1110568617 >> 172.21.15.82:0/1110568617 conn(0x7f5f5c009fb0 msgr2=0x7f5f5c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f1245db1640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1240162820 0x7f12400cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f1245db1640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1240162820 0x7f12400cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45610/0 (socket says 172.21.15.82:45610) 2024-06-02T22:52:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f1245db1640 1 -- 172.21.15.82:0/732363818 learned_addr learned my addr 172.21.15.82:0/732363818 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f720bfff640 1 -- 172.21.15.82:0/469873972 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721003a070 con 0x7f720c0e1060 2024-06-02T22:52:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f720bfff640 1 -- 172.21.15.82:0/469873972 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7210033710 con 0x7f720c0e1060 2024-06-02T22:52:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f720bfff640 1 -- 172.21.15.82:0/469873972 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7210033ae0 con 0x7f720c0e1060 2024-06-02T22:52:25.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f9c577fe640 1 -- 172.21.15.82:0/3011915309 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44037070 con 0x7f9c581625c0 2024-06-02T22:52:25.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f721a451640 1 -- 172.21.15.82:0/469873972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f720c0e1060 msgr2=0x7f720c054db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f721a451640 1 --2- 172.21.15.82:0/469873972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f720c0e1060 0x7f720c054db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f720c00fd90 tx=0x7f721002e490 comp rx=0 tx=0).stop 2024-06-02T22:52:25.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f1248015640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f124006bad0 con 0x7f12400af7e0 2024-06-02T22:52:25.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f1248015640 1 -- 172.21.15.82:0/732363818 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f124006e8c0 con 0x7f1240162820 2024-06-02T22:52:25.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f1248015640 1 -- 172.21.15.82:0/732363818 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f1240072630 con 0x7f12400718e0 2024-06-02T22:52:25.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f9c577fe640 1 -- 172.21.15.82:0/3011915309 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4402ae40 con 0x7f9c581625c0 2024-06-02T22:52:25.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f12465b2640 1 --2- 172.21.15.82:0/732363818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 0x7f1240071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f9c577fe640 1 -- 172.21.15.82:0/3011915309 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44032660 con 0x7f9c581625c0 2024-06-02T22:52:25.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.496+0000 7f0569038640 1 -- start start 2024-06-02T22:52:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f0569038640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05640cd0c0 0x7f0564150e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f0569038640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f05641513c0 0x7f05640d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f0569038640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05640cd540 con 0x7f05640ccce0 2024-06-02T22:52:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f0569038640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f05640b4fe0 con 0x7f05641513c0 2024-06-02T22:52:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f721a451640 1 -- 172.21.15.82:0/469873972 shutdown_connections 2024-06-02T22:52:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f721a451640 1 --2- 172.21.15.82:0/469873972 >> v2:172.21.15.184:3300/0 conn(0x7f720c0567c0 0x7f720c051ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f721a451640 1 --2- 172.21.15.82:0/469873972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f720c03ca20 0x7f720c051ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f721a451640 1 --2- 172.21.15.82:0/469873972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f720c0e1060 0x7f720c054db0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f721a451640 1 -- 172.21.15.82:0/469873972 >> 172.21.15.82:0/469873972 conn(0x7f720c056ce0 msgr2=0x7f720c0570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f0569038640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f05640b43d0 con 0x7f05640cd0c0 2024-06-02T22:52:25.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f48cad9d640 1 -- 172.21.15.82:0/915527294 >> v2:172.21.15.184:3300/0 conn(0x7f48cc0d2810 msgr2=0x7f48cc0cf870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:52:25.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f48cad9d640 1 --2- 172.21.15.82:0/915527294 >> v2:172.21.15.184:3300/0 conn(0x7f48cc0d2810 0x7f48cc0cf870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f48cad9d640 1 -- 172.21.15.82:0/915527294 >> v1:172.21.15.82:6789/0 conn(0x7f48cc0b5130 legacy=0x7f48cc0d4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f48cad9d640 1 -- 172.21.15.82:0/915527294 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc0cf070 con 0x7f48cc0cfdb0 2024-06-02T22:52:25.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f5f6a9eb640 1 -- 172.21.15.82:0/1110568617 shutdown_connections 2024-06-02T22:52:25.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f056359e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f05641513c0 0x7f05640d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f5f6a9eb640 1 -- 172.21.15.82:0/1110568617 wait complete. 2024-06-02T22:52:25.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f056259c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05640cd0c0 0x7f0564150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f2f48f30640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f4414c190 con 0x7f2f440ce470 2024-06-02T22:52:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f721a451640 1 -- 172.21.15.82:0/469873972 shutdown_connections 2024-06-02T22:52:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f2f48f30640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2f440715d0 con 0x7f2f4406d440 2024-06-02T22:52:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f2f48f30640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f2f44072a00 con 0x7f2f4414bdb0 2024-06-02T22:52:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f2f39d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2f440ce470 0x7f2f440ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48142/0 (socket says 172.21.15.82:48142) 2024-06-02T22:52:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f2f39d9b640 1 -- 172.21.15.82:0/367680162 learned_addr learned my addr 172.21.15.82:0/367680162 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.497+0000 7f2f4259c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2f4414bdb0 0x7f2f440b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f056359e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f05641513c0 0x7f05640d0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45616/0 (socket says 172.21.15.82:45616) 2024-06-02T22:52:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f056359e640 1 -- 172.21.15.82:0/2525336268 learned_addr learned my addr 172.21.15.82:0/2525336268 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/3011915309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c581625c0 msgr2=0x7f9c580d2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f9c5eb4f640 1 --2- 172.21.15.82:0/3011915309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c581625c0 0x7f9c580d2f10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9c440097a0 tx=0x7f9c4402a0f0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/3011915309 shutdown_connections 2024-06-02T22:52:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f9c5eb4f640 1 --2- 172.21.15.82:0/3011915309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c580cf920 0x7f9c580cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f9c5eb4f640 1 --2- 172.21.15.82:0/3011915309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c581625c0 0x7f9c580d2f10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/3011915309 >> 172.21.15.82:0/3011915309 conn(0x7f9c580d4290 msgr2=0x7f9c580d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f48cad9d640 1 --2- 172.21.15.82:0/915527294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc0cfdb0 0x7f48cc0b6d30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f48cc09d910 tx=0x7f48c402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c516d8cca98eab44 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f1245db1640 1 -- 172.21.15.82:0/732363818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 msgr2=0x7f1240071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f1245db1640 1 --2- 172.21.15.82:0/732363818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 0x7f1240071d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f1245db1640 1 -- 172.21.15.82:0/732363818 >> v1:172.21.15.184:6789/0 conn(0x7f12400af7e0 legacy=0x7f124006b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f1245db1640 1 -- 172.21.15.82:0/732363818 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12400cfd10 con 0x7f1240162820 2024-06-02T22:52:25.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/3011915309 shutdown_connections 2024-06-02T22:52:25.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/3011915309 wait complete. 2024-06-02T22:52:25.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f48c959a640 1 -- 172.21.15.82:0/915527294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4007740 con 0x7f48cc0cfdb0 2024-06-02T22:52:25.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f48c959a640 1 -- 172.21.15.82:0/915527294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c40078e0 con 0x7f48cc0cfdb0 2024-06-02T22:52:25.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f48c959a640 1 -- 172.21.15.82:0/915527294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4007cb0 con 0x7f48cc0cfdb0 2024-06-02T22:52:25.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f5f6a9eb640 1 Processor -- start 2024-06-02T22:52:25.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f1fd9f34640 1 Processor -- start 2024-06-02T22:52:25.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f1fd9f34640 1 -- start start 2024-06-02T22:52:25.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f5f6a9eb640 1 -- start start 2024-06-02T22:52:25.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f721a451640 1 -- 172.21.15.82:0/469873972 wait complete. 2024-06-02T22:52:25.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f721a451640 1 Processor -- start 2024-06-02T22:52:25.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f721a451640 1 -- start start 2024-06-02T22:52:25.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f5f6a9eb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5c00aaa0 0x7f5f5c04b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f056359e640 1 -- 172.21.15.82:0/2525336268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05640cd0c0 msgr2=0x7f0564150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f056359e640 1 --2- 172.21.15.82:0/2525336268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05640cd0c0 0x7f0564150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f056359e640 1 -- 172.21.15.82:0/2525336268 >> v1:172.21.15.184:6789/0 conn(0x7f05640ccce0 legacy=0x7f056415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f056359e640 1 -- 172.21.15.82:0/2525336268 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05640b46b0 con 0x7f05641513c0 2024-06-02T22:52:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.498+0000 7f2f42d9d640 1 --2- 172.21.15.82:0/367680162 >> v2:172.21.15.82:3300/0 conn(0x7f2f4406d440 0x7f2f4406d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f2f42d9d640 1 -- 172.21.15.82:0/367680162 >> v2:172.21.15.184:3300/0 conn(0x7f2f4414bdb0 msgr2=0x7f2f440b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f2f42d9d640 1 --2- 172.21.15.82:0/367680162 >> v2:172.21.15.184:3300/0 conn(0x7f2f4414bdb0 0x7f2f440b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f2f42d9d640 1 -- 172.21.15.82:0/367680162 >> v1:172.21.15.82:6789/0 conn(0x7f2f440ce470 legacy=0x7f2f440ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.499+0000 7f2f42d9d640 1 -- 172.21.15.82:0/367680162 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f440712f0 con 0x7f2f4406d440 2024-06-02T22:52:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f2f42d9d640 1 --2- 172.21.15.82:0/367680162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4406d440 0x7f2f4406d8b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f440743b0 tx=0x7f2f3c02a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4cce77a3db1b19f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f2f41d9b640 1 -- 172.21.15.82:0/367680162 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c007740 con 0x7f2f4406d440 2024-06-02T22:52:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f2f41d9b640 1 -- 172.21.15.82:0/367680162 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f3c0078e0 con 0x7f2f4406d440 2024-06-02T22:52:25.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f2f41d9b640 1 -- 172.21.15.82:0/367680162 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c007cb0 con 0x7f2f4406d440 2024-06-02T22:52:25.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f5f6a9eb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f5c0392d0 0x7f5f5c0efb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f5f6a9eb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c0501a0 0x7f5f5c0eb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f5f6a9eb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c053920 con 0x7f5f5c0501a0 2024-06-02T22:52:25.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f5f6a9eb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c0537a0 con 0x7f5f5c00aaa0 2024-06-02T22:52:25.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f5f6a9eb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5c053aa0 con 0x7f5f5c0392d0 2024-06-02T22:52:25.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f5f699e9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5c00aaa0 0x7f5f5c04b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f5f6a1ea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c0501a0 0x7f5f5c0eb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f5f699e9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5c00aaa0 0x7f5f5c04b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45618/0 (socket says 172.21.15.82:45618) 2024-06-02T22:52:25.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f056359e640 1 --2- 172.21.15.82:0/2525336268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05641513c0 0x7f05640d0190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0554008870 tx=0x7f055402c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26d08c3e700d30ae server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f5f699e9640 1 -- 172.21.15.82:0/2339689771 learned_addr learned my addr 172.21.15.82:0/2339689771 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1fd9f34640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fd4071e50 0x7f1fd415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1245db1640 1 --2- 172.21.15.82:0/732363818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240162820 0x7f12400cf680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1230009870 tx=0x7f123002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f2247f20abd176 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f9c5eb4f640 1 Processor -- start 2024-06-02T22:52:25.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1fcbfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fd4071e50 0x7f1fd415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1fcbfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1fd4071e50 0x7f1fd415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34516/0 (socket says 172.21.15.82:34516) 2024-06-02T22:52:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f48cb59e640 1 -- 172.21.15.82:0/915527294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc0cfdb0 msgr2=0x7f48cc0b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.500+0000 7f48cb59e640 1 --2- 172.21.15.82:0/915527294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc0cfdb0 0x7f48cc0b6d30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f48cc09d910 tx=0x7f48c402a6a0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f48cb59e640 1 -- 172.21.15.82:0/915527294 shutdown_connections 2024-06-02T22:52:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f48cb59e640 1 --2- 172.21.15.82:0/915527294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc0cfdb0 0x7f48cc0b6d30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f48cb59e640 1 --2- 172.21.15.82:0/915527294 >> v2:172.21.15.184:3300/0 conn(0x7f48cc0d2810 0x7f48cc0cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f48cb59e640 1 -- 172.21.15.82:0/915527294 >> 172.21.15.82:0/915527294 conn(0x7f48cc09d1c0 msgr2=0x7f48cc0d3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f5f6a1ea640 1 -- 172.21.15.82:0/2339689771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f5c0392d0 msgr2=0x7f5f5c0efb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f5f6a1ea640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f5c0392d0 0x7f5f5c0efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f5f6a1ea640 1 -- 172.21.15.82:0/2339689771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5c00aaa0 msgr2=0x7f5f5c04b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f5f6a1ea640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5c00aaa0 0x7f5f5c04b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f5f6a1ea640 1 -- 172.21.15.82:0/2339689771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c0e9490 con 0x7f5f5c0501a0 2024-06-02T22:52:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f5f699e9640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5c00aaa0 0x7f5f5c04b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1244daf640 1 -- 172.21.15.82:0/732363818 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230037070 con 0x7f1240162820 2024-06-02T22:52:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1244daf640 1 -- 172.21.15.82:0/732363818 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1230032440 con 0x7f1240162820 2024-06-02T22:52:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1244daf640 1 -- 172.21.15.82:0/732363818 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230032810 con 0x7f1240162820 2024-06-02T22:52:25.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f48cb59e640 1 -- 172.21.15.82:0/915527294 shutdown_connections 2024-06-02T22:52:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f2f48f30640 1 -- 172.21.15.82:0/367680162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4406d440 msgr2=0x7f2f4406d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f2f48f30640 1 --2- 172.21.15.82:0/367680162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4406d440 0x7f2f4406d8b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f440743b0 tx=0x7f2f3c02a590 comp rx=0 tx=0).stop 2024-06-02T22:52:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f9c5eb4f640 1 -- start start 2024-06-02T22:52:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f0561d9b640 1 -- 172.21.15.82:0/2525336268 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055403a070 con 0x7f05641513c0 2024-06-02T22:52:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f0561d9b640 1 -- 172.21.15.82:0/2525336268 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0554032480 con 0x7f05641513c0 2024-06-02T22:52:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1fd9f34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fd406e0a0 con 0x7f1fd406f140 2024-06-02T22:52:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1fd9f34640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fd406e380 con 0x7f1fd4154550 2024-06-02T22:52:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1fd9f34640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1fd406ecb0 con 0x7f1fd4071e50 2024-06-02T22:52:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f721a451640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f720c03ca20 0x7f720c0e1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1fd3fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1fd406f140 0x7f1fd40b2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48150/0 (socket says 172.21.15.82:48150) 2024-06-02T22:52:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f1fd3fff640 1 -- 172.21.15.82:0/3498654650 learned_addr learned my addr 172.21.15.82:0/3498654650 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f48cb59e640 1 -- 172.21.15.82:0/915527294 wait complete. 2024-06-02T22:52:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.501+0000 7f721a451640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f720c0567c0 0x7f720c0e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f721a451640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f720c036720 0x7f720c0d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f2f48f30640 1 -- 172.21.15.82:0/367680162 shutdown_connections 2024-06-02T22:52:25.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f2f48f30640 1 --2- 172.21.15.82:0/367680162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4406d440 0x7f2f4406d8b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f721a451640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f720c0552f0 con 0x7f720c036720 2024-06-02T22:52:25.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f721a451640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f720c055fc0 con 0x7f720c03ca20 2024-06-02T22:52:25.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f2f48f30640 1 --2- 172.21.15.82:0/367680162 >> v2:172.21.15.184:3300/0 conn(0x7f2f4414bdb0 0x7f2f440b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f2f48f30640 1 -- 172.21.15.82:0/367680162 >> 172.21.15.82:0/367680162 conn(0x7f2f440cfab0 msgr2=0x7f2f440cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f721a451640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f720c055470 con 0x7f720c0567c0 2024-06-02T22:52:25.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f0561d9b640 1 -- 172.21.15.82:0/2525336268 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554032850 con 0x7f05641513c0 2024-06-02T22:52:25.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f1fd2ffd640 1 -- 172.21.15.82:0/3498654650 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3513687263 0 0) 0x7f1fd406e0a0 con 0x7f1fd406f140 2024-06-02T22:52:25.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f7218c4e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f720c0567c0 0x7f720c0e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f0569038640 1 -- 172.21.15.82:0/2525336268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05641513c0 msgr2=0x7f05640d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f0569038640 1 --2- 172.21.15.82:0/2525336268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05641513c0 0x7f05640d0190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0554008870 tx=0x7f055402c7a0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f1248015640 1 -- 172.21.15.82:0/732363818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240162820 msgr2=0x7f12400cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f1248015640 1 --2- 172.21.15.82:0/732363818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240162820 0x7f12400cf680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1230009870 tx=0x7f123002a210 comp rx=0 tx=0).stop 2024-06-02T22:52:25.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f1fcbfff640 1 -- 172.21.15.82:0/3498654650 >> v1:172.21.15.184:6789/0 conn(0x7f1fd4154550 legacy=0x7f1fd4071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f1fcbfff640 1 -- 172.21.15.82:0/3498654650 >> v1:172.21.15.82:6789/0 conn(0x7f1fd406f140 legacy=0x7f1fd40b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f1fcbfff640 1 -- 172.21.15.82:0/3498654650 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd406e660 con 0x7f1fd4071e50 2024-06-02T22:52:25.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f0569038640 1 -- 172.21.15.82:0/2525336268 shutdown_connections 2024-06-02T22:52:25.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f0569038640 1 --2- 172.21.15.82:0/2525336268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05641513c0 0x7f05640d0190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f0569038640 1 --2- 172.21.15.82:0/2525336268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05640cd0c0 0x7f0564150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f0569038640 1 -- 172.21.15.82:0/2525336268 >> 172.21.15.82:0/2525336268 conn(0x7f056406b3c0 msgr2=0x7f056406b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f0569038640 1 -- 172.21.15.82:0/2525336268 shutdown_connections 2024-06-02T22:52:25.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f7219c50640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f720c036720 0x7f720c0d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f7219c50640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f720c036720 0x7f720c0d2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34526/0 (socket says 172.21.15.82:34526) 2024-06-02T22:52:25.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f7219c50640 1 -- 172.21.15.82:0/2584866211 learned_addr learned my addr 172.21.15.82:0/2584866211 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f7219c50640 1 -- 172.21.15.82:0/2584866211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f720c0567c0 msgr2=0x7f720c0e3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f7219c50640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f720c0567c0 0x7f720c0e3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f7219c50640 1 -- 172.21.15.82:0/2584866211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f720c03ca20 msgr2=0x7f720c0e1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f7219c50640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f720c03ca20 0x7f720c0e1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f7219c50640 1 -- 172.21.15.82:0/2584866211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720c0e44d0 con 0x7f720c036720 2024-06-02T22:52:25.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f1248015640 1 -- 172.21.15.82:0/732363818 shutdown_connections 2024-06-02T22:52:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f1248015640 1 --2- 172.21.15.82:0/732363818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 0x7f1240071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f1248015640 1 --2- 172.21.15.82:0/732363818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240162820 0x7f12400cf680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f1248015640 1 -- 172.21.15.82:0/732363818 >> 172.21.15.82:0/732363818 conn(0x7f12400b22b0 msgr2=0x7f12400b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f2f48f30640 1 -- 172.21.15.82:0/367680162 shutdown_connections 2024-06-02T22:52:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f2f48f30640 1 -- 172.21.15.82:0/367680162 wait complete. 2024-06-02T22:52:25.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f0569038640 1 -- 172.21.15.82:0/2525336268 wait complete. 2024-06-02T22:52:25.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f7219c50640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f720c036720 0x7f720c0d2cf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f720400e870 tx=0x7f720400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f5f6a1ea640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c0501a0 0x7f5f5c0eb540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f54031000 tx=0x7f5f540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f7209ffb640 1 -- 172.21.15.82:0/2584866211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204017070 con 0x7f720c036720 2024-06-02T22:52:25.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f5f5a7fc640 1 -- 172.21.15.82:0/2339689771 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f54037040 con 0x7f5f5c0501a0 2024-06-02T22:52:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f5f5a7fc640 1 -- 172.21.15.82:0/2339689771 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f54003c90 con 0x7f5f5c0501a0 2024-06-02T22:52:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.502+0000 7f5f6a9eb640 1 -- 172.21.15.82:0/2339689771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5c0e9770 con 0x7f5f5c0501a0 2024-06-02T22:52:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f5f6a9eb640 1 -- 172.21.15.82:0/2339689771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f5c0e9d30 con 0x7f5f5c0501a0 2024-06-02T22:52:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f9c5eb4f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c580cf920 0x7f9c58200410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f9c5eb4f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c581625c0 0x7f9c580c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f9c5eb4f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c58166b70 0x7f9c580cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f9c5eb4f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58167050 con 0x7f9c581625c0 2024-06-02T22:52:25.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f9c5eb4f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9c580b2980 con 0x7f9c580cf920 2024-06-02T22:52:25.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f9c5eb4f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f9c580d3950 con 0x7f9c58166b70 2024-06-02T22:52:25.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f9c5d0ec640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c58166b70 0x7f9c580cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f9c5d0ec640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c58166b70 0x7f9c580cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42724/0 (socket says 172.21.15.82:42724) 2024-06-02T22:52:25.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f9c5d0ec640 1 -- 172.21.15.82:0/2511352253 learned_addr learned my addr 172.21.15.82:0/2511352253 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f48cb59e640 1 Processor -- start 2024-06-02T22:52:25.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f5f5a7fc640 1 -- 172.21.15.82:0/2339689771 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f54006e10 con 0x7f5f5c0501a0 2024-06-02T22:52:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f721a451640 1 -- 172.21.15.82:0/2584866211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720c0d5150 con 0x7f720c036720 2024-06-02T22:52:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f721a451640 1 -- 172.21.15.82:0/2584866211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f720c0d5710 con 0x7f720c036720 2024-06-02T22:52:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f7209ffb640 1 -- 172.21.15.82:0/2584866211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f720400c940 con 0x7f720c036720 2024-06-02T22:52:25.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f7209ffb640 1 -- 172.21.15.82:0/2584866211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204021060 con 0x7f720c036720 2024-06-02T22:52:25.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f9c5d0ec640 1 -- 172.21.15.82:0/2511352253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c580cf920 msgr2=0x7f9c58200410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:52:25.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f9c5d0ec640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c580cf920 0x7f9c58200410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f9c5d0ec640 1 -- 172.21.15.82:0/2511352253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c581625c0 msgr2=0x7f9c580c77f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:52:25.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f1248015640 1 -- 172.21.15.82:0/732363818 shutdown_connections 2024-06-02T22:52:25.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f9c57fff640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c581625c0 0x7f9c580c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f48cb59e640 1 -- start start 2024-06-02T22:52:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.505+0000 7f5f6a9eb640 1 -- 172.21.15.82:0/2339689771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f4c005290 con 0x7f5f5c0501a0 2024-06-02T22:52:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.505+0000 7f2f48f30640 1 Processor -- start 2024-06-02T22:52:25.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.505+0000 7f1248015640 1 -- 172.21.15.82:0/732363818 wait complete. 2024-06-02T22:52:25.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.505+0000 7f2f48f30640 1 -- start start 2024-06-02T22:52:25.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f1fcbfff640 1 --2- 172.21.15.82:0/3498654650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd4071e50 0x7f1fd415a6f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009f30 tx=0x7f1fbc02c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a7532359e996ef server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.503+0000 7f1fd2ffd640 1 -- 172.21.15.82:0/3498654650 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc007ad0 con 0x7f1fd4071e50 2024-06-02T22:52:25.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.504+0000 7f1fd2ffd640 1 -- 172.21.15.82:0/3498654650 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fbc007c70 con 0x7f1fd4071e50 2024-06-02T22:52:25.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.505+0000 7f1fd2ffd640 1 -- 172.21.15.82:0/3498654650 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc007ad0 con 0x7f1fd4071e50 2024-06-02T22:52:25.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.505+0000 7f1fd9f34640 1 -- 172.21.15.82:0/3498654650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd4071e50 msgr2=0x7f1fd415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.505+0000 7f1fd9f34640 1 --2- 172.21.15.82:0/3498654650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd4071e50 0x7f1fd415a6f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009f30 tx=0x7f1fbc02c360 comp rx=0 tx=0).stop 2024-06-02T22:52:25.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.505+0000 7f9c5d0ec640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c581625c0 0x7f9c580c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.505+0000 7f0569038640 1 Processor -- start 2024-06-02T22:52:25.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.505+0000 7f0569038640 1 -- start start 2024-06-02T22:52:25.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.505+0000 7f9c5d0ec640 1 -- 172.21.15.82:0/2511352253 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c58163700 con 0x7f9c58166b70 2024-06-02T22:52:25.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f9c5d0ec640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c58166b70 0x7f9c580cd350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000efc0 tx=0x7f9c5000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f9c57fff640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c581625c0 0x7f9c580c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:25.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f48cb59e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc0b5130 0x7f48cc0cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f9c557fa640 1 -- 172.21.15.82:0/2511352253 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50018020 con 0x7f9c58166b70 2024-06-02T22:52:25.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f9c557fa640 1 -- 172.21.15.82:0/2511352253 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c50014480 con 0x7f9c58166b70 2024-06-02T22:52:25.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f48cb59e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48cc0cfdb0 0x7f48cc0c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f9c557fa640 1 -- 172.21.15.82:0/2511352253 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50014870 con 0x7f9c58166b70 2024-06-02T22:52:25.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/2511352253 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c581639e0 con 0x7f9c58166b70 2024-06-02T22:52:25.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f2f48f30640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f4406d440 0x7f2f440aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f2f48f30640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f440ce470 0x7f2f44161d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f2f4259c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f4406d440 0x7f2f440aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f5f5a7fc640 1 -- 172.21.15.82:0/2339689771 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f54044020 con 0x7f5f5c0501a0 2024-06-02T22:52:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f2f39d9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f440ce470 0x7f2f44161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f2f39d9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f440ce470 0x7f2f44161d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45646/0 (socket says 172.21.15.82:45646) 2024-06-02T22:52:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f2f4259c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f4406d440 0x7f2f440aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42728/0 (socket says 172.21.15.82:42728) 2024-06-02T22:52:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f2f39d9b640 1 -- 172.21.15.82:0/1062371770 learned_addr learned my addr 172.21.15.82:0/1062371770 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f1fd9f34640 1 -- 172.21.15.82:0/3498654650 shutdown_connections 2024-06-02T22:52:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f1fd9f34640 1 --2- 172.21.15.82:0/3498654650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd4071e50 0x7f1fd415a6f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f2f48f30640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4414bdb0 0x7f2f440afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f1fd9f34640 1 -- 172.21.15.82:0/3498654650 >> 172.21.15.82:0/3498654650 conn(0x7f1fd40b1c20 msgr2=0x7f1fd40b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f5f5a7fc640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5f4806be80 0x7f5f4806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f0569038640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05640ccce0 0x7f05641fe360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f1248015640 1 Processor -- start 2024-06-02T22:52:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f0569038640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05640cd0c0 0x7f05641e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f0569038640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05641513c0 0x7f0564200da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f0569038640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05640cf300 con 0x7f05640cd0c0 2024-06-02T22:52:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f0569038640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f05640b4c70 con 0x7f05641513c0 2024-06-02T22:52:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f0569038640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f05640cf480 con 0x7f05640ccce0 2024-06-02T22:52:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f5f5a7fc640 1 -- 172.21.15.82:0/2339689771 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5f54077dd0 con 0x7f5f5c0501a0 2024-06-02T22:52:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f5f699e9640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5f4806be80 0x7f5f4806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f056259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05640cd0c0 0x7f05641e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f056259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05640cd0c0 0x7f05641e6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34534/0 (socket says 172.21.15.82:34534) 2024-06-02T22:52:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f056259c640 1 -- 172.21.15.82:0/3029071843 learned_addr learned my addr 172.21.15.82:0/3029071843 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f056259c640 1 -- 172.21.15.82:0/3029071843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05640ccce0 msgr2=0x7f05641fe360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f056259c640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05640ccce0 0x7f05641fe360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f056259c640 1 -- 172.21.15.82:0/3029071843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05641513c0 msgr2=0x7f0564200da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:52:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f056259c640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05641513c0 0x7f0564200da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f056259c640 1 -- 172.21.15.82:0/3029071843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056409d170 con 0x7f05640cd0c0 2024-06-02T22:52:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f056259c640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05640cd0c0 0x7f05641e6a50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f055c00efc0 tx=0x7f055c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.506+0000 7f7209ffb640 1 -- 172.21.15.82:0/2584866211 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f720401a070 con 0x7f720c036720 2024-06-02T22:52:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f721a451640 1 -- 172.21.15.82:0/2584866211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f720c054db0 con 0x7f720c036720 2024-06-02T22:52:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f7209ffb640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f71f806be30 0x7f71f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f7209ffb640 1 -- 172.21.15.82:0/2584866211 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f720408b550 con 0x7f720c036720 2024-06-02T22:52:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f721944f640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f71f806be30 0x7f71f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f48ca59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc0b5130 0x7f48cc0cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f48ca59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc0b5130 0x7f48cc0cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45640/0 (socket says 172.21.15.82:45640) 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f48cb59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc0d2810 0x7f48cc0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f48cb59e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc0b5510 con 0x7f48cc0d2810 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f48cb59e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc0cea60 con 0x7f48cc0b5130 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f48cb59e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc0b5690 con 0x7f48cc0cfdb0 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f48cad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc0d2810 0x7f48cc0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f48cad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc0d2810 0x7f48cc0c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34558/0 (socket says 172.21.15.82:34558) 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f48cad9d640 1 -- 172.21.15.82:0/918231749 learned_addr learned my addr 172.21.15.82:0/918231749 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f48cad9d640 1 -- 172.21.15.82:0/918231749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48cc0cfdb0 msgr2=0x7f48cc0c9000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f48cad9d640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48cc0cfdb0 0x7f48cc0c9000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f48cad9d640 1 -- 172.21.15.82:0/918231749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc0b5130 msgr2=0x7f48cc0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f48cad9d640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc0b5130 0x7f48cc0cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f48cad9d640 1 -- 172.21.15.82:0/918231749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc15c320 con 0x7f48cc0d2810 2024-06-02T22:52:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/2511352253 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c58200950 con 0x7f9c58166b70 2024-06-02T22:52:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f9c557fa640 1 -- 172.21.15.82:0/2511352253 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c5001b020 con 0x7f9c58166b70 2024-06-02T22:52:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2f44070f10 con 0x7f2f4414bdb0 2024-06-02T22:52:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f2f42d9d640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4414bdb0 0x7f2f440afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2f44072f80 con 0x7f2f440ce470 2024-06-02T22:52:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2f44071090 con 0x7f2f4406d440 2024-06-02T22:52:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f1fd9f34640 1 -- 172.21.15.82:0/3498654650 shutdown_connections 2024-06-02T22:52:25.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f1248015640 1 -- start start 2024-06-02T22:52:25.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.508+0000 7f1248015640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 0x7f12401edce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f1248015640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400af7e0 0x7f12401491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f1248015640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240162820 0x7f1240149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f1245db1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 0x7f12401edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.507+0000 7f1fd9f34640 1 -- 172.21.15.82:0/3498654650 wait complete. 2024-06-02T22:52:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f1248015640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f124006e4e0 con 0x7f12400af7e0 2024-06-02T22:52:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f1fd9f34640 1 Processor -- start 2024-06-02T22:52:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f12455b0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400af7e0 0x7f12401491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f1248015640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f12400ce880 con 0x7f1240162820 2024-06-02T22:52:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f1248015640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f124006ed50 con 0x7f12400718e0 2024-06-02T22:52:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f48cad9d640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc0d2810 0x7f48cc0c9540 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48c402ac90 tx=0x7f48c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f1245db1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 0x7f12401edce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42744/0 (socket says 172.21.15.82:42744) 2024-06-02T22:52:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f1245db1640 1 -- 172.21.15.82:0/279694171 learned_addr learned my addr 172.21.15.82:0/279694171 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f721944f640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f71f806be30 0x7f71f806e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7210037000 tx=0x7f7210032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f9c557fa640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c3c06beb0 0x7f9c3c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f2f39d9b640 1 -- 172.21.15.82:0/1062371770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f4406d440 msgr2=0x7f2f440aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f2f39d9b640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f4406d440 0x7f2f440aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f2f39d9b640 1 -- 172.21.15.82:0/1062371770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4414bdb0 msgr2=0x7f2f440afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f2f39d9b640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4414bdb0 0x7f2f440afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f2f39d9b640 1 -- 172.21.15.82:0/1062371770 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f440a9b40 con 0x7f2f440ce470 2024-06-02T22:52:25.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f1fd9f34640 1 -- start start 2024-06-02T22:52:25.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f12465b2640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240162820 0x7f1240149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.509+0000 7f12455b0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400af7e0 0x7f12401491f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34572/0 (socket says 172.21.15.82:34572) 2024-06-02T22:52:25.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f1245db1640 1 -- 172.21.15.82:0/279694171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240162820 msgr2=0x7f1240149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f1245db1640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240162820 0x7f1240149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f1245db1640 1 -- 172.21.15.82:0/279694171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400af7e0 msgr2=0x7f12401491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f1245db1640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400af7e0 0x7f12401491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f1245db1640 1 -- 172.21.15.82:0/279694171 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124015f1b0 con 0x7f12400718e0 2024-06-02T22:52:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f12455b0640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400af7e0 0x7f12401491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/2511352253 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c58068ad0 con 0x7f9c58166b70 2024-06-02T22:52:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f9c557fa640 1 -- 172.21.15.82:0/2511352253 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9c5008b2f0 con 0x7f9c58166b70 2024-06-02T22:52:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f9c5c8eb640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c3c06beb0 0x7f9c3c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f5f699e9640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5f4806be80 0x7f5f4806e340 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5f6406ae20 tx=0x7f5f64069140 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f1245db1640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 0x7f12401edce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1230009870 tx=0x7f12300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f2f39d9b640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f440ce470 0x7f2f44161d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00c460 tx=0x7f2f2c00c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f2f3b7fe640 1 -- 172.21.15.82:0/1062371770 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c005ce0 con 0x7f2f440ce470 2024-06-02T22:52:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f2f3b7fe640 1 -- 172.21.15.82:0/1062371770 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2c007070 con 0x7f2f440ce470 2024-06-02T22:52:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f440a9e20 con 0x7f2f440ce470 2024-06-02T22:52:25.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f2f3b7fe640 1 -- 172.21.15.82:0/1062371770 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c007460 con 0x7f2f440ce470 2024-06-02T22:52:25.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f44162270 con 0x7f2f440ce470 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.510+0000 7f1fd9f34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd406f140 0x7f1fd4145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd406f140 0x7f1fd4145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd406f140 0x7f1fd4145b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34578/0 (socket says 172.21.15.82:34578) 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd9f34640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd4071e50 0x7f1fd40cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd9f34640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd4154550 0x7f1fd414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd9f34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd40685b0 con 0x7f1fd406f140 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd9f34640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd4068430 con 0x7f1fd4071e50 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd9f34640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd4154930 con 0x7f1fd4154550 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd37fe640 1 -- 172.21.15.82:0/2021722923 learned_addr learned my addr 172.21.15.82:0/2021722923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fcbfff640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd4071e50 0x7f1fd40cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd3fff640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd4154550 0x7f1fd414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f9c5c8eb640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c3c06beb0 0x7f9c3c06e370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c44034000 tx=0x7f9c4402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd3fff640 1 -- 172.21.15.82:0/2021722923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd4071e50 msgr2=0x7f1fd40cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd3fff640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd4071e50 0x7f1fd40cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd3fff640 1 -- 172.21.15.82:0/2021722923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd406f140 msgr2=0x7f1fd4145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd3fff640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd406f140 0x7f1fd4145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd3fff640 1 -- 172.21.15.82:0/2021722923 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd41460d0 con 0x7f1fd4154550 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fcbfff640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd4071e50 0x7f1fd40cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.511+0000 7f1fd37fe640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd406f140 0x7f1fd4145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.512+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f440683c0 con 0x7f2f440ce470 2024-06-02T22:52:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.512+0000 7f1fd3fff640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd4154550 0x7f1fd414a8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40b50c0 tx=0x7f1fcc00cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.512+0000 7f2f3b7fe640 1 -- 172.21.15.82:0/1062371770 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f2c007600 con 0x7f2f440ce470 2024-06-02T22:52:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.513+0000 7f2f3b7fe640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2f2406be30 0x7f2f2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.513+0000 7f2f3b7fe640 1 -- 172.21.15.82:0/1062371770 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2f2c08ae80 con 0x7f2f440ce470 2024-06-02T22:52:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.513+0000 7f2f4259c640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2f2406be30 0x7f2f2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.513+0000 7f054b7fe640 1 -- 172.21.15.82:0/3029071843 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c018020 con 0x7f05640cd0c0 2024-06-02T22:52:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.513+0000 7f48baffd640 1 -- 172.21.15.82:0/918231749 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4040070 con 0x7f48cc0d2810 2024-06-02T22:52:25.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.513+0000 7f48cb59e640 1 -- 172.21.15.82:0/918231749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc15cc70 con 0x7f48cc0d2810 2024-06-02T22:52:25.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.513+0000 7f0569038640 1 -- 172.21.15.82:0/3029071843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056409d450 con 0x7f05640cd0c0 2024-06-02T22:52:25.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.513+0000 7f5f5a7fc640 1 -- 172.21.15.82:0/2339689771 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5f5407a430 con 0x7f5f5c0501a0 2024-06-02T22:52:25.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.513+0000 7f48cb59e640 1 -- 172.21.15.82:0/918231749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48cc0cdeb0 con 0x7f48cc0d2810 2024-06-02T22:52:25.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.513+0000 7f2f4259c640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2f2406be30 0x7f2f2406e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009ad0 tx=0x7f2f34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.513+0000 7f0569038640 1 -- 172.21.15.82:0/3029071843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0564071030 con 0x7f05640cd0c0 2024-06-02T22:52:25.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.514+0000 7f0569038640 1 -- 172.21.15.82:0/3029071843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05640b3f70 con 0x7f05640cd0c0 2024-06-02T22:52:25.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.514+0000 7f48cb59e640 1 -- 172.21.15.82:0/918231749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48cc068ad0 con 0x7f48cc0d2810 2024-06-02T22:52:25.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.518+0000 7f1fd0ff9640 1 -- 172.21.15.82:0/2021722923 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc018070 con 0x7f1fd4154550 2024-06-02T22:52:25.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.518+0000 7f1fd0ff9640 1 -- 172.21.15.82:0/2021722923 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc004d60 con 0x7f1fd4154550 2024-06-02T22:52:25.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.518+0000 7f054b7fe640 1 -- 172.21.15.82:0/3029071843 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055c014480 con 0x7f05640cd0c0 2024-06-02T22:52:25.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.518+0000 7f054b7fe640 1 -- 172.21.15.82:0/3029071843 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c014830 con 0x7f05640cd0c0 2024-06-02T22:52:25.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.518+0000 7f7209ffb640 1 -- 172.21.15.82:0/2584866211 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f720c054db0 con 0x7f720c036720 2024-06-02T22:52:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.518+0000 7f12367fc640 1 -- 172.21.15.82:0/279694171 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230037040 con 0x7f12400718e0 2024-06-02T22:52:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.518+0000 7f12367fc640 1 -- 172.21.15.82:0/279694171 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1230042070 con 0x7f12400718e0 2024-06-02T22:52:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.518+0000 7f12367fc640 1 -- 172.21.15.82:0/279694171 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230030bd0 con 0x7f12400718e0 2024-06-02T22:52:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.518+0000 7f9c557fa640 1 -- 172.21.15.82:0/2511352253 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9c50010040 con 0x7f9c58166b70 2024-06-02T22:52:25.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.519+0000 7f1248015640 1 -- 172.21.15.82:0/279694171 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124015f490 con 0x7f12400718e0 2024-06-02T22:52:25.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.519+0000 7f1248015640 1 -- 172.21.15.82:0/279694171 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f124015fa50 con 0x7f12400718e0 2024-06-02T22:52:25.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.518+0000 7f48baffd640 1 -- 172.21.15.82:0/918231749 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c4031e40 con 0x7f48cc0d2810 2024-06-02T22:52:25.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.518+0000 7f48baffd640 1 -- 172.21.15.82:0/918231749 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4045460 con 0x7f48cc0d2810 2024-06-02T22:52:25.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.520+0000 7f48baffd640 1 -- 172.21.15.82:0/918231749 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48c4039040 con 0x7f48cc0d2810 2024-06-02T22:52:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.519+0000 7f1fd0ff9640 1 -- 172.21.15.82:0/2021722923 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00a850 con 0x7f1fd4154550 2024-06-02T22:52:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.519+0000 7f1fd9f34640 1 -- 172.21.15.82:0/2021722923 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd40ce080 con 0x7f1fd4154550 2024-06-02T22:52:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.519+0000 7f1fd9f34640 1 -- 172.21.15.82:0/2021722923 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd40cebc0 con 0x7f1fd4154550 2024-06-02T22:52:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.521+0000 7f48baffd640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f48ac06be30 0x7f48ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.521+0000 7f48baffd640 1 -- 172.21.15.82:0/918231749 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f48c40acfb0 con 0x7f48cc0d2810 2024-06-02T22:52:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.521+0000 7f48ca59c640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f48ac06be30 0x7f48ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.521+0000 7f1fd9f34640 1 -- 172.21.15.82:0/2021722923 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd4068ad0 con 0x7f1fd4154550 2024-06-02T22:52:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.522+0000 7f054b7fe640 1 -- 172.21.15.82:0/3029071843 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f055c005d10 con 0x7f05640cd0c0 2024-06-02T22:52:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.522+0000 7f48ca59c640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f48ac06be30 0x7f48ac06e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f48bc007fd0 tx=0x7f48bc007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.522+0000 7f2f3b7fe640 1 -- 172.21.15.82:0/1062371770 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2f2c058e80 con 0x7f2f440ce470 2024-06-02T22:52:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.522+0000 7f12367fc640 1 -- 172.21.15.82:0/279694171 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1230047460 con 0x7f12400718e0 2024-06-02T22:52:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.522+0000 7f12367fc640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f122406bf00 0x7f122406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.522+0000 7f054b7fe640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f055006be30 0x7f055006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.522+0000 7f054b7fe640 1 -- 172.21.15.82:0/3029071843 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f055c08c480 con 0x7f05640cd0c0 2024-06-02T22:52:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.523+0000 7f12367fc640 1 -- 172.21.15.82:0/279694171 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f12300ac000 con 0x7f12400718e0 2024-06-02T22:52:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.523+0000 7f0562d9d640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f055006be30 0x7f055006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.523+0000 7f12455b0640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f122406bf00 0x7f122406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.523+0000 7f0562d9d640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f055006be30 0x7f055006e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0558000f60 tx=0x7f05580079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.523+0000 7f1248015640 1 -- 172.21.15.82:0/279694171 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1240068ad0 con 0x7f12400718e0 2024-06-02T22:52:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.524+0000 7f1fd0ff9640 1 -- 172.21.15.82:0/2021722923 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fcc00a9f0 con 0x7f1fd4154550 2024-06-02T22:52:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.524+0000 7f1fd0ff9640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1fb406be30 0x7f1fb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.525+0000 7f1fd37fe640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1fb406be30 0x7f1fb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.525+0000 7f1fd0ff9640 1 -- 172.21.15.82:0/2021722923 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1fcc08a410 con 0x7f1fd4154550 2024-06-02T22:52:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.525+0000 7f1fd37fe640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1fb406be30 0x7f1fb406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4001c30 tx=0x7f1fc4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.525+0000 7f12455b0640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f122406bf00 0x7f122406e3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f124006db90 tx=0x7f123c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.527+0000 7f054b7fe640 1 -- 172.21.15.82:0/3029071843 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f05640b3f70 con 0x7f05640cd0c0 2024-06-02T22:52:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.529+0000 7f12367fc640 1 -- 172.21.15.82:0/279694171 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f123007a650 con 0x7f12400718e0 2024-06-02T22:52:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.533+0000 7f48baffd640 1 -- 172.21.15.82:0/918231749 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f48c4054080 con 0x7f48cc0d2810 2024-06-02T22:52:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.533+0000 7f1fd0ff9640 1 -- 172.21.15.82:0/2021722923 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1fcc058420 con 0x7f1fd4154550 2024-06-02T22:52:25.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.923+0000 7f721a451640 1 -- 172.21.15.82:0/2584866211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f720c005390 con 0x7f720c036720 2024-06-02T22:52:25.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.924+0000 7f7209ffb640 1 -- 172.21.15.82:0/2584866211 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f72040593c0 con 0x7f720c036720 2024-06-02T22:52:25.924 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2024-06-02T22:52:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.927+0000 7f71ff7fe640 1 -- 172.21.15.82:0/2584866211 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f71f806be30 msgr2=0x7f71f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.927+0000 7f71ff7fe640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f71f806be30 0x7f71f806e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7210037000 tx=0x7f7210032000 comp rx=0 tx=0).stop 2024-06-02T22:52:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.928+0000 7f71ff7fe640 1 -- 172.21.15.82:0/2584866211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f720c036720 msgr2=0x7f720c0d2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.928+0000 7f71ff7fe640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f720c036720 0x7f720c0d2cf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f720400e870 tx=0x7f720400ed30 comp rx=0 tx=0).stop 2024-06-02T22:52:25.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.928+0000 7f71ff7fe640 1 -- 172.21.15.82:0/2584866211 shutdown_connections 2024-06-02T22:52:25.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.928+0000 7f71ff7fe640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f71f806be30 0x7f71f806e2f0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7210037000 tx=0x7f7210032000 comp rx=0 tx=0).stop 2024-06-02T22:52:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.928+0000 7f71ff7fe640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f720c036720 0x7f720c0d2cf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.928+0000 7f71ff7fe640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f720c0567c0 0x7f720c0e3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.928+0000 7f71ff7fe640 1 --2- 172.21.15.82:0/2584866211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f720c03ca20 0x7f720c0e1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.928+0000 7f71ff7fe640 1 -- 172.21.15.82:0/2584866211 >> 172.21.15.82:0/2584866211 conn(0x7f720c056ce0 msgr2=0x7f720c0dd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.929+0000 7f71ff7fe640 1 -- 172.21.15.82:0/2584866211 shutdown_connections 2024-06-02T22:52:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.929+0000 7f71ff7fe640 1 -- 172.21.15.82:0/2584866211 wait complete. 2024-06-02T22:52:25.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.931+0000 7f5f6a9eb640 1 -- 172.21.15.82:0/2339689771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5f4c005850 con 0x7f5f5c0501a0 2024-06-02T22:52:25.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.932+0000 7f5f5a7fc640 1 -- 172.21.15.82:0/2339689771 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f54079d30 con 0x7f5f5c0501a0 2024-06-02T22:52:25.932 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:25.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.935+0000 7f5f47fff640 1 -- 172.21.15.82:0/2339689771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5f4806be80 msgr2=0x7f5f4806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.936+0000 7f5f47fff640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5f4806be80 0x7f5f4806e340 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5f6406ae20 tx=0x7f5f64069140 comp rx=0 tx=0).stop 2024-06-02T22:52:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.936+0000 7f5f47fff640 1 -- 172.21.15.82:0/2339689771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c0501a0 msgr2=0x7f5f5c0eb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.936+0000 7f5f47fff640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c0501a0 0x7f5f5c0eb540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f54031000 tx=0x7f5f540046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.936+0000 7f5f47fff640 1 -- 172.21.15.82:0/2339689771 shutdown_connections 2024-06-02T22:52:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.936+0000 7f5f47fff640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5f4806be80 0x7f5f4806e340 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.936+0000 7f5f47fff640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c0501a0 0x7f5f5c0eb540 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.937+0000 7f5f47fff640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5f5c0392d0 0x7f5f5c0efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.937+0000 7f5f47fff640 1 --2- 172.21.15.82:0/2339689771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5c00aaa0 0x7f5f5c04b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.937+0000 7f5f47fff640 1 -- 172.21.15.82:0/2339689771 >> 172.21.15.82:0/2339689771 conn(0x7f5f5c009fb0 msgr2=0x7f5f5c0369b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.937+0000 7f5f47fff640 1 -- 172.21.15.82:0/2339689771 shutdown_connections 2024-06-02T22:52:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.937+0000 7f5f47fff640 1 -- 172.21.15.82:0/2339689771 wait complete. 2024-06-02T22:52:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.944+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/2511352253 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9c58165f40 con 0x7f9c58166b70 2024-06-02T22:52:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.944+0000 7f9c557fa640 1 -- 172.21.15.82:0/2511352253 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9c50059950 con 0x7f9c58166b70 2024-06-02T22:52:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.946+0000 7f48cb59e640 1 -- 172.21.15.82:0/918231749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f48cc09d5a0 con 0x7f48cc0d2810 2024-06-02T22:52:25.946 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2024-06-02T22:52:25.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-06-02T22:52:25.947 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2024-06-02T22:52:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.946+0000 7f48baffd640 1 -- 172.21.15.82:0/918231749 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f48c407b790 con 0x7f48cc0d2810 2024-06-02T22:52:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.946+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2f440cf370 con 0x7f2f440ce470 2024-06-02T22:52:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.947+0000 7f2f3b7fe640 1 -- 172.21.15.82:0/1062371770 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f2c05d180 con 0x7f2f440ce470 2024-06-02T22:52:25.948 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2024-06-02T22:52:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.948+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/2511352253 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c3c06beb0 msgr2=0x7f9c3c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.948+0000 7f9c5eb4f640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c3c06beb0 0x7f9c3c06e370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c44034000 tx=0x7f9c4402e000 comp rx=0 tx=0).stop 2024-06-02T22:52:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.948+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/2511352253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c58166b70 msgr2=0x7f9c580cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.948+0000 7f9c5eb4f640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c58166b70 0x7f9c580cd350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000efc0 tx=0x7f9c5000c490 comp rx=0 tx=0).stop 2024-06-02T22:52:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.948+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/2511352253 shutdown_connections 2024-06-02T22:52:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.948+0000 7f9c5eb4f640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c3c06beb0 0x7f9c3c06e370 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c44034000 tx=0x7f9c4402e000 comp rx=0 tx=0).stop 2024-06-02T22:52:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.948+0000 7f9c5eb4f640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c58166b70 0x7f9c580cd350 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.948+0000 7f9c5eb4f640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c581625c0 0x7f9c580c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.948+0000 7f9c5eb4f640 1 --2- 172.21.15.82:0/2511352253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c580cf920 0x7f9c58200410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.948+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/2511352253 >> 172.21.15.82:0/2511352253 conn(0x7f9c580d4290 msgr2=0x7f9c5815fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.949+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/2511352253 shutdown_connections 2024-06-02T22:52:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.949+0000 7f9c5eb4f640 1 -- 172.21.15.82:0/2511352253 wait complete. 2024-06-02T22:52:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.949+0000 7f48cb59e640 1 -- 172.21.15.82:0/918231749 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f48ac06be30 msgr2=0x7f48ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.949+0000 7f48cb59e640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f48ac06be30 0x7f48ac06e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f48bc007fd0 tx=0x7f48bc007e80 comp rx=0 tx=0).stop 2024-06-02T22:52:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.949+0000 7f48cb59e640 1 -- 172.21.15.82:0/918231749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc0d2810 msgr2=0x7f48cc0c9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.949+0000 7f48cb59e640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc0d2810 0x7f48cc0c9540 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48c402ac90 tx=0x7f48c4004a40 comp rx=0 tx=0).stop 2024-06-02T22:52:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f48cb59e640 1 -- 172.21.15.82:0/918231749 shutdown_connections 2024-06-02T22:52:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f48cb59e640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f48ac06be30 0x7f48ac06e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f48cb59e640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc0d2810 0x7f48cc0c9540 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f48cb59e640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48cc0cfdb0 0x7f48cc0c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f48cb59e640 1 --2- 172.21.15.82:0/918231749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc0b5130 0x7f48cc0cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f48cb59e640 1 -- 172.21.15.82:0/918231749 >> 172.21.15.82:0/918231749 conn(0x7f48cc09d1c0 msgr2=0x7f48cc0b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f48cb59e640 1 -- 172.21.15.82:0/918231749 shutdown_connections 2024-06-02T22:52:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f48cb59e640 1 -- 172.21.15.82:0/918231749 wait complete. 2024-06-02T22:52:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2f2406be30 msgr2=0x7f2f2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f2f48f30640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2f2406be30 0x7f2f2406e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009ad0 tx=0x7f2f34008040 comp rx=0 tx=0).stop 2024-06-02T22:52:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f440ce470 msgr2=0x7f2f44161d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f2f48f30640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f440ce470 0x7f2f44161d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00c460 tx=0x7f2f2c00c920 comp rx=0 tx=0).stop 2024-06-02T22:52:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f0569038640 1 -- 172.21.15.82:0/3029071843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0564068430 con 0x7f05640cd0c0 2024-06-02T22:52:25.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f1248015640 1 -- 172.21.15.82:0/279694171 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1240149e40 con 0x7f12400718e0 2024-06-02T22:52:25.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 shutdown_connections 2024-06-02T22:52:25.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f2f48f30640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2f2406be30 0x7f2f2406e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.950+0000 7f2f48f30640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f4414bdb0 0x7f2f440afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.951+0000 7f2f48f30640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f440ce470 0x7f2f44161d30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.951+0000 7f2f48f30640 1 --2- 172.21.15.82:0/1062371770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f4406d440 0x7f2f440aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.951+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 >> 172.21.15.82:0/1062371770 conn(0x7f2f440cfab0 msgr2=0x7f2f4414b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.951+0000 7f12367fc640 1 -- 172.21.15.82:0/279694171 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1230079f50 con 0x7f12400718e0 2024-06-02T22:52:25.955 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2024-06-02T22:52:25.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.951+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 shutdown_connections 2024-06-02T22:52:25.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.951+0000 7f054b7fe640 1 -- 172.21.15.82:0/3029071843 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f055c022070 con 0x7f05640cd0c0 2024-06-02T22:52:25.955 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2024-06-02T22:52:25.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.951+0000 7f2f48f30640 1 -- 172.21.15.82:0/1062371770 wait complete. 2024-06-02T22:52:25.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2024-06-02T22:52:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.954+0000 7f1248015640 1 -- 172.21.15.82:0/279694171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f122406bf00 msgr2=0x7f122406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.954+0000 7f1248015640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f122406bf00 0x7f122406e3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f124006db90 tx=0x7f123c009040 comp rx=0 tx=0).stop 2024-06-02T22:52:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.954+0000 7f1248015640 1 -- 172.21.15.82:0/279694171 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 msgr2=0x7f12401edce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 -- 172.21.15.82:0/3029071843 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f055006be30 msgr2=0x7f055006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.954+0000 7f1248015640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 0x7f12401edce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1230009870 tx=0x7f12300046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f055006be30 0x7f055006e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0558000f60 tx=0x7f05580079b0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f1248015640 1 -- 172.21.15.82:0/279694171 shutdown_connections 2024-06-02T22:52:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f1248015640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f122406bf00 0x7f122406e3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 -- 172.21.15.82:0/3029071843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05640cd0c0 msgr2=0x7f05641e6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05640cd0c0 0x7f05641e6a50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f055c00efc0 tx=0x7f055c00c490 comp rx=0 tx=0).stop 2024-06-02T22:52:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f1248015640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1240162820 0x7f1240149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f1248015640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12400af7e0 0x7f12401491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f1248015640 1 --2- 172.21.15.82:0/279694171 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12400718e0 0x7f12401edce0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f1248015640 1 -- 172.21.15.82:0/279694171 >> 172.21.15.82:0/279694171 conn(0x7f12400b22b0 msgr2=0x7f1240164ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 -- 172.21.15.82:0/3029071843 shutdown_connections 2024-06-02T22:52:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f055006be30 0x7f055006e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05641513c0 0x7f0564200da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05640cd0c0 0x7f05641e6a50 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f055c00efc0 tx=0x7f055c00c490 comp rx=0 tx=0).stop 2024-06-02T22:52:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 --2- 172.21.15.82:0/3029071843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05640ccce0 0x7f05641fe360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 -- 172.21.15.82:0/3029071843 >> 172.21.15.82:0/3029071843 conn(0x7f056406b3c0 msgr2=0x7f056415ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f1248015640 1 -- 172.21.15.82:0/279694171 shutdown_connections 2024-06-02T22:52:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f1248015640 1 -- 172.21.15.82:0/279694171 wait complete. 2024-06-02T22:52:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f1fd9f34640 1 -- 172.21.15.82:0/2021722923 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1fd40b28f0 con 0x7f1fd4154550 2024-06-02T22:52:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 -- 172.21.15.82:0/3029071843 shutdown_connections 2024-06-02T22:52:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.955+0000 7f0569038640 1 -- 172.21.15.82:0/3029071843 wait complete. 2024-06-02T22:52:25.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.956+0000 7f1fd0ff9640 1 -- 172.21.15.82:0/2021722923 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1fcc05c720 con 0x7f1fd4154550 2024-06-02T22:52:25.962 INFO:teuthology.orchestra.run.smithi082.stdout:55834574857 2024-06-02T22:52:25.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.959+0000 7f1fd9f34640 1 -- 172.21.15.82:0/2021722923 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1fb406be30 msgr2=0x7f1fb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.959+0000 7f1fd9f34640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1fb406be30 0x7f1fb406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4001c30 tx=0x7f1fc4009040 comp rx=0 tx=0).stop 2024-06-02T22:52:25.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.960+0000 7f1fd9f34640 1 -- 172.21.15.82:0/2021722923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd4154550 msgr2=0x7f1fd414a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:25.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.960+0000 7f1fd9f34640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd4154550 0x7f1fd414a8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40b50c0 tx=0x7f1fcc00cbe0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.960+0000 7f1fd9f34640 1 -- 172.21.15.82:0/2021722923 shutdown_connections 2024-06-02T22:52:25.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.960+0000 7f1fd9f34640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1fb406be30 0x7f1fb406e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.960+0000 7f1fd9f34640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1fd4154550 0x7f1fd414a8f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.960+0000 7f1fd9f34640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1fd4071e50 0x7f1fd40cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.960+0000 7f1fd9f34640 1 --2- 172.21.15.82:0/2021722923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fd406f140 0x7f1fd4145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:25.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.960+0000 7f1fd9f34640 1 -- 172.21.15.82:0/2021722923 >> 172.21.15.82:0/2021722923 conn(0x7f1fd40b1c20 msgr2=0x7f1fd40b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:25.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.960+0000 7f1fd9f34640 1 -- 172.21.15.82:0/2021722923 shutdown_connections 2024-06-02T22:52:25.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:25.960+0000 7f1fd9f34640 1 -- 172.21.15.82:0/2021722923 wait complete. 2024-06-02T22:52:25.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-06-02T22:52:25.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-06-02T22:52:25.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-06-02T22:52:25.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-06-02T22:52:25.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-06-02T22:52:25.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-06-02T22:52:26.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-02T22:52:26.957 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-02T22:52:26.969 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-02T22:52:26.970 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-02T22:52:26.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-02T22:52:26.975 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-02T22:52:26.976 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-02T22:52:26.977 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-02T22:52:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.110+0000 7f32f9714640 1 Processor -- start 2024-06-02T22:52:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.110+0000 7f32f9714640 1 -- start start 2024-06-02T22:52:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.112+0000 7f32f9714640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f32f406b3c0 0x7f32f40b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.112+0000 7f32f9714640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f40d1890 0x7f32f406b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.112+0000 7f32f9714640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f40cf3e0 con 0x7f32f406e7c0 2024-06-02T22:52:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.112+0000 7f32f9714640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f32f40cf710 con 0x7f32f406b3c0 2024-06-02T22:52:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.112+0000 7f32f9714640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f32f406bce0 con 0x7f32f40d1890 2024-06-02T22:52:27.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.112+0000 7f32f27fc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f40d1890 0x7f32f406b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.112+0000 7f32f27fc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f40d1890 0x7f32f406b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42758/0 (socket says 172.21.15.82:42758) 2024-06-02T22:52:27.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.112+0000 7f32f27fc640 1 -- 172.21.15.82:0/1006357240 learned_addr learned my addr 172.21.15.82:0/1006357240 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.112+0000 7f32f2ffd640 1 --2- 172.21.15.82:0/1006357240 >> v2:172.21.15.184:3300/0 conn(0x7f32f406b3c0 0x7f32f40b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.113+0000 7f32f27fc640 1 -- 172.21.15.82:0/1006357240 >> v2:172.21.15.184:3300/0 conn(0x7f32f406b3c0 msgr2=0x7f32f40b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.113+0000 7f32f27fc640 1 --2- 172.21.15.82:0/1006357240 >> v2:172.21.15.184:3300/0 conn(0x7f32f406b3c0 0x7f32f40b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.113+0000 7f32f27fc640 1 -- 172.21.15.82:0/1006357240 >> v1:172.21.15.184:6789/0 conn(0x7f32f406e7c0 legacy=0x7f32f40cfba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:52:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.113+0000 7f32f27fc640 1 -- 172.21.15.82:0/1006357240 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f406f010 con 0x7f32f40d1890 2024-06-02T22:52:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.114+0000 7f32f27fc640 1 --2- 172.21.15.82:0/1006357240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f40d1890 0x7f32f406b7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f32f40cd300 tx=0x7f32e402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6387976da7b07c7d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.114+0000 7f32f1ffb640 1 -- 172.21.15.82:0/1006357240 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4037070 con 0x7f32f40d1890 2024-06-02T22:52:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.115+0000 7f32f1ffb640 1 -- 172.21.15.82:0/1006357240 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e4032440 con 0x7f32f40d1890 2024-06-02T22:52:27.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.116+0000 7f32f9714640 1 -- 172.21.15.82:0/1006357240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f40d1890 msgr2=0x7f32f406b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.116+0000 7f32f9714640 1 --2- 172.21.15.82:0/1006357240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f40d1890 0x7f32f406b7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f32f40cd300 tx=0x7f32e402a210 comp rx=0 tx=0).stop 2024-06-02T22:52:27.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.116+0000 7f32f9714640 1 -- 172.21.15.82:0/1006357240 shutdown_connections 2024-06-02T22:52:27.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.116+0000 7f32f9714640 1 --2- 172.21.15.82:0/1006357240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f40d1890 0x7f32f406b7a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.116+0000 7f32f9714640 1 --2- 172.21.15.82:0/1006357240 >> v2:172.21.15.184:3300/0 conn(0x7f32f406b3c0 0x7f32f40b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.116+0000 7f32f9714640 1 -- 172.21.15.82:0/1006357240 >> 172.21.15.82:0/1006357240 conn(0x7f32f40b2a70 msgr2=0x7f32f40b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.116+0000 7f32f9714640 1 -- 172.21.15.82:0/1006357240 shutdown_connections 2024-06-02T22:52:27.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.116+0000 7f32f9714640 1 -- 172.21.15.82:0/1006357240 wait complete. 2024-06-02T22:52:27.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.119+0000 7f32f9714640 1 Processor -- start 2024-06-02T22:52:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.119+0000 7f32f9714640 1 -- start start 2024-06-02T22:52:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.120+0000 7f32f9714640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f406b3c0 0x7f32f40b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.120+0000 7f32f9714640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f406e7c0 0x7f32f414e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.121+0000 7f32f2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f406b3c0 0x7f32f40b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.121+0000 7f32f2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f406b3c0 0x7f32f40b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34580/0 (socket says 172.21.15.82:34580) 2024-06-02T22:52:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.121+0000 7f32f2ffd640 1 -- 172.21.15.82:0/1756424854 learned_addr learned my addr 172.21.15.82:0/1756424854 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.121+0000 7f32f27fc640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f406e7c0 0x7f32f414e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.121+0000 7f32f9714640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32f40d1890 0x7f32f40af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.121+0000 7f32f9714640 1 -- 172.21.15.82:0/1756424854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f32f40b5f90 con 0x7f32f406b3c0 2024-06-02T22:52:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.121+0000 7f32f9714640 1 -- 172.21.15.82:0/1756424854 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f32f406f5d0 con 0x7f32f40d1890 2024-06-02T22:52:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.121+0000 7f32f37fe640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32f40d1890 0x7f32f40af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.121+0000 7f32f9714640 1 -- 172.21.15.82:0/1756424854 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f32f406ec40 con 0x7f32f406e7c0 2024-06-02T22:52:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.122+0000 7f32f2ffd640 1 -- 172.21.15.82:0/1756424854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f406e7c0 msgr2=0x7f32f414e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.122+0000 7f32f2ffd640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f406e7c0 0x7f32f414e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.122+0000 7f32f2ffd640 1 -- 172.21.15.82:0/1756424854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32f40d1890 msgr2=0x7f32f40af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.122+0000 7f32f2ffd640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32f40d1890 0x7f32f40af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.122+0000 7f32f2ffd640 1 -- 172.21.15.82:0/1756424854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f40ae760 con 0x7f32f406b3c0 2024-06-02T22:52:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.122+0000 7f32f2ffd640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f406b3c0 0x7f32f40b18a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32e800d800 tx=0x7f32e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.123+0000 7f32f27fc640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f406e7c0 0x7f32f414e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.123+0000 7f32f37fe640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32f40d1890 0x7f32f40af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.123+0000 7f32db7fe640 1 -- 172.21.15.82:0/1756424854 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8018030 con 0x7f32f406b3c0 2024-06-02T22:52:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.123+0000 7f32f9714640 1 -- 172.21.15.82:0/1756424854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f40aea40 con 0x7f32f406b3c0 2024-06-02T22:52:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.123+0000 7f32f9714640 1 -- 172.21.15.82:0/1756424854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f414d820 con 0x7f32f406b3c0 2024-06-02T22:52:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.124+0000 7f32db7fe640 1 -- 172.21.15.82:0/1756424854 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e80096a0 con 0x7f32f406b3c0 2024-06-02T22:52:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.124+0000 7f32db7fe640 1 -- 172.21.15.82:0/1756424854 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8009870 con 0x7f32f406b3c0 2024-06-02T22:52:27.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.126+0000 7f32db7fe640 1 -- 172.21.15.82:0/1756424854 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32e801b070 con 0x7f32f406b3c0 2024-06-02T22:52:27.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.127+0000 7f32db7fe640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f32e006bf00 0x7f32e006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.127+0000 7f32f27fc640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f32e006bf00 0x7f32e006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.128+0000 7f32f27fc640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f32e006bf00 0x7f32e006e3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f32e4034000 tx=0x7f32e402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.128+0000 7f32db7fe640 1 -- 172.21.15.82:0/1756424854 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f32e808b460 con 0x7f32f406b3c0 2024-06-02T22:52:27.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.130+0000 7f32f9714640 1 -- 172.21.15.82:0/1756424854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f4074170 con 0x7f32f406b3c0 2024-06-02T22:52:27.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.139+0000 7f32db7fe640 1 -- 172.21.15.82:0/1756424854 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f32f4074170 con 0x7f32f406b3c0 2024-06-02T22:52:27.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.168+0000 7f00c33d5640 1 Processor -- start 2024-06-02T22:52:27.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.168+0000 7f00c33d5640 1 -- start start 2024-06-02T22:52:27.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.168+0000 7fb2c28f7640 1 Processor -- start 2024-06-02T22:52:27.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.168+0000 7fb2c28f7640 1 -- start start 2024-06-02T22:52:27.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.169+0000 7fd4f02a5640 1 Processor -- start 2024-06-02T22:52:27.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.169+0000 7fd4f02a5640 1 -- start start 2024-06-02T22:52:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7f00c33d5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc06d260 0x7f00bc0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7f00c33d5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00bc0cf990 con 0x7f00bc06cdb0 2024-06-02T22:52:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7f00c33d5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00bc0cf3d0 con 0x7f00bc0d0000 2024-06-02T22:52:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7fb2c28f7640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb2bc0af4e0 0x7fb2bc15a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7f00c33d5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f00bc0b3b50 con 0x7f00bc06d260 2024-06-02T22:52:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7fb2c28f7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2bc0cdb40 0x7fb2bc0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7fb2c28f7640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc15a680 con 0x7fb2bc06f120 2024-06-02T22:52:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7fb2c28f7640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fb2bc0b4050 con 0x7fb2bc0af4e0 2024-06-02T22:52:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7fb2c28f7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb2bc0ce930 con 0x7fb2bc0cdb40 2024-06-02T22:52:27.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7f00c1972640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc06d260 0x7f00bc0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7f00c1972640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc06d260 0x7f00bc0b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42778/0 (socket says 172.21.15.82:42778) 2024-06-02T22:52:27.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7f00c1972640 1 -- 172.21.15.82:0/2538216410 learned_addr learned my addr 172.21.15.82:0/2538216410 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7fb2bb7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb2bc06f120 0x7fb2bc15ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48158/0 (socket says 172.21.15.82:48158) 2024-06-02T22:52:27.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7f00c0970640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f00bc06cdb0 0x7f00bc0ce980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48154/0 (socket says 172.21.15.82:48154) 2024-06-02T22:52:27.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7f4e3b59e640 1 Processor -- start 2024-06-02T22:52:27.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7f00c1972640 1 -- 172.21.15.82:0/2538216410 >> v1:172.21.15.184:6789/0 conn(0x7f00bc0d0000 legacy=0x7f00bc0d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7f00c1972640 1 -- 172.21.15.82:0/2538216410 >> v1:172.21.15.82:6789/0 conn(0x7f00bc06cdb0 legacy=0x7f00bc0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7f00c1972640 1 -- 172.21.15.82:0/2538216410 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00bc0cf6b0 con 0x7f00bc06d260 2024-06-02T22:52:27.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.170+0000 7fb2bb7fe640 1 -- 172.21.15.82:0/288172761 learned_addr learned my addr 172.21.15.82:0/288172761 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:27.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7fd4f02a5640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd4e80b55e0 0x7fd4e815ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7fd4f02a5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e80d17b0 con 0x7fd4e815eaf0 2024-06-02T22:52:27.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7fd4f02a5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e80cea90 con 0x7fd4e8144900 2024-06-02T22:52:27.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7fd4f02a5640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e815f490 con 0x7fd4e80b55e0 2024-06-02T22:52:27.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7f44e759e640 1 Processor -- start 2024-06-02T22:52:27.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7f44e759e640 1 -- start start 2024-06-02T22:52:27.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7fb2c0e94640 1 --2- 172.21.15.82:0/288172761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2bc0cdb40 0x7fb2bc0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7fb2bbfff640 1 --2- 172.21.15.82:0/288172761 >> v2:172.21.15.184:3300/0 conn(0x7fb2bc0af4e0 0x7fb2bc15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7f4e3b59e640 1 -- start start 2024-06-02T22:52:27.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f4e3b59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4e340e7820 0x7f4e34038280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f4e3b59e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4e340eb300 0x7f4e340eb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f00c1972640 1 --2- 172.21.15.82:0/2538216410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc06d260 0x7f00bc0b4580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009eb0 tx=0x7f00b402a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d75b79260f7b9c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f00b3fff640 1 -- 172.21.15.82:0/2538216410 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b4036070 con 0x7f00bc06d260 2024-06-02T22:52:27.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f00b3fff640 1 -- 172.21.15.82:0/2538216410 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b4031600 con 0x7f00bc06d260 2024-06-02T22:52:27.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f00b3fff640 1 -- 172.21.15.82:0/2538216410 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b40319d0 con 0x7f00bc06d260 2024-06-02T22:52:27.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130367433 0 0) 0x7fb2bc15a680 con 0x7fb2bc06f120 2024-06-02T22:52:27.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a8003520 con 0x7fb2bc06f120 2024-06-02T22:52:27.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7fd4ee842640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd4e80b55e0 0x7fd4e815ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7fd4ee842640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd4e80b55e0 0x7fd4e815ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45696/0 (socket says 172.21.15.82:45696) 2024-06-02T22:52:27.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.171+0000 7fd4ee842640 1 -- 172.21.15.82:0/4084422003 learned_addr learned my addr 172.21.15.82:0/4084422003 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7fd4ed03f640 1 -- 172.21.15.82:0/4084422003 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757731054 0 0) 0x7fd4e80cea90 con 0x7fd4e8144900 2024-06-02T22:52:27.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7fd4ed03f640 1 -- 172.21.15.82:0/4084422003 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4d4003520 con 0x7fd4e8144900 2024-06-02T22:52:27.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f44e759e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e808b750 0x7f44e80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f4e39d9b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4e340eb300 0x7f4e340eb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f4e39d9b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4e340eb300 0x7f4e340eb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45710/0 (socket says 172.21.15.82:45710) 2024-06-02T22:52:27.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f4e39d9b640 1 -- 172.21.15.82:0/2815710629 learned_addr learned my addr 172.21.15.82:0/2815710629 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f4e3b59e640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e340e7c00 con 0x7f4e340ebcc0 2024-06-02T22:52:27.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f44e759e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e80ccee0 con 0x7f44e80ce3b0 2024-06-02T22:52:27.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f4e3b59e640 1 -- 172.21.15.82:0/2815710629 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f4e34057f20 con 0x7f4e340e7820 2024-06-02T22:52:27.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3407892127 0 0) 0x7fb2a8003520 con 0x7fb2bc06f120 2024-06-02T22:52:27.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f4e3b59e640 1 -- 172.21.15.82:0/2815710629 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f4e34058200 con 0x7f4e340eb300 2024-06-02T22:52:27.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2bc0cdb40 msgr2=0x7fb2bc0cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2baffd640 1 --2- 172.21.15.82:0/288172761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2bc0cdb40 0x7fb2bc0cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 >> v2:172.21.15.184:3300/0 conn(0x7fb2bc0af4e0 msgr2=0x7fb2bc15a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7fd4ee842640 1 -- 172.21.15.82:0/4084422003 >> v1:172.21.15.184:6789/0 conn(0x7fd4e8144900 legacy=0x7fd4e80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7fd4ee842640 1 -- 172.21.15.82:0/4084422003 >> v1:172.21.15.82:6789/0 conn(0x7fd4e815eaf0 legacy=0x7fd4e806b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7fd4ee842640 1 -- 172.21.15.82:0/4084422003 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e8161e10 con 0x7fd4e80b55e0 2024-06-02T22:52:27.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2baffd640 1 --2- 172.21.15.82:0/288172761 >> v2:172.21.15.184:3300/0 conn(0x7fb2bc0af4e0 0x7fb2bc15a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f44e759e640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e80ceba0 con 0x7f44e80cd700 2024-06-02T22:52:27.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc06e2b0 con 0x7fb2bc06f120 2024-06-02T22:52:27.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f4e3959a640 1 -- 172.21.15.82:0/2815710629 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1238214289 0 0) 0x7f4e340e7c00 con 0x7f4e340ebcc0 2024-06-02T22:52:27.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f4e3959a640 1 -- 172.21.15.82:0/2815710629 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e24003520 con 0x7f4e340ebcc0 2024-06-02T22:52:27.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fb2ac0019f0 con 0x7fb2bc06f120 2024-06-02T22:52:27.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f44e759e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f44e806eec0 con 0x7f44e808b750 2024-06-02T22:52:27.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f4e3a59c640 1 --2- 172.21.15.82:0/2815710629 >> v2:172.21.15.82:3300/0 conn(0x7f4e340e7820 0x7f4e34038280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 >> v1:172.21.15.82:6789/0 conn(0x7fb2bc06f120 legacy=0x7fb2bc15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f4e39d9b640 1 -- 172.21.15.82:0/2815710629 >> v2:172.21.15.82:3300/0 conn(0x7f4e340e7820 msgr2=0x7f4e34038280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f4e39d9b640 1 --2- 172.21.15.82:0/2815710629 >> v2:172.21.15.82:3300/0 conn(0x7f4e340e7820 0x7f4e34038280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f4e39d9b640 1 -- 172.21.15.82:0/2815710629 >> v1:172.21.15.184:6789/0 conn(0x7f4e340ebcc0 legacy=0x7f4e34053520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f4e39d9b640 1 -- 172.21.15.82:0/2815710629 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e340584e0 con 0x7f4e340eb300 2024-06-02T22:52:27.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2baffd640 1 --2- 172.21.15.82:0/288172761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2a80039b0 0x7fb2a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f4e3a59c640 1 --2- 172.21.15.82:0/2815710629 >> v2:172.21.15.82:3300/0 conn(0x7f4e340e7820 0x7f4e34038280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:27.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2baffd640 1 --2- 172.21.15.82:0/288172761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2a8004800 0x7fb2a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fd4ee842640 1 --2- 172.21.15.82:0/4084422003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e80b55e0 0x7fd4e815ef50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009870 tx=0x7fd4e402a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10dd02ba78488c5c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f00c33d5640 1 -- 172.21.15.82:0/2538216410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc06d260 msgr2=0x7f00bc0b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f00c33d5640 1 --2- 172.21.15.82:0/2538216410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc06d260 0x7f00bc0b4580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009eb0 tx=0x7f00b402a730 comp rx=0 tx=0).stop 2024-06-02T22:52:27.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2baffd640 1 --2- 172.21.15.82:0/288172761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2a80051c0 0x7fb2a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.172+0000 7f44e659c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e808b750 0x7f44e80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f44e6d9d640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f44e80cd700 0x7f44e80cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:35494/0 (socket says 172.21.15.82:35494) 2024-06-02T22:52:27.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f44e6d9d640 1 -- 172.21.15.82:0/1299726256 learned_addr learned my addr 172.21.15.82:0/1299726256 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:27.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f44e659c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e808b750 0x7f44e80cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42796/0 (socket says 172.21.15.82:42796) 2024-06-02T22:52:27.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fd4ed03f640 1 -- 172.21.15.82:0/4084422003 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4037070 con 0x7fd4e80b55e0 2024-06-02T22:52:27.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fd4ed03f640 1 -- 172.21.15.82:0/4084422003 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e4032440 con 0x7fd4e80b55e0 2024-06-02T22:52:27.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fd4ed03f640 1 -- 172.21.15.82:0/4084422003 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4032810 con 0x7fd4e80b55e0 2024-06-02T22:52:27.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f44e659c640 1 -- 172.21.15.82:0/1299726256 >> v1:172.21.15.184:6789/0 conn(0x7f44e80cd700 legacy=0x7f44e80cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f44e659c640 1 -- 172.21.15.82:0/1299726256 >> v1:172.21.15.82:6789/0 conn(0x7f44e80ce3b0 legacy=0x7f44e806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7f44e659c640 1 -- 172.21.15.82:0/1299726256 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e80cee80 con 0x7f44e808b750 2024-06-02T22:52:27.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f877026b640 1 Processor -- start 2024-06-02T22:52:27.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2bb7fe640 1 --2- 172.21.15.82:0/288172761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2a8004800 0x7fb2a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc0ce930 con 0x7fb2a8004800 2024-06-02T22:52:27.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a800c070 con 0x7fb2a80051c0 2024-06-02T22:52:27.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a800c270 con 0x7fb2a80039b0 2024-06-02T22:52:27.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.173+0000 7fb2bbfff640 1 --2- 172.21.15.82:0/288172761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2a80039b0 0x7fb2a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f4e39d9b640 1 --2- 172.21.15.82:0/2815710629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e340eb300 0x7f4e340eb780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e34056b70 tx=0x7f4e3002a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a492195a554eafb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f00c33d5640 1 -- 172.21.15.82:0/2538216410 shutdown_connections 2024-06-02T22:52:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f00c33d5640 1 --2- 172.21.15.82:0/2538216410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc06d260 0x7f00bc0b4580 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f00c33d5640 1 -- 172.21.15.82:0/2538216410 >> 172.21.15.82:0/2538216410 conn(0x7f00bc06b3c0 msgr2=0x7f00bc06b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f00c33d5640 1 -- 172.21.15.82:0/2538216410 shutdown_connections 2024-06-02T22:52:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f00c33d5640 1 -- 172.21.15.82:0/2538216410 wait complete. 2024-06-02T22:52:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f877026b640 1 -- start start 2024-06-02T22:52:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7fb2bb7fe640 1 -- 172.21.15.82:0/288172761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2a80039b0 msgr2=0x7fb2a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7fb2bb7fe640 1 --2- 172.21.15.82:0/288172761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2a80039b0 0x7fb2a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7fb2bb7fe640 1 -- 172.21.15.82:0/288172761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2a80051c0 msgr2=0x7fb2a800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:52:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7fb2bb7fe640 1 --2- 172.21.15.82:0/288172761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2a80051c0 0x7fb2a800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7fb2bb7fe640 1 -- 172.21.15.82:0/288172761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a8003520 con 0x7fb2a8004800 2024-06-02T22:52:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7fd4f02a5640 1 -- 172.21.15.82:0/4084422003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e80b55e0 msgr2=0x7fd4e815ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7fd4f02a5640 1 --2- 172.21.15.82:0/4084422003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e80b55e0 0x7fd4e815ef50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009870 tx=0x7fd4e402a2a0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f44e659c640 1 --2- 172.21.15.82:0/1299726256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e808b750 0x7f44e80cc9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f44d800ddc0 tx=0x7f44d802e680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8951ba2a84130a5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7fd4f02a5640 1 -- 172.21.15.82:0/4084422003 shutdown_connections 2024-06-02T22:52:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7fd4f02a5640 1 --2- 172.21.15.82:0/4084422003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e80b55e0 0x7fd4e815ef50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7f4e3959a640 1 -- 172.21.15.82:0/2815710629 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30037070 con 0x7f4e340eb300 2024-06-02T22:52:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7f4e3959a640 1 -- 172.21.15.82:0/2815710629 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e30032440 con 0x7f4e340eb300 2024-06-02T22:52:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7f4e3959a640 1 -- 172.21.15.82:0/2815710629 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e300327f0 con 0x7f4e340eb300 2024-06-02T22:52:27.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7fd4f02a5640 1 -- 172.21.15.82:0/4084422003 >> 172.21.15.82:0/4084422003 conn(0x7fd4e80b2a70 msgr2=0x7fd4e80b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7fd4f02a5640 1 -- 172.21.15.82:0/4084422003 shutdown_connections 2024-06-02T22:52:27.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f44e559a640 1 -- 172.21.15.82:0/1299726256 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d802ee60 con 0x7f44e808b750 2024-06-02T22:52:27.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f44e559a640 1 -- 172.21.15.82:0/1299726256 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d800b740 con 0x7f44e808b750 2024-06-02T22:52:27.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.174+0000 7f44e559a640 1 -- 172.21.15.82:0/1299726256 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d800bb10 con 0x7f44e808b750 2024-06-02T22:52:27.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7f44e759e640 1 -- 172.21.15.82:0/1299726256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e808b750 msgr2=0x7f44e80cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f877026b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f876815a3b0 0x7f876815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f4e3b59e640 1 -- 172.21.15.82:0/2815710629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e340eb300 msgr2=0x7f4e340eb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7f44e759e640 1 --2- 172.21.15.82:0/1299726256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e808b750 0x7f44e80cc9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f44d800ddc0 tx=0x7f44d802e680 comp rx=0 tx=0).stop 2024-06-02T22:52:27.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f4e3b59e640 1 --2- 172.21.15.82:0/2815710629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e340eb300 0x7f4e340eb780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e34056b70 tx=0x7f4e3002a290 comp rx=0 tx=0).stop 2024-06-02T22:52:27.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7fb2bb7fe640 1 --2- 172.21.15.82:0/288172761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2a8004800 0x7fb2a8004c80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00a7a0 tx=0x7fb2a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ac656cd3be797a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f877026b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f87680ccde0 0x7f87680b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f00c33d5640 1 Processor -- start 2024-06-02T22:52:27.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f4e3b59e640 1 -- 172.21.15.82:0/2815710629 shutdown_connections 2024-06-02T22:52:27.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f4e3b59e640 1 --2- 172.21.15.82:0/2815710629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e340eb300 0x7f4e340eb780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f4e3b59e640 1 --2- 172.21.15.82:0/2815710629 >> v2:172.21.15.82:3300/0 conn(0x7f4e340e7820 0x7f4e34038280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f4e3b59e640 1 -- 172.21.15.82:0/2815710629 >> 172.21.15.82:0/2815710629 conn(0x7f4e340559e0 msgr2=0x7f4e34055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f877026b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f876806dfd0 con 0x7f87680af4e0 2024-06-02T22:52:27.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f876d806640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f87680af4e0 0x7f87680cc6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:35508/0 (socket says 172.21.15.82:35508) 2024-06-02T22:52:27.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f876d806640 1 -- 172.21.15.82:0/1303983161 learned_addr learned my addr 172.21.15.82:0/1303983161 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:27.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f44e759e640 1 -- 172.21.15.82:0/1299726256 shutdown_connections 2024-06-02T22:52:27.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f44e759e640 1 --2- 172.21.15.82:0/1299726256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e808b750 0x7f44e80cc9a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f44e759e640 1 -- 172.21.15.82:0/1299726256 >> 172.21.15.82:0/1299726256 conn(0x7f44e806b3c0 msgr2=0x7f44e806b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f876e007640 1 --2- 172.21.15.82:0/1303983161 >> v2:172.21.15.184:3300/0 conn(0x7f876815a3b0 0x7f876815ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.175+0000 7fd4f02a5640 1 -- 172.21.15.82:0/4084422003 wait complete. 2024-06-02T22:52:27.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f877026b640 1 -- 172.21.15.82:0/1303983161 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f87680b4050 con 0x7f87680ccde0 2024-06-02T22:52:27.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f877026b640 1 -- 172.21.15.82:0/1303983161 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f87680ce930 con 0x7f876815a3b0 2024-06-02T22:52:27.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f4e3b59e640 1 -- 172.21.15.82:0/2815710629 shutdown_connections 2024-06-02T22:52:27.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f4e3b59e640 1 -- 172.21.15.82:0/2815710629 wait complete. 2024-06-02T22:52:27.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f00c33d5640 1 -- start start 2024-06-02T22:52:27.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f876e808640 1 --2- 172.21.15.82:0/1303983161 >> v2:172.21.15.82:3300/0 conn(0x7f87680ccde0 0x7f87680b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f876d005640 1 -- 172.21.15.82:0/1303983161 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3390190727 0 0) 0x7f876806dfd0 con 0x7f87680af4e0 2024-06-02T22:52:27.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f44e759e640 1 -- 172.21.15.82:0/1299726256 shutdown_connections 2024-06-02T22:52:27.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f876d005640 1 -- 172.21.15.82:0/1303983161 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8754003520 con 0x7f87680af4e0 2024-06-02T22:52:27.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f00c33d5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00bc06cdb0 0x7f00bc14cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f00c33d5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc06d260 0x7f00bc0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f00c33d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00bc0d0000 0x7f00bc15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f00c33d5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00bc0cf090 con 0x7f00bc0d0000 2024-06-02T22:52:27.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f00c33d5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f00bc0b4060 con 0x7f00bc06cdb0 2024-06-02T22:52:27.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f00c33d5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f00bc1604c0 con 0x7f00bc06d260 2024-06-02T22:52:27.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f00c1171640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00bc06cdb0 0x7f00bc14cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f00c1171640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00bc06cdb0 0x7f00bc14cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45722/0 (socket says 172.21.15.82:45722) 2024-06-02T22:52:27.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f00c1171640 1 -- 172.21.15.82:0/2697989516 learned_addr learned my addr 172.21.15.82:0/2697989516 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7f00c1972640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00bc0d0000 0x7f00bc15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac00a3f0 con 0x7fb2a8004800 2024-06-02T22:52:27.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ac02f070 con 0x7fb2a8004800 2024-06-02T22:52:27.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fb2baffd640 1 -- 172.21.15.82:0/288172761 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac02bca0 con 0x7fb2a8004800 2024-06-02T22:52:27.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fb2c28f7640 1 -- 172.21.15.82:0/288172761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2a8004800 msgr2=0x7fb2a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fb2c28f7640 1 --2- 172.21.15.82:0/288172761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2a8004800 0x7fb2a8004c80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00a7a0 tx=0x7fb2a8005830 comp rx=0 tx=0).stop 2024-06-02T22:52:27.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fb2c0e94640 1 -- 172.21.15.82:0/288172761 reap_dead start 2024-06-02T22:52:27.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fb2c28f7640 1 -- 172.21.15.82:0/288172761 shutdown_connections 2024-06-02T22:52:27.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fb2c28f7640 1 -- 172.21.15.82:0/288172761 >> 172.21.15.82:0/288172761 conn(0x7fb2bc0b19f0 msgr2=0x7fb2bc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fb2c28f7640 1 -- 172.21.15.82:0/288172761 shutdown_connections 2024-06-02T22:52:27.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fb2c28f7640 1 -- 172.21.15.82:0/288172761 wait complete. 2024-06-02T22:52:27.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7fdf8bba9640 1 Processor -- start 2024-06-02T22:52:27.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7fd4f02a5640 1 Processor -- start 2024-06-02T22:52:27.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.176+0000 7f44e759e640 1 -- 172.21.15.82:0/1299726256 wait complete. 2024-06-02T22:52:27.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7fd4f02a5640 1 -- start start 2024-06-02T22:52:27.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7f44e759e640 1 Processor -- start 2024-06-02T22:52:27.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7f4e3b59e640 1 Processor -- start 2024-06-02T22:52:27.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f876e007640 1 -- 172.21.15.82:0/1303983161 >> v2:172.21.15.82:3300/0 conn(0x7f87680ccde0 msgr2=0x7f87680b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f876e007640 1 --2- 172.21.15.82:0/1303983161 >> v2:172.21.15.82:3300/0 conn(0x7f87680ccde0 0x7f87680b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f876e007640 1 -- 172.21.15.82:0/1303983161 >> v1:172.21.15.184:6789/0 conn(0x7f87680af4e0 legacy=0x7f87680cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.177+0000 7f876e007640 1 -- 172.21.15.82:0/1303983161 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876806e2b0 con 0x7f876815a3b0 2024-06-02T22:52:27.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7f876e007640 1 --2- 172.21.15.82:0/1303983161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f876815a3b0 0x7f876815ddf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8768075080 tx=0x7f876402c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=851ea672aa0b08b0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fd4f02a5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e80b55e0 0x7fd4e8141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fd4f02a5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4e8144900 0x7fd4e815b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fd4f02a5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e815eaf0 0x7fd4e81670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fd4f02a5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e80b3e10 con 0x7fd4e8144900 2024-06-02T22:52:27.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fd4f02a5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e80b4140 con 0x7fd4e815eaf0 2024-06-02T22:52:27.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fd4f02a5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e80cf010 con 0x7fd4e80b55e0 2024-06-02T22:52:27.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7f4e3b59e640 1 -- start start 2024-06-02T22:52:27.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7f44e759e640 1 -- start start 2024-06-02T22:52:27.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7f876d005640 1 -- 172.21.15.82:0/1303983161 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876403b070 con 0x7f876815a3b0 2024-06-02T22:52:27.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7f876d005640 1 -- 172.21.15.82:0/1303983161 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87640369b0 con 0x7f876815a3b0 2024-06-02T22:52:27.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7f876d005640 1 -- 172.21.15.82:0/1303983161 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764036da0 con 0x7f876815a3b0 2024-06-02T22:52:27.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7fd4ed840640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4e8144900 0x7fd4e815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7fd4ed840640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4e8144900 0x7fd4e815b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34622/0 (socket says 172.21.15.82:34622) 2024-06-02T22:52:27.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7fd4ed840640 1 -- 172.21.15.82:0/1052340235 learned_addr learned my addr 172.21.15.82:0/1052340235 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7f00c1972640 1 -- 172.21.15.82:0/2697989516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc06d260 msgr2=0x7f00bc0aece0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:52:27.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7f00c1972640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc06d260 0x7f00bc0aece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7f00c1972640 1 -- 172.21.15.82:0/2697989516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00bc06cdb0 msgr2=0x7f00bc14cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7f00c1972640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00bc06cdb0 0x7f00bc14cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7f00c1972640 1 -- 172.21.15.82:0/2697989516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00bc1650c0 con 0x7f00bc0d0000 2024-06-02T22:52:27.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.178+0000 7fdf8bba9640 1 -- start start 2024-06-02T22:52:27.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7fd4ee842640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e815eaf0 0x7fd4e81670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7fd4ee041640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e80b55e0 0x7fd4e8141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f00c1972640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00bc0d0000 0x7f00bc15cf50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0cd840 tx=0x7f00b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f877026b640 1 -- 172.21.15.82:0/1303983161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f876815a3b0 msgr2=0x7f876815ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f877026b640 1 --2- 172.21.15.82:0/1303983161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f876815a3b0 0x7f876815ddf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8768075080 tx=0x7f876402c3f0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7fb2c28f7640 1 Processor -- start 2024-06-02T22:52:27.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7fd4ed840640 1 -- 172.21.15.82:0/1052340235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e80b55e0 msgr2=0x7fd4e8141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7fd4ed840640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e80b55e0 0x7fd4e8141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7fd4ed840640 1 -- 172.21.15.82:0/1052340235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e815eaf0 msgr2=0x7fd4e81670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7fd4ed840640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e815eaf0 0x7fd4e81670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7fd4ed840640 1 -- 172.21.15.82:0/1052340235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e815c320 con 0x7fd4e8144900 2024-06-02T22:52:27.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7fd4ee041640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e80b55e0 0x7fd4e8141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:27.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f44e759e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e808b750 0x7f44e80ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f44e759e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e80cd700 0x7f44e8166200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7fdf8bba9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84162190 0x7fdf840d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f877026b640 1 -- 172.21.15.82:0/1303983161 shutdown_connections 2024-06-02T22:52:27.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f44e759e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44e80ce3b0 0x7f44e8166740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f44e759e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f44e806e320 con 0x7f44e808b750 2024-06-02T22:52:27.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f877026b640 1 --2- 172.21.15.82:0/1303983161 >> v2:172.21.15.82:3300/0 conn(0x7f87680ccde0 0x7f87680b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f877026b640 1 --2- 172.21.15.82:0/1303983161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f876815a3b0 0x7f876815ddf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f877026b640 1 -- 172.21.15.82:0/1303983161 >> 172.21.15.82:0/1303983161 conn(0x7f87680b19f0 msgr2=0x7f87680b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7fdf8bba9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf84162ca0 con 0x7fdf84161a30 2024-06-02T22:52:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f44e759e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f44e806dd60 con 0x7f44e80ce3b0 2024-06-02T22:52:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f44e759e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f44e80ce7d0 con 0x7f44e80cd700 2024-06-02T22:52:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f44e5d9b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e80cd700 0x7f44e8166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f44e5d9b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e80cd700 0x7f44e8166200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42852/0 (socket says 172.21.15.82:42852) 2024-06-02T22:52:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f44e5d9b640 1 -- 172.21.15.82:0/254617894 learned_addr learned my addr 172.21.15.82:0/254617894 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7fdf8bba9640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf8406dd60 con 0x7fdf8406d050 2024-06-02T22:52:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f44e6d9d640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44e80ce3b0 0x7f44e8166740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f877026b640 1 -- 172.21.15.82:0/1303983161 shutdown_connections 2024-06-02T22:52:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f877026b640 1 -- 172.21.15.82:0/1303983161 wait complete. 2024-06-02T22:52:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.179+0000 7fdf8bba9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8406db10 con 0x7fdf84162190 2024-06-02T22:52:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7fd4ed840640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4e8144900 0x7fd4e815b940 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000ba50 tx=0x7fd4e000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f44e659c640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e808b750 0x7f44e80ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f4e3b59e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e340e7820 0x7f4e34052950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f00b1ffb640 1 -- 172.21.15.82:0/2697989516 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b4041070 con 0x7f00bc0d0000 2024-06-02T22:52:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7f4e3b59e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e340eb300 0x7f4e340dd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7fdf89144640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fdf8406d050 0x7fdf84161320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:35512/0 (socket says 172.21.15.82:35512) 2024-06-02T22:52:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7fdf89144640 1 -- 172.21.15.82:0/1800838471 learned_addr learned my addr 172.21.15.82:0/1800838471 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f4e3a59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e340e7820 0x7f4e34052950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f4e3a59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e340e7820 0x7f4e34052950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45744/0 (socket says 172.21.15.82:45744) 2024-06-02T22:52:27.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f4e39d9b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e340eb300 0x7f4e340dd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fdf89945640 1 --2- 172.21.15.82:0/1800838471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84162190 0x7fdf840d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f4e39d9b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e340eb300 0x7f4e340dd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42868/0 (socket says 172.21.15.82:42868) 2024-06-02T22:52:27.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f44e659c640 1 -- 172.21.15.82:0/254617894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e80cd700 msgr2=0x7f44e8166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f44e659c640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e80cd700 0x7f44e8166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f44e659c640 1 -- 172.21.15.82:0/254617894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44e80ce3b0 msgr2=0x7f44e8166740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f44e659c640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44e80ce3b0 0x7f44e8166740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f44e659c640 1 -- 172.21.15.82:0/254617894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e809ab90 con 0x7f44e808b750 2024-06-02T22:52:27.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f4e3a59c640 1 -- 172.21.15.82:0/3172845786 learned_addr learned my addr 172.21.15.82:0/3172845786 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fdf88943640 1 -- 172.21.15.82:0/1800838471 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 166109224 0 0) 0x7fdf8406dd60 con 0x7fdf8406d050 2024-06-02T22:52:27.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f4e3b59e640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e340ebcc0 0x7f4e340dbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f00c33d5640 1 -- 172.21.15.82:0/2697989516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00bc164020 con 0x7f00bc0d0000 2024-06-02T22:52:27.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f00c33d5640 1 -- 172.21.15.82:0/2697989516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00bc1645e0 con 0x7f00bc0d0000 2024-06-02T22:52:27.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f00b1ffb640 1 -- 172.21.15.82:0/2697989516 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b4037040 con 0x7f00bc0d0000 2024-06-02T22:52:27.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fdf88943640 1 -- 172.21.15.82:0/1800838471 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf70003520 con 0x7fdf8406d050 2024-06-02T22:52:27.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.180+0000 7fb2c28f7640 1 -- start start 2024-06-02T22:52:27.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4e34058ce0 con 0x7f4e340ebcc0 2024-06-02T22:52:27.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fb2c28f7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2bc09d290 0x7fb2bc139a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fb2c28f7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2bc147bd0 0x7fb2bc139180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fb2c28f7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2bc15ca60 0x7fb2bc15cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fb2c28f7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc0cfa80 con 0x7fb2bc147bd0 2024-06-02T22:52:27.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4e340ec1a0 con 0x7f4e340e7820 2024-06-02T22:52:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fb2c28f7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc06ee30 con 0x7fb2bc09d290 2024-06-02T22:52:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fb2c28f7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb2bc06e870 con 0x7fb2bc15ca60 2024-06-02T22:52:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fdf89945640 1 -- 172.21.15.82:0/1800838471 >> v1:172.21.15.184:6789/0 conn(0x7fdf8406d050 legacy=0x7fdf84161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fdf89945640 1 -- 172.21.15.82:0/1800838471 >> v1:172.21.15.82:6789/0 conn(0x7fdf84161a30 legacy=0x7fdf840cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4e340546f0 con 0x7f4e340eb300 2024-06-02T22:52:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.181+0000 7fdf89945640 1 -- 172.21.15.82:0/1800838471 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf840d2830 con 0x7fdf84162190 2024-06-02T22:52:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2bc09d290 0x7fb2bc139a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2bc09d290 0x7fb2bc139a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45754/0 (socket says 172.21.15.82:45754) 2024-06-02T22:52:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7fb2bbfff640 1 -- 172.21.15.82:0/1824143941 learned_addr learned my addr 172.21.15.82:0/1824143941 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7f00b1ffb640 1 -- 172.21.15.82:0/2697989516 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b4036070 con 0x7f00bc0d0000 2024-06-02T22:52:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7fb2bbfff640 1 -- 172.21.15.82:0/1824143941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2bc15ca60 msgr2=0x7fb2bc15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7f4e39d9b640 1 -- 172.21.15.82:0/3172845786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e340e7820 msgr2=0x7f4e34052950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7f4e39d9b640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e340e7820 0x7f4e34052950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7f4e39d9b640 1 -- 172.21.15.82:0/3172845786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e340ebcc0 msgr2=0x7f4e340dbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7f4e39d9b640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e340ebcc0 0x7f4e340dbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7f877026b640 1 Processor -- start 2024-06-02T22:52:27.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7f4e39d9b640 1 -- 172.21.15.82:0/3172845786 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e340e0920 con 0x7f4e340eb300 2024-06-02T22:52:27.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7fb2bbfff640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2bc15ca60 0x7fb2bc15cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7f877026b640 1 -- start start 2024-06-02T22:52:27.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7fb2bbfff640 1 -- 172.21.15.82:0/1824143941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2bc147bd0 msgr2=0x7fb2bc139180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7fb2bbfff640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2bc147bd0 0x7fb2bc139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7fb2bbfff640 1 -- 172.21.15.82:0/1824143941 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc1389c0 con 0x7fb2bc09d290 2024-06-02T22:52:27.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7f00c33d5640 1 -- 172.21.15.82:0/2697989516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00bc068430 con 0x7f00bc0d0000 2024-06-02T22:52:27.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7f44e659c640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e808b750 0x7f44e80ad3a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f44d8035000 tx=0x7f44d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7fd4deffd640 1 -- 172.21.15.82:0/1052340235 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0019070 con 0x7fd4e8144900 2024-06-02T22:52:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7fd4deffd640 1 -- 172.21.15.82:0/1052340235 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e000cc10 con 0x7fd4e8144900 2024-06-02T22:52:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.182+0000 7fd4f02a5640 1 -- 172.21.15.82:0/1052340235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e815c600 con 0x7fd4e8144900 2024-06-02T22:52:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7fd4deffd640 1 -- 172.21.15.82:0/1052340235 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0014440 con 0x7fd4e8144900 2024-06-02T22:52:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7fd4f02a5640 1 -- 172.21.15.82:0/1052340235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e815cbc0 con 0x7fd4e8144900 2024-06-02T22:52:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7fb2bbfff640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2bc09d290 0x7fb2bc139a50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400f8f0 tx=0x7fb2a400fdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7fdf89945640 1 --2- 172.21.15.82:0/1800838471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84162190 0x7fdf840d1c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdf800097d0 tx=0x7fdf8002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b29b4f0d9a5b86cc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7fb2b8ff9640 1 -- 172.21.15.82:0/1824143941 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400db50 con 0x7fb2bc09d290 2024-06-02T22:52:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7fb2b8ff9640 1 -- 172.21.15.82:0/1824143941 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a400dcf0 con 0x7fb2bc09d290 2024-06-02T22:52:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7fb2b8ff9640 1 -- 172.21.15.82:0/1824143941 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400dea0 con 0x7fb2bc09d290 2024-06-02T22:52:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7fb2c28f7640 1 -- 172.21.15.82:0/1824143941 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc09d670 con 0x7fb2bc09d290 2024-06-02T22:52:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7fb2c28f7640 1 -- 172.21.15.82:0/1824143941 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2bc13a580 con 0x7fb2bc09d290 2024-06-02T22:52:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7fdf88943640 1 -- 172.21.15.82:0/1800838471 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf80037070 con 0x7fdf84162190 2024-06-02T22:52:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7fdf88943640 1 -- 172.21.15.82:0/1800838471 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8002ae40 con 0x7fdf84162190 2024-06-02T22:52:27.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7f4e39d9b640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e340eb300 0x7f4e340dd0f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e30031000 tx=0x7f4e300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7f4e2affd640 1 -- 172.21.15.82:0/3172845786 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30037040 con 0x7f4e340eb300 2024-06-02T22:52:27.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.183+0000 7f4e2affd640 1 -- 172.21.15.82:0/3172845786 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e30042070 con 0x7f4e340eb300 2024-06-02T22:52:27.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e340e0c00 con 0x7f4e340eb300 2024-06-02T22:52:27.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f4e2affd640 1 -- 172.21.15.82:0/3172845786 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30030bd0 con 0x7f4e340eb300 2024-06-02T22:52:27.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e340e11c0 con 0x7f4e340eb300 2024-06-02T22:52:27.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f877026b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87680af4e0 0x7f8768145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f877026b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87680ccde0 0x7f87681e27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f877026b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f876815a3b0 0x7f87681e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f877026b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f87680cfa80 con 0x7f87680ccde0 2024-06-02T22:52:27.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f877026b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f876806ee30 con 0x7f87680af4e0 2024-06-02T22:52:27.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f877026b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f876806e870 con 0x7f876815a3b0 2024-06-02T22:52:27.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f876e007640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87680af4e0 0x7f8768145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f876e007640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87680af4e0 0x7f8768145580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45760/0 (socket says 172.21.15.82:45760) 2024-06-02T22:52:27.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f876e007640 1 -- 172.21.15.82:0/2513034881 learned_addr learned my addr 172.21.15.82:0/2513034881 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7fdf8bba9640 1 -- 172.21.15.82:0/1800838471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84162190 msgr2=0x7fdf840d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7fdf8bba9640 1 --2- 172.21.15.82:0/1800838471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84162190 0x7fdf840d1c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdf800097d0 tx=0x7fdf8002a130 comp rx=0 tx=0).stop 2024-06-02T22:52:27.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f876e007640 1 -- 172.21.15.82:0/2513034881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f876815a3b0 msgr2=0x7f87681e2d00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:52:27.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f44d6ffd640 1 -- 172.21.15.82:0/254617894 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8035940 con 0x7f44e808b750 2024-06-02T22:52:27.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f876e007640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f876815a3b0 0x7f87681e2d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7fd4f02a5640 1 -- 172.21.15.82:0/1052340235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e8068ad0 con 0x7fd4e8144900 2024-06-02T22:52:27.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f876e007640 1 -- 172.21.15.82:0/2513034881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87680ccde0 msgr2=0x7f87681e27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f876e007640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87680ccde0 0x7f87681e27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f876e007640 1 -- 172.21.15.82:0/2513034881 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8768145ac0 con 0x7f87680af4e0 2024-06-02T22:52:27.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7fdf8bba9640 1 -- 172.21.15.82:0/1800838471 shutdown_connections 2024-06-02T22:52:27.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7fdf8bba9640 1 --2- 172.21.15.82:0/1800838471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84162190 0x7fdf840d1c80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.185+0000 7fdf8bba9640 1 -- 172.21.15.82:0/1800838471 >> 172.21.15.82:0/1800838471 conn(0x7fdf8409d3c0 msgr2=0x7fdf840d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f44d6ffd640 1 -- 172.21.15.82:0/254617894 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d8043070 con 0x7f44e808b750 2024-06-02T22:52:27.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.184+0000 7f44d6ffd640 1 -- 172.21.15.82:0/254617894 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8035d40 con 0x7f44e808b750 2024-06-02T22:52:27.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.185+0000 7fdf8bba9640 1 -- 172.21.15.82:0/1800838471 shutdown_connections 2024-06-02T22:52:27.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.185+0000 7f876e007640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87680af4e0 0x7f8768145580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8764000c00 tx=0x7f87640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.185+0000 7f875effd640 1 -- 172.21.15.82:0/2513034881 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876403b050 con 0x7f87680af4e0 2024-06-02T22:52:27.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.185+0000 7f875effd640 1 -- 172.21.15.82:0/2513034881 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8764047070 con 0x7f87680af4e0 2024-06-02T22:52:27.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.185+0000 7f875effd640 1 -- 172.21.15.82:0/2513034881 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764003a40 con 0x7f87680af4e0 2024-06-02T22:52:27.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.185+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e340057e0 con 0x7f4e340eb300 2024-06-02T22:52:27.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.185+0000 7f877026b640 1 -- 172.21.15.82:0/2513034881 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8768145f70 con 0x7f87680af4e0 2024-06-02T22:52:27.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.186+0000 7f877026b640 1 -- 172.21.15.82:0/2513034881 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8768146530 con 0x7f87680af4e0 2024-06-02T22:52:27.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.185+0000 7fdf8bba9640 1 -- 172.21.15.82:0/1800838471 wait complete. 2024-06-02T22:52:27.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.185+0000 7f44e759e640 1 -- 172.21.15.82:0/254617894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e809ae70 con 0x7f44e808b750 2024-06-02T22:52:27.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.185+0000 7f44e759e640 1 -- 172.21.15.82:0/254617894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e809b430 con 0x7f44e808b750 2024-06-02T22:52:27.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.186+0000 7f4e2affd640 1 -- 172.21.15.82:0/3172845786 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e30047460 con 0x7f4e340eb300 2024-06-02T22:52:27.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.186+0000 7fb2c28f7640 1 -- 172.21.15.82:0/1824143941 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2bc068430 con 0x7fb2bc09d290 2024-06-02T22:52:27.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.187+0000 7fdf8bba9640 1 Processor -- start 2024-06-02T22:52:27.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.187+0000 7f4e2affd640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e1c06be80 0x7f4e1c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.187+0000 7f4e2affd640 1 -- 172.21.15.82:0/3172845786 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4e300abb10 con 0x7f4e340eb300 2024-06-02T22:52:27.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.187+0000 7f4e3a59c640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e1c06be80 0x7f4e1c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7f4e3a59c640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e1c06be80 0x7f4e1c06e340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00ab80 tx=0x7f4e2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.187+0000 7f00b1ffb640 1 -- 172.21.15.82:0/2697989516 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00b4003b90 con 0x7f00bc0d0000 2024-06-02T22:52:27.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7f00b1ffb640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f00a006be60 0x7f00a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7f44e759e640 1 -- 172.21.15.82:0/254617894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e80683c0 con 0x7f44e808b750 2024-06-02T22:52:27.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7f00b1ffb640 1 -- 172.21.15.82:0/2697989516 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f00b40ac900 con 0x7f00bc0d0000 2024-06-02T22:52:27.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7f875effd640 1 -- 172.21.15.82:0/2513034881 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8764003be0 con 0x7f87680af4e0 2024-06-02T22:52:27.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7fd4deffd640 1 -- 172.21.15.82:0/1052340235 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4e001c070 con 0x7fd4e8144900 2024-06-02T22:52:27.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7f877026b640 1 -- 172.21.15.82:0/2513034881 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8750005290 con 0x7f87680af4e0 2024-06-02T22:52:27.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7f00c1171640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f00a006be60 0x7f00a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fd4deffd640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd4cc06be80 0x7fd4cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.187+0000 7fdf8bba9640 1 -- start start 2024-06-02T22:52:27.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7fdf8bba9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf8406d050 0x7fdf840a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7f875effd640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f874c06bf00 0x7f874c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7fdf8bba9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84161a30 0x7fdf8406e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fd4deffd640 1 -- 172.21.15.82:0/1052340235 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd4e008b010 con 0x7fd4e8144900 2024-06-02T22:52:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7fdf8bba9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf84162190 0x7fdf840b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7fdf8bba9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf841626f0 con 0x7fdf84162190 2024-06-02T22:52:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7f876d806640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f874c06bf00 0x7f874c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7fdf8bba9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdf84162570 con 0x7fdf8406d050 2024-06-02T22:52:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7fdf8bba9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdf84162870 con 0x7fdf84161a30 2024-06-02T22:52:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7fdf89144640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84161a30 0x7fdf8406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7fdf89144640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84161a30 0x7fdf8406e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42884/0 (socket says 172.21.15.82:42884) 2024-06-02T22:52:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7fdf89144640 1 -- 172.21.15.82:0/562706952 learned_addr learned my addr 172.21.15.82:0/562706952 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.188+0000 7fdf89945640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf8406d050 0x7fdf840a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7f875effd640 1 -- 172.21.15.82:0/2513034881 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f87640b02a0 con 0x7f87680af4e0 2024-06-02T22:52:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fd4ee041640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd4cc06be80 0x7fd4cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fb2b8ff9640 1 -- 172.21.15.82:0/1824143941 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2a4013680 con 0x7fb2bc09d290 2024-06-02T22:52:27.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fb2b8ff9640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29c06bf30 0x7fb29c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fdf89144640 1 -- 172.21.15.82:0/562706952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf8406d050 msgr2=0x7fdf840a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fdf89144640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf8406d050 0x7fdf840a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fdf89144640 1 -- 172.21.15.82:0/562706952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf84162190 msgr2=0x7fdf840b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fdf8a146640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf84162190 0x7fdf840b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fb2b8ff9640 1 -- 172.21.15.82:0/1824143941 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb2a408bf70 con 0x7fb2bc09d290 2024-06-02T22:52:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fdf89144640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf84162190 0x7fdf840b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fdf89144640 1 -- 172.21.15.82:0/562706952 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8409fc50 con 0x7fdf84161a30 2024-06-02T22:52:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.189+0000 7fdf8a146640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf84162190 0x7fdf840b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.190+0000 7f876d806640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f874c06bf00 0x7f874c06e3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f87680b2220 tx=0x7f8758007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.190+0000 7fb2bb7fe640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29c06bf30 0x7fb29c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.190+0000 7fdf89144640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84161a30 0x7fdf8406e750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00cbf0 tx=0x7fdf7c00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.190+0000 7fd4ee041640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd4cc06be80 0x7fd4cc06e340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80011e0 tx=0x7fd4d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.190+0000 7f00c1171640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f00a006be60 0x7f00a006e320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f00b8004ee0 tx=0x7f00b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.190+0000 7fb2bb7fe640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29c06bf30 0x7fb29c06e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac033000 tx=0x7fb2ac02d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.191+0000 7fdf7a7fc640 1 -- 172.21.15.82:0/562706952 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c017070 con 0x7fdf84161a30 2024-06-02T22:52:27.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.191+0000 7fdf7a7fc640 1 -- 172.21.15.82:0/562706952 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7c00ad40 con 0x7fdf84161a30 2024-06-02T22:52:27.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.191+0000 7fdf7a7fc640 1 -- 172.21.15.82:0/562706952 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c012620 con 0x7fdf84161a30 2024-06-02T22:52:27.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.191+0000 7fdf8bba9640 1 -- 172.21.15.82:0/562706952 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf8409ff30 con 0x7fdf84161a30 2024-06-02T22:52:27.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.191+0000 7fdf8bba9640 1 -- 172.21.15.82:0/562706952 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf840a04f0 con 0x7fdf84161a30 2024-06-02T22:52:27.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.191+0000 7f4e2affd640 1 -- 172.21.15.82:0/3172845786 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4e3007a1f0 con 0x7f4e340eb300 2024-06-02T22:52:27.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.192+0000 7f00b1ffb640 1 -- 172.21.15.82:0/2697989516 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f00b407af90 con 0x7f00bc0d0000 2024-06-02T22:52:27.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.193+0000 7fb2b8ff9640 1 -- 172.21.15.82:0/1824143941 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb2a4017030 con 0x7fb2bc09d290 2024-06-02T22:52:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.194+0000 7fdf7a7fc640 1 -- 172.21.15.82:0/562706952 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf7c01a070 con 0x7fdf84161a30 2024-06-02T22:52:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.194+0000 7fdf8bba9640 1 -- 172.21.15.82:0/562706952 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf84068ad0 con 0x7fdf84161a30 2024-06-02T22:52:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.195+0000 7fdf7a7fc640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdf6806be30 0x7fdf6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.195+0000 7fdf7a7fc640 1 -- 172.21.15.82:0/562706952 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdf7c08af20 con 0x7fdf84161a30 2024-06-02T22:52:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.195+0000 7f44d6ffd640 1 -- 172.21.15.82:0/254617894 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44d8048460 con 0x7f44e808b750 2024-06-02T22:52:27.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.195+0000 7fdf89945640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdf6806be30 0x7fdf6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.196+0000 7f44d6ffd640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f44c806be80 0x7f44c806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.196+0000 7fdf89945640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdf6806be30 0x7fdf6806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdf80034000 tx=0x7fdf8002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.196+0000 7f44e5d9b640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f44c806be80 0x7f44c806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.197+0000 7f44e5d9b640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f44c806be80 0x7f44c806e340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f44e820c720 tx=0x7f44dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.198+0000 7f875effd640 1 -- 172.21.15.82:0/2513034881 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f876400e070 con 0x7f87680af4e0 2024-06-02T22:52:27.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.200+0000 7fdf7a7fc640 1 -- 172.21.15.82:0/562706952 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdf7c058f30 con 0x7fdf84161a30 2024-06-02T22:52:27.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.200+0000 7fd4deffd640 1 -- 172.21.15.82:0/1052340235 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd4e00595e0 con 0x7fd4e8144900 2024-06-02T22:52:27.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.200+0000 7f44d6ffd640 1 -- 172.21.15.82:0/254617894 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f44d8078aa0 con 0x7f44e808b750 2024-06-02T22:52:27.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.209+0000 7f44d6ffd640 1 -- 172.21.15.82:0/254617894 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f44d807aa00 con 0x7f44e808b750 2024-06-02T22:52:27.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.539+0000 7f32f9714640 1 -- 172.21.15.82:0/1756424854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f32f4068ad0 con 0x7f32f406b3c0 2024-06-02T22:52:27.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.540+0000 7f32db7fe640 1 -- 172.21.15.82:0/1756424854 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32e8059ab0 con 0x7f32f406b3c0 2024-06-02T22:52:27.539 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:27.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.543+0000 7f32d97fa640 1 -- 172.21.15.82:0/1756424854 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f32e006bf00 msgr2=0x7f32e006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.543+0000 7f32d97fa640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f32e006bf00 0x7f32e006e3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f32e4034000 tx=0x7f32e402e000 comp rx=0 tx=0).stop 2024-06-02T22:52:27.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.543+0000 7f32d97fa640 1 -- 172.21.15.82:0/1756424854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f406b3c0 msgr2=0x7f32f40b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.543+0000 7f32d97fa640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f406b3c0 0x7f32f40b18a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32e800d800 tx=0x7f32e800dcc0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.544+0000 7f32d97fa640 1 -- 172.21.15.82:0/1756424854 shutdown_connections 2024-06-02T22:52:27.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.544+0000 7f32d97fa640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f32e006bf00 0x7f32e006e3c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.544+0000 7f32d97fa640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32f40d1890 0x7f32f40af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.544+0000 7f32d97fa640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32f406e7c0 0x7f32f414e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.544+0000 7f32d97fa640 1 --2- 172.21.15.82:0/1756424854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32f406b3c0 0x7f32f40b18a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.544+0000 7f32d97fa640 1 -- 172.21.15.82:0/1756424854 >> 172.21.15.82:0/1756424854 conn(0x7f32f40b2a70 msgr2=0x7f32f40b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.544+0000 7f32d97fa640 1 -- 172.21.15.82:0/1756424854 shutdown_connections 2024-06-02T22:52:27.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.544+0000 7f32d97fa640 1 -- 172.21.15.82:0/1756424854 wait complete. 2024-06-02T22:52:27.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-06-02T22:52:27.561 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.589+0000 7fd4f02a5640 1 -- 172.21.15.82:0/1052340235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd4e80d1990 con 0x7fd4e8144900 2024-06-02T22:52:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.589+0000 7fd4deffd640 1 -- 172.21.15.82:0/1052340235 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd4e0058ee0 con 0x7fd4e8144900 2024-06-02T22:52:27.589 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.591+0000 7fd4f02a5640 1 -- 172.21.15.82:0/1052340235 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd4cc06be80 msgr2=0x7fd4cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.591+0000 7fd4f02a5640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd4cc06be80 0x7fd4cc06e340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80011e0 tx=0x7fd4d8009040 comp rx=0 tx=0).stop 2024-06-02T22:52:27.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.591+0000 7fd4f02a5640 1 -- 172.21.15.82:0/1052340235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4e8144900 msgr2=0x7fd4e815b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.591+0000 7fd4f02a5640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4e8144900 0x7fd4e815b940 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000ba50 tx=0x7fd4e000bf10 comp rx=0 tx=0).stop 2024-06-02T22:52:27.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.592+0000 7fd4f02a5640 1 -- 172.21.15.82:0/1052340235 shutdown_connections 2024-06-02T22:52:27.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.592+0000 7fd4f02a5640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd4cc06be80 0x7fd4cc06e340 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.592+0000 7fd4f02a5640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e815eaf0 0x7fd4e81670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.592+0000 7fd4f02a5640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4e8144900 0x7fd4e815b940 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.592+0000 7fd4f02a5640 1 --2- 172.21.15.82:0/1052340235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e80b55e0 0x7fd4e8141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.592+0000 7fd4f02a5640 1 -- 172.21.15.82:0/1052340235 >> 172.21.15.82:0/1052340235 conn(0x7fd4e80b2a70 msgr2=0x7fd4e806e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.592+0000 7fd4f02a5640 1 -- 172.21.15.82:0/1052340235 shutdown_connections 2024-06-02T22:52:27.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.592+0000 7fd4f02a5640 1 -- 172.21.15.82:0/1052340235 wait complete. 2024-06-02T22:52:27.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-06-02T22:52:27.603 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:27.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.607+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4e3404f6a0 con 0x7f4e340eb300 2024-06-02T22:52:27.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.608+0000 7f4e2affd640 1 -- 172.21.15.82:0/3172845786 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e30079af0 con 0x7f4e340eb300 2024-06-02T22:52:27.608 INFO:teuthology.orchestra.run.smithi082.stdout:55834574859 2024-06-02T22:52:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e1c06be80 msgr2=0x7f4e1c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e1c06be80 0x7f4e1c06e340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00ab80 tx=0x7f4e2c008040 comp rx=0 tx=0).stop 2024-06-02T22:52:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e340eb300 msgr2=0x7f4e340dd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e340eb300 0x7f4e340dd0f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e30031000 tx=0x7f4e300046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 shutdown_connections 2024-06-02T22:52:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e1c06be80 0x7f4e1c06e340 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e340ebcc0 0x7f4e340dbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e340eb300 0x7f4e340dd0f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 --2- 172.21.15.82:0/3172845786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e340e7820 0x7f4e34052950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 >> 172.21.15.82:0/3172845786 conn(0x7f4e340559e0 msgr2=0x7f4e340e6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 shutdown_connections 2024-06-02T22:52:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.611+0000 7f4e3b59e640 1 -- 172.21.15.82:0/3172845786 wait complete. 2024-06-02T22:52:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.612+0000 7f877026b640 1 -- 172.21.15.82:0/2513034881 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8750005580 con 0x7f87680af4e0 2024-06-02T22:52:27.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.612+0000 7fb2c28f7640 1 -- 172.21.15.82:0/1824143941 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb2bc15a210 con 0x7fb2bc09d290 2024-06-02T22:52:27.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.613+0000 7f875effd640 1 -- 172.21.15.82:0/2513034881 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f876403f360 con 0x7f87680af4e0 2024-06-02T22:52:27.613 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.613+0000 7fb2b8ff9640 1 -- 172.21.15.82:0/1824143941 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb2a405a5c0 con 0x7fb2bc09d290 2024-06-02T22:52:27.614 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.615+0000 7f00c33d5640 1 -- 172.21.15.82:0/2697989516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f00bc0cdf70 con 0x7f00bc0d0000 2024-06-02T22:52:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.615+0000 7f00b1ffb640 1 -- 172.21.15.82:0/2697989516 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f00b407a890 con 0x7f00bc0d0000 2024-06-02T22:52:27.615 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 -- 172.21.15.82:0/1824143941 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29c06bf30 msgr2=0x7fb29c06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29c06bf30 0x7fb29c06e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac033000 tx=0x7fb2ac02d000 comp rx=0 tx=0).stop 2024-06-02T22:52:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 -- 172.21.15.82:0/1824143941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2bc09d290 msgr2=0x7fb2bc139a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2bc09d290 0x7fb2bc139a50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400f8f0 tx=0x7fb2a400fdb0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 -- 172.21.15.82:0/1824143941 shutdown_connections 2024-06-02T22:52:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29c06bf30 0x7fb29c06e3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2bc15ca60 0x7fb2bc15cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2bc147bd0 0x7fb2bc139180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 --2- 172.21.15.82:0/1824143941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2bc09d290 0x7fb2bc139a50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 -- 172.21.15.82:0/1824143941 >> 172.21.15.82:0/1824143941 conn(0x7fb2bc0b19f0 msgr2=0x7fb2bc0b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 -- 172.21.15.82:0/1824143941 shutdown_connections 2024-06-02T22:52:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7f877026b640 1 -- 172.21.15.82:0/2513034881 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f874c06bf00 msgr2=0x7f874c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7fb2c28f7640 1 -- 172.21.15.82:0/1824143941 wait complete. 2024-06-02T22:52:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7f877026b640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f874c06bf00 0x7f874c06e3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f87680b2220 tx=0x7f8758007930 comp rx=0 tx=0).stop 2024-06-02T22:52:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7f877026b640 1 -- 172.21.15.82:0/2513034881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87680af4e0 msgr2=0x7f8768145580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7f877026b640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87680af4e0 0x7f8768145580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8764000c00 tx=0x7f87640046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7f877026b640 1 -- 172.21.15.82:0/2513034881 shutdown_connections 2024-06-02T22:52:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.616+0000 7f877026b640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f874c06bf00 0x7f874c06e3c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.617+0000 7f877026b640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f876815a3b0 0x7f87681e2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.617+0000 7f877026b640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87680ccde0 0x7f87681e27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.617+0000 7f877026b640 1 --2- 172.21.15.82:0/2513034881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87680af4e0 0x7f8768145580 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.617+0000 7f877026b640 1 -- 172.21.15.82:0/2513034881 >> 172.21.15.82:0/2513034881 conn(0x7f87680b19f0 msgr2=0x7f876806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.617+0000 7f877026b640 1 -- 172.21.15.82:0/2513034881 shutdown_connections 2024-06-02T22:52:27.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.617+0000 7f877026b640 1 -- 172.21.15.82:0/2513034881 wait complete. 2024-06-02T22:52:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.618+0000 7f00c33d5640 1 -- 172.21.15.82:0/2697989516 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f00a006be60 msgr2=0x7f00a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.618+0000 7f00c33d5640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f00a006be60 0x7f00a006e320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f00b8004ee0 tx=0x7f00b8009040 comp rx=0 tx=0).stop 2024-06-02T22:52:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.618+0000 7f00c33d5640 1 -- 172.21.15.82:0/2697989516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00bc0d0000 msgr2=0x7f00bc15cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.618+0000 7f00c33d5640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00bc0d0000 0x7f00bc15cf50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0cd840 tx=0x7f00b4004a40 comp rx=0 tx=0).stop 2024-06-02T22:52:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.619+0000 7f00c33d5640 1 -- 172.21.15.82:0/2697989516 shutdown_connections 2024-06-02T22:52:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.619+0000 7f00c33d5640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f00a006be60 0x7f00a006e320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.619+0000 7f00c33d5640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00bc0d0000 0x7f00bc15cf50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.619+0000 7f00c33d5640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc06d260 0x7f00bc0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.619+0000 7f00c33d5640 1 --2- 172.21.15.82:0/2697989516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00bc06cdb0 0x7f00bc14cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.619+0000 7f00c33d5640 1 -- 172.21.15.82:0/2697989516 >> 172.21.15.82:0/2697989516 conn(0x7f00bc06b3c0 msgr2=0x7f00bc160780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.619+0000 7f00c33d5640 1 -- 172.21.15.82:0/2697989516 shutdown_connections 2024-06-02T22:52:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.619+0000 7f00c33d5640 1 -- 172.21.15.82:0/2697989516 wait complete. 2024-06-02T22:52:27.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.623+0000 7fdf8bba9640 1 -- 172.21.15.82:0/562706952 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fdf840b9f70 con 0x7fdf84161a30 2024-06-02T22:52:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.623+0000 7fdf7a7fc640 1 -- 172.21.15.82:0/562706952 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf7c05d230 con 0x7fdf84161a30 2024-06-02T22:52:27.623 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:27.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 -- 172.21.15.82:0/562706952 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdf6806be30 msgr2=0x7fdf6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdf6806be30 0x7fdf6806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdf80034000 tx=0x7fdf8002e000 comp rx=0 tx=0).stop 2024-06-02T22:52:27.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 -- 172.21.15.82:0/562706952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84161a30 msgr2=0x7fdf8406e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84161a30 0x7fdf8406e750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00cbf0 tx=0x7fdf7c00a430 comp rx=0 tx=0).stop 2024-06-02T22:52:27.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 -- 172.21.15.82:0/562706952 shutdown_connections 2024-06-02T22:52:27.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdf6806be30 0x7fdf6806e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf84162190 0x7fdf840b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf84161a30 0x7fdf8406e750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 --2- 172.21.15.82:0/562706952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf8406d050 0x7fdf840a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 -- 172.21.15.82:0/562706952 >> 172.21.15.82:0/562706952 conn(0x7fdf8409d3c0 msgr2=0x7fdf840d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 -- 172.21.15.82:0/562706952 shutdown_connections 2024-06-02T22:52:27.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.627+0000 7fdf8bba9640 1 -- 172.21.15.82:0/562706952 wait complete. 2024-06-02T22:52:27.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-06-02T22:52:27.628 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:27.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.632+0000 7f44e759e640 1 -- 172.21.15.82:0/254617894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f44e806d5f0 con 0x7f44e808b750 2024-06-02T22:52:27.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.632+0000 7f44d6ffd640 1 -- 172.21.15.82:0/254617894 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f44d807ed00 con 0x7f44e808b750 2024-06-02T22:52:27.632 INFO:teuthology.orchestra.run.smithi082.stdout:55834574858 2024-06-02T22:52:27.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-06-02T22:52:27.633 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:27.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-06-02T22:52:27.635 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 -- 172.21.15.82:0/254617894 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f44c806be80 msgr2=0x7f44c806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f44c806be80 0x7f44c806e340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f44e820c720 tx=0x7f44dc009040 comp rx=0 tx=0).stop 2024-06-02T22:52:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 -- 172.21.15.82:0/254617894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e808b750 msgr2=0x7f44e80ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e808b750 0x7f44e80ad3a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f44d8035000 tx=0x7f44d80046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 -- 172.21.15.82:0/254617894 shutdown_connections 2024-06-02T22:52:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f44c806be80 0x7f44c806e340 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44e80ce3b0 0x7f44e8166740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44e80cd700 0x7f44e8166200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 --2- 172.21.15.82:0/254617894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e808b750 0x7f44e80ad3a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 -- 172.21.15.82:0/254617894 >> 172.21.15.82:0/254617894 conn(0x7f44e806b3c0 msgr2=0x7f44e80afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 -- 172.21.15.82:0/254617894 shutdown_connections 2024-06-02T22:52:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.635+0000 7f44e759e640 1 -- 172.21.15.82:0/254617894 wait complete. 2024-06-02T22:52:27.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-06-02T22:52:27.638 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:27.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-06-02T22:52:27.641 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:27.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-06-02T22:52:27.646 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:27.646 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T22:52:27.646 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:52:27.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.786+0000 7f70b3ecd640 1 Processor -- start 2024-06-02T22:52:27.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.786+0000 7f70b3ecd640 1 -- start start 2024-06-02T22:52:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b3ecd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac06bad0 0x7f70ac1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b3ecd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70ac15f5c0 con 0x7f70ac162b00 2024-06-02T22:52:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b3ecd640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70ac162020 con 0x7f70ac154fc0 2024-06-02T22:52:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b3ecd640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f70ac0d03a0 con 0x7f70ac06bad0 2024-06-02T22:52:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b246a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f70ac162b00 0x7f70ac0afde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48196/0 (socket says 172.21.15.82:48196) 2024-06-02T22:52:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b246a640 1 -- 172.21.15.82:0/570699466 learned_addr learned my addr 172.21.15.82:0/570699466 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b1468640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac06bad0 0x7f70ac1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2445660635 0 0) 0x7f70ac15f5c0 con 0x7f70ac162b00 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7098003520 con 0x7f70ac162b00 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3317254233 0 0) 0x7f7098003520 con 0x7f70ac162b00 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac06bad0 msgr2=0x7f70ac1553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac06bad0 0x7f70ac1553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 >> v1:172.21.15.184:6789/0 conn(0x7f70ac154fc0 legacy=0x7f70ac06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac162300 con 0x7f70ac162b00 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f70a40019f0 con 0x7f70ac162b00 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 >> v1:172.21.15.82:6789/0 conn(0x7f70ac162b00 legacy=0x7f70ac0afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70980039e0 0x7f7098003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 0x7f7098004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac06bad0 0x7f70980050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac0d03a0 con 0x7f7098004390 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f709800b9c0 con 0x7f70980039e0 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.787+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f709800bbc0 con 0x7f70ac06bad0 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.788+0000 7f70b1468640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 0x7f7098004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.788+0000 7f70b1c69640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70980039e0 0x7f7098003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.788+0000 7f70b246a640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac06bad0 0x7f70980050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.788+0000 7f70b1468640 1 -- 172.21.15.82:0/570699466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac06bad0 msgr2=0x7f70980050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.788+0000 7f70b1468640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac06bad0 0x7f70980050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.788+0000 7f70b1468640 1 -- 172.21.15.82:0/570699466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70980039e0 msgr2=0x7f7098003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.788+0000 7f70b1468640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70980039e0 0x7f7098003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.788+0000 7f70b1468640 1 -- 172.21.15.82:0/570699466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7098003520 con 0x7f7098004390 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.789+0000 7f70b1468640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 0x7f7098004860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f709c009ac0 tx=0x7f7098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8cd2c74e92bed6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.789+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c036070 con 0x7f7098004390 2024-06-02T22:52:27.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.789+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f709c031400 con 0x7f7098004390 2024-06-02T22:52:27.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.789+0000 7f70b0c67640 1 -- 172.21.15.82:0/570699466 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c009690 con 0x7f7098004390 2024-06-02T22:52:27.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.789+0000 7f70b3ecd640 1 -- 172.21.15.82:0/570699466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 msgr2=0x7f7098004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.789+0000 7f70b3ecd640 1 --2- 172.21.15.82:0/570699466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 0x7f7098004860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f709c009ac0 tx=0x7f7098005830 comp rx=0 tx=0).stop 2024-06-02T22:52:27.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.789+0000 7f70b246a640 1 -- 172.21.15.82:0/570699466 reap_dead start 2024-06-02T22:52:27.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.789+0000 7f70b3ecd640 1 -- 172.21.15.82:0/570699466 shutdown_connections 2024-06-02T22:52:27.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.789+0000 7f70b3ecd640 1 -- 172.21.15.82:0/570699466 >> 172.21.15.82:0/570699466 conn(0x7f70ac0b2ae0 msgr2=0x7f70ac0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.789+0000 7f70b3ecd640 1 -- 172.21.15.82:0/570699466 shutdown_connections 2024-06-02T22:52:27.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.789+0000 7f70b3ecd640 1 -- 172.21.15.82:0/570699466 wait complete. 2024-06-02T22:52:27.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.790+0000 7f70b3ecd640 1 Processor -- start 2024-06-02T22:52:27.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.790+0000 7f70b3ecd640 1 -- start start 2024-06-02T22:52:27.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b3ecd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 0x7f70ac1f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b3ecd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70ac0b4c20 0x7f70ac0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b3ecd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac0b50a0 0x7f70ac0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b3ecd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac155520 con 0x7f7098004390 2024-06-02T22:52:27.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b3ecd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1553a0 con 0x7f70ac0b4c20 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b3ecd640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f70ac1556a0 con 0x7f70ac0b50a0 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b1c69640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 0x7f70ac1f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b1c69640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 0x7f70ac1f3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34694/0 (socket says 172.21.15.82:34694) 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b1c69640 1 -- 172.21.15.82:0/933465771 learned_addr learned my addr 172.21.15.82:0/933465771 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b246a640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac0b50a0 0x7f70ac0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b1468640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70ac0b4c20 0x7f70ac0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b1c69640 1 -- 172.21.15.82:0/933465771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac0b50a0 msgr2=0x7f70ac0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b1c69640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac0b50a0 0x7f70ac0b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b1c69640 1 -- 172.21.15.82:0/933465771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70ac0b4c20 msgr2=0x7f70ac0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.791+0000 7f70b1c69640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70ac0b4c20 0x7f70ac0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.792+0000 7f70b1c69640 1 -- 172.21.15.82:0/933465771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac0b5600 con 0x7f7098004390 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.792+0000 7f70b1468640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70ac0b4c20 0x7f70ac0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:27.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.792+0000 7f70b1c69640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 0x7f70ac1f3410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f70a800f7f0 tx=0x7f70a800fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.792+0000 7f70a27fc640 1 -- 172.21.15.82:0/933465771 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a800fe40 con 0x7f7098004390 2024-06-02T22:52:27.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.792+0000 7f70a27fc640 1 -- 172.21.15.82:0/933465771 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a8018070 con 0x7f7098004390 2024-06-02T22:52:27.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.792+0000 7f70b3ecd640 1 -- 172.21.15.82:0/933465771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ac0b58e0 con 0x7f7098004390 2024-06-02T22:52:27.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.792+0000 7f70a27fc640 1 -- 172.21.15.82:0/933465771 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a800d730 con 0x7f7098004390 2024-06-02T22:52:27.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.792+0000 7f70b3ecd640 1 -- 172.21.15.82:0/933465771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ac0b5ea0 con 0x7f7098004390 2024-06-02T22:52:27.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.793+0000 7f70b3ecd640 1 -- 172.21.15.82:0/933465771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ac068430 con 0x7f7098004390 2024-06-02T22:52:27.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.793+0000 7f70a27fc640 1 -- 172.21.15.82:0/933465771 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70a800d8d0 con 0x7f7098004390 2024-06-02T22:52:27.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.794+0000 7f70a27fc640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f709006be60 0x7f709006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:27.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.794+0000 7f70a27fc640 1 -- 172.21.15.82:0/933465771 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f70a808b060 con 0x7f7098004390 2024-06-02T22:52:27.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.794+0000 7f70b1468640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f709006be60 0x7f709006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:27.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.794+0000 7f70b1468640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f709006be60 0x7f709006e320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f709c009ac0 tx=0x7f709c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:27.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.798+0000 7f70a27fc640 1 -- 172.21.15.82:0/933465771 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f70a80596d0 con 0x7f7098004390 2024-06-02T22:52:27.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.969+0000 7f70b3ecd640 1 -- 172.21.15.82:0/933465771 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70ac0cec50 con 0x7f709006be60 2024-06-02T22:52:27.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.977+0000 7f70a27fc640 1 -- 172.21.15.82:0/933465771 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f70ac0cec50 con 0x7f709006be60 2024-06-02T22:52:27.980 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:52:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 -- 172.21.15.82:0/933465771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f709006be60 msgr2=0x7f709006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f709006be60 0x7f709006e320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f709c009ac0 tx=0x7f709c008030 comp rx=0 tx=0).stop 2024-06-02T22:52:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 -- 172.21.15.82:0/933465771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 msgr2=0x7f70ac1f3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 0x7f70ac1f3410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f70a800f7f0 tx=0x7f70a800fbf0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 -- 172.21.15.82:0/933465771 shutdown_connections 2024-06-02T22:52:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f709006be60 0x7f709006e320 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70ac0b50a0 0x7f70ac0b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70ac0b4c20 0x7f70ac0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 --2- 172.21.15.82:0/933465771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7098004390 0x7f70ac1f3410 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 -- 172.21.15.82:0/933465771 >> 172.21.15.82:0/933465771 conn(0x7f70ac0b2ae0 msgr2=0x7f70ac0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 -- 172.21.15.82:0/933465771 shutdown_connections 2024-06-02T22:52:27.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:27.980+0000 7f70b3ecd640 1 -- 172.21.15.82:0/933465771 wait complete. 2024-06-02T22:52:27.991 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-06-02T22:52:27.827721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002655"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867448+0000","last_change":"2024-06-02T22:52:02.575295+0000","last_active":"2024-06-02T22:52:09.867448+0000","last_peered":"2024-06-02T22:52:09.867448+0000","last_clean":"2024-06-02T22:52:09.867448+0000","last_became_active":"2024-06-02T22:52:02.575023+0000","last_became_peered":"2024-06-02T22:52:02.575023+0000","last_unstale":"2024-06-02T22:52:09.867448+0000","last_undegraded":"2024-06-02T22:52:09.867448+0000","last_fullsized":"2024-06-02T22:52:09.867448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:31:16.566686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802284+0000","last_change":"2024-06-02T22:52:03.580611+0000","last_active":"2024-06-02T22:52:09.802284+0000","last_peered":"2024-06-02T22:52:09.802284+0000","last_clean":"2024-06-02T22:52:09.802284+0000","last_became_active":"2024-06-02T22:52:03.580225+0000","last_became_peered":"2024-06-02T22:52:03.580225+0000","last_unstale":"2024-06-02T22:52:09.802284+0000","last_undegraded":"2024-06-02T22:52:09.802284+0000","last_fullsized":"2024-06-02T22:52:09.802284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801869+0000","last_change":"2024-06-02T22:52:07.615955+0000","last_active":"2024-06-02T22:52:09.801869+0000","last_peered":"2024-06-02T22:52:09.801869+0000","last_clean":"2024-06-02T22:52:09.801869+0000","last_became_active":"2024-06-02T22:52:07.615566+0000","last_became_peered":"2024-06-02T22:52:07.615566+0000","last_unstale":"2024-06-02T22:52:09.801869+0000","last_undegraded":"2024-06-02T22:52:09.801869+0000","last_fullsized":"2024-06-02T22:52:09.801869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:27:30.054564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802388+0000","last_change":"2024-06-02T22:52:02.574379+0000","last_active":"2024-06-02T22:52:09.802388+0000","last_peered":"2024-06-02T22:52:09.802388+0000","last_clean":"2024-06-02T22:52:09.802388+0000","last_became_active":"2024-06-02T22:52:02.574045+0000","last_became_peered":"2024-06-02T22:52:02.574045+0000","last_unstale":"2024-06-02T22:52:09.802388+0000","last_undegraded":"2024-06-02T22:52:09.802388+0000","last_fullsized":"2024-06-02T22:52:09.802388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867282+0000","last_change":"2024-06-02T22:52:03.576563+0000","last_active":"2024-06-02T22:52:09.867282+0000","last_peered":"2024-06-02T22:52:09.867282+0000","last_clean":"2024-06-02T22:52:09.867282+0000","last_became_active":"2024-06-02T22:52:03.576270+0000","last_became_peered":"2024-06-02T22:52:03.576270+0000","last_unstale":"2024-06-02T22:52:09.867282+0000","last_undegraded":"2024-06-02T22:52:09.867282+0000","last_fullsized":"2024-06-02T22:52:09.867282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:18:18.561237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608375+0000","last_change":"2024-06-02T22:52:07.602568+0000","last_active":"2024-06-02T22:52:08.608375+0000","last_peered":"2024-06-02T22:52:08.608375+0000","last_clean":"2024-06-02T22:52:08.608375+0000","last_became_active":"2024-06-02T22:52:07.602120+0000","last_became_peered":"2024-06-02T22:52:07.602120+0000","last_unstale":"2024-06-02T22:52:08.608375+0000","last_undegraded":"2024-06-02T22:52:08.608375+0000","last_fullsized":"2024-06-02T22:52:08.608375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:47.081866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366155+0000","last_change":"2024-06-02T22:52:02.571940+0000","last_active":"2024-06-02T22:52:09.366155+0000","last_peered":"2024-06-02T22:52:09.366155+0000","last_clean":"2024-06-02T22:52:09.366155+0000","last_became_active":"2024-06-02T22:52:02.571659+0000","last_became_peered":"2024-06-02T22:52:02.571659+0000","last_unstale":"2024-06-02T22:52:09.366155+0000","last_undegraded":"2024-06-02T22:52:09.366155+0000","last_fullsized":"2024-06-02T22:52:09.366155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:38:20.818313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866687+0000","last_change":"2024-06-02T22:52:03.585947+0000","last_active":"2024-06-02T22:52:09.866687+0000","last_peered":"2024-06-02T22:52:09.866687+0000","last_clean":"2024-06-02T22:52:09.866687+0000","last_became_active":"2024-06-02T22:52:03.585500+0000","last_became_peered":"2024-06-02T22:52:03.585500+0000","last_unstale":"2024-06-02T22:52:09.866687+0000","last_undegraded":"2024-06-02T22:52:09.866687+0000","last_fullsized":"2024-06-02T22:52:09.866687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609695+0000","last_change":"2024-06-02T22:52:07.601710+0000","last_active":"2024-06-02T22:52:08.609695+0000","last_peered":"2024-06-02T22:52:08.609695+0000","last_clean":"2024-06-02T22:52:08.609695+0000","last_became_active":"2024-06-02T22:52:07.601102+0000","last_became_peered":"2024-06-02T22:52:07.601102+0000","last_unstale":"2024-06-02T22:52:08.609695+0000","last_undegraded":"2024-06-02T22:52:08.609695+0000","last_fullsized":"2024-06-02T22:52:08.609695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365966+0000","last_change":"2024-06-02T22:52:02.571116+0000","last_active":"2024-06-02T22:52:09.365966+0000","last_peered":"2024-06-02T22:52:09.365966+0000","last_clean":"2024-06-02T22:52:09.365966+0000","last_became_active":"2024-06-02T22:52:02.570844+0000","last_became_peered":"2024-06-02T22:52:02.570844+0000","last_unstale":"2024-06-02T22:52:09.365966+0000","last_undegraded":"2024-06-02T22:52:09.365966+0000","last_fullsized":"2024-06-02T22:52:09.365966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:29.459302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866964+0000","last_change":"2024-06-02T22:52:03.586616+0000","last_active":"2024-06-02T22:52:09.866964+0000","last_peered":"2024-06-02T22:52:09.866964+0000","last_clean":"2024-06-02T22:52:09.866964+0000","last_became_active":"2024-06-02T22:52:03.586329+0000","last_became_peered":"2024-06-02T22:52:03.586329+0000","last_unstale":"2024-06-02T22:52:09.866964+0000","last_undegraded":"2024-06-02T22:52:09.866964+0000","last_fullsized":"2024-06-02T22:52:09.866964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:53.784824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608637+0000","last_change":"2024-06-02T22:52:07.601892+0000","last_active":"2024-06-02T22:52:08.608637+0000","last_peered":"2024-06-02T22:52:08.608637+0000","last_clean":"2024-06-02T22:52:08.608637+0000","last_became_active":"2024-06-02T22:52:07.601456+0000","last_became_peered":"2024-06-02T22:52:07.601456+0000","last_unstale":"2024-06-02T22:52:08.608637+0000","last_undegraded":"2024-06-02T22:52:08.608637+0000","last_fullsized":"2024-06-02T22:52:08.608637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:36.100904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609102+0000","last_change":"2024-06-02T22:52:03.565750+0000","last_active":"2024-06-02T22:52:08.609102+0000","last_peered":"2024-06-02T22:52:08.609102+0000","last_clean":"2024-06-02T22:52:08.609102+0000","last_became_active":"2024-06-02T22:52:03.565467+0000","last_became_peered":"2024-06-02T22:52:03.565467+0000","last_unstale":"2024-06-02T22:52:08.609102+0000","last_undegraded":"2024-06-02T22:52:08.609102+0000","last_fullsized":"2024-06-02T22:52:08.609102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365983+0000","last_change":"2024-06-02T22:52:02.570379+0000","last_active":"2024-06-02T22:52:09.365983+0000","last_peered":"2024-06-02T22:52:09.365983+0000","last_clean":"2024-06-02T22:52:09.365983+0000","last_became_active":"2024-06-02T22:52:02.570030+0000","last_became_peered":"2024-06-02T22:52:02.570030+0000","last_unstale":"2024-06-02T22:52:09.365983+0000","last_undegraded":"2024-06-02T22:52:09.365983+0000","last_fullsized":"2024-06-02T22:52:09.365983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:22.565230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609584+0000","last_change":"2024-06-02T22:52:07.595784+0000","last_active":"2024-06-02T22:52:08.609584+0000","last_peered":"2024-06-02T22:52:08.609584+0000","last_clean":"2024-06-02T22:52:08.609584+0000","last_became_active":"2024-06-02T22:52:07.595380+0000","last_became_peered":"2024-06-02T22:52:07.595380+0000","last_unstale":"2024-06-02T22:52:08.609584+0000","last_undegraded":"2024-06-02T22:52:08.609584+0000","last_fullsized":"2024-06-02T22:52:08.609584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:58.268207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802173+0000","last_change":"2024-06-02T22:52:03.576639+0000","last_active":"2024-06-02T22:52:09.802173+0000","last_peered":"2024-06-02T22:52:09.802173+0000","last_clean":"2024-06-02T22:52:09.802173+0000","last_became_active":"2024-06-02T22:52:03.576309+0000","last_became_peered":"2024-06-02T22:52:03.576309+0000","last_unstale":"2024-06-02T22:52:09.802173+0000","last_undegraded":"2024-06-02T22:52:09.802173+0000","last_fullsized":"2024-06-02T22:52:09.802173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:12.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867086+0000","last_change":"2024-06-02T22:52:02.571697+0000","last_active":"2024-06-02T22:52:09.867086+0000","last_peered":"2024-06-02T22:52:09.867086+0000","last_clean":"2024-06-02T22:52:09.867086+0000","last_became_active":"2024-06-02T22:52:02.571334+0000","last_became_peered":"2024-06-02T22:52:02.571334+0000","last_unstale":"2024-06-02T22:52:09.867086+0000","last_undegraded":"2024-06-02T22:52:09.867086+0000","last_fullsized":"2024-06-02T22:52:09.867086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608904+0000","last_change":"2024-06-02T22:52:07.602282+0000","last_active":"2024-06-02T22:52:08.608904+0000","last_peered":"2024-06-02T22:52:08.608904+0000","last_clean":"2024-06-02T22:52:08.608904+0000","last_became_active":"2024-06-02T22:52:07.601727+0000","last_became_peered":"2024-06-02T22:52:07.601727+0000","last_unstale":"2024-06-02T22:52:08.608904+0000","last_undegraded":"2024-06-02T22:52:08.608904+0000","last_fullsized":"2024-06-02T22:52:08.608904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:16.624490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802324+0000","last_change":"2024-06-02T22:52:03.581537+0000","last_active":"2024-06-02T22:52:09.802324+0000","last_peered":"2024-06-02T22:52:09.802324+0000","last_clean":"2024-06-02T22:52:09.802324+0000","last_became_active":"2024-06-02T22:52:03.581246+0000","last_became_peered":"2024-06-02T22:52:03.581246+0000","last_unstale":"2024-06-02T22:52:09.802324+0000","last_undegraded":"2024-06-02T22:52:09.802324+0000","last_fullsized":"2024-06-02T22:52:09.802324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866507+0000","last_change":"2024-06-02T22:52:02.572402+0000","last_active":"2024-06-02T22:52:09.866507+0000","last_peered":"2024-06-02T22:52:09.866507+0000","last_clean":"2024-06-02T22:52:09.866507+0000","last_became_active":"2024-06-02T22:52:02.572115+0000","last_became_peered":"2024-06-02T22:52:02.572115+0000","last_unstale":"2024-06-02T22:52:09.866507+0000","last_undegraded":"2024-06-02T22:52:09.866507+0000","last_fullsized":"2024-06-02T22:52:09.866507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866967+0000","last_change":"2024-06-02T22:52:07.612631+0000","last_active":"2024-06-02T22:52:09.866967+0000","last_peered":"2024-06-02T22:52:09.866967+0000","last_clean":"2024-06-02T22:52:09.866967+0000","last_became_active":"2024-06-02T22:52:07.612232+0000","last_became_peered":"2024-06-02T22:52:07.612232+0000","last_unstale":"2024-06-02T22:52:09.866967+0000","last_undegraded":"2024-06-02T22:52:09.866967+0000","last_fullsized":"2024-06-02T22:52:09.866967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:06.782146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609382+0000","last_change":"2024-06-02T22:52:03.572261+0000","last_active":"2024-06-02T22:52:08.609382+0000","last_peered":"2024-06-02T22:52:08.609382+0000","last_clean":"2024-06-02T22:52:08.609382+0000","last_became_active":"2024-06-02T22:52:03.571880+0000","last_became_peered":"2024-06-02T22:52:03.571880+0000","last_unstale":"2024-06-02T22:52:08.609382+0000","last_undegraded":"2024-06-02T22:52:08.609382+0000","last_fullsized":"2024-06-02T22:52:08.609382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:12.138755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365549+0000","last_change":"2024-06-02T22:52:02.577529+0000","last_active":"2024-06-02T22:52:09.365549+0000","last_peered":"2024-06-02T22:52:09.365549+0000","last_clean":"2024-06-02T22:52:09.365549+0000","last_became_active":"2024-06-02T22:52:02.577284+0000","last_became_peered":"2024-06-02T22:52:02.577284+0000","last_unstale":"2024-06-02T22:52:09.365549+0000","last_undegraded":"2024-06-02T22:52:09.365549+0000","last_fullsized":"2024-06-02T22:52:09.365549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608462+0000","last_change":"2024-06-02T22:52:07.602336+0000","last_active":"2024-06-02T22:52:08.608462+0000","last_peered":"2024-06-02T22:52:08.608462+0000","last_clean":"2024-06-02T22:52:08.608462+0000","last_became_active":"2024-06-02T22:52:07.601622+0000","last_became_peered":"2024-06-02T22:52:07.601622+0000","last_unstale":"2024-06-02T22:52:08.608462+0000","last_undegraded":"2024-06-02T22:52:08.608462+0000","last_fullsized":"2024-06-02T22:52:08.608462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:51.634356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867716+0000","last_change":"2024-06-02T22:52:03.572653+0000","last_active":"2024-06-02T22:52:09.867716+0000","last_peered":"2024-06-02T22:52:09.867716+0000","last_clean":"2024-06-02T22:52:09.867716+0000","last_became_active":"2024-06-02T22:52:03.570668+0000","last_became_peered":"2024-06-02T22:52:03.570668+0000","last_unstale":"2024-06-02T22:52:09.867716+0000","last_undegraded":"2024-06-02T22:52:09.867716+0000","last_fullsized":"2024-06-02T22:52:09.867716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609605+0000","last_change":"2024-06-02T22:52:02.567590+0000","last_active":"2024-06-02T22:52:08.609605+0000","last_peered":"2024-06-02T22:52:08.609605+0000","last_clean":"2024-06-02T22:52:08.609605+0000","last_became_active":"2024-06-02T22:52:02.567282+0000","last_became_peered":"2024-06-02T22:52:02.567282+0000","last_unstale":"2024-06-02T22:52:08.609605+0000","last_undegraded":"2024-06-02T22:52:08.609605+0000","last_fullsized":"2024-06-02T22:52:08.609605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609106+0000","last_change":"2024-06-02T22:52:07.612665+0000","last_active":"2024-06-02T22:52:08.609106+0000","last_peered":"2024-06-02T22:52:08.609106+0000","last_clean":"2024-06-02T22:52:08.609106+0000","last_became_active":"2024-06-02T22:52:07.612285+0000","last_became_peered":"2024-06-02T22:52:07.612285+0000","last_unstale":"2024-06-02T22:52:08.609106+0000","last_undegraded":"2024-06-02T22:52:08.609106+0000","last_fullsized":"2024-06-02T22:52:08.609106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:16.674095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802607+0000","last_change":"2024-06-02T22:52:03.582904+0000","last_active":"2024-06-02T22:52:09.802607+0000","last_peered":"2024-06-02T22:52:09.802607+0000","last_clean":"2024-06-02T22:52:09.802607+0000","last_became_active":"2024-06-02T22:52:03.582518+0000","last_became_peered":"2024-06-02T22:52:03.582518+0000","last_unstale":"2024-06-02T22:52:09.802607+0000","last_undegraded":"2024-06-02T22:52:09.802607+0000","last_fullsized":"2024-06-02T22:52:09.802607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866796+0000","last_change":"2024-06-02T22:52:02.573748+0000","last_active":"2024-06-02T22:52:09.866796+0000","last_peered":"2024-06-02T22:52:09.866796+0000","last_clean":"2024-06-02T22:52:09.866796+0000","last_became_active":"2024-06-02T22:52:02.573176+0000","last_became_peered":"2024-06-02T22:52:02.573176+0000","last_unstale":"2024-06-02T22:52:09.866796+0000","last_undegraded":"2024-06-02T22:52:09.866796+0000","last_fullsized":"2024-06-02T22:52:09.866796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801791+0000","last_change":"2024-06-02T22:52:07.616184+0000","last_active":"2024-06-02T22:52:09.801791+0000","last_peered":"2024-06-02T22:52:09.801791+0000","last_clean":"2024-06-02T22:52:09.801791+0000","last_became_active":"2024-06-02T22:52:07.615819+0000","last_became_peered":"2024-06-02T22:52:07.615819+0000","last_unstale":"2024-06-02T22:52:09.801791+0000","last_undegraded":"2024-06-02T22:52:09.801791+0000","last_fullsized":"2024-06-02T22:52:09.801791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:19.408730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867127+0000","last_change":"2024-06-02T22:52:03.569758+0000","last_active":"2024-06-02T22:52:09.867127+0000","last_peered":"2024-06-02T22:52:09.867127+0000","last_clean":"2024-06-02T22:52:09.867127+0000","last_became_active":"2024-06-02T22:52:03.569452+0000","last_became_peered":"2024-06-02T22:52:03.569452+0000","last_unstale":"2024-06-02T22:52:09.867127+0000","last_undegraded":"2024-06-02T22:52:09.867127+0000","last_fullsized":"2024-06-02T22:52:09.867127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366261+0000","last_change":"2024-06-02T22:52:02.580385+0000","last_active":"2024-06-02T22:52:09.366261+0000","last_peered":"2024-06-02T22:52:09.366261+0000","last_clean":"2024-06-02T22:52:09.366261+0000","last_became_active":"2024-06-02T22:52:02.580155+0000","last_became_peered":"2024-06-02T22:52:02.580155+0000","last_unstale":"2024-06-02T22:52:09.366261+0000","last_undegraded":"2024-06-02T22:52:09.366261+0000","last_fullsized":"2024-06-02T22:52:09.366261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:13:02.259557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866547+0000","last_change":"2024-06-02T22:52:07.613087+0000","last_active":"2024-06-02T22:52:09.866547+0000","last_peered":"2024-06-02T22:52:09.866547+0000","last_clean":"2024-06-02T22:52:09.866547+0000","last_became_active":"2024-06-02T22:52:07.612654+0000","last_became_peered":"2024-06-02T22:52:07.612654+0000","last_unstale":"2024-06-02T22:52:09.866547+0000","last_undegraded":"2024-06-02T22:52:09.866547+0000","last_fullsized":"2024-06-02T22:52:09.866547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867078+0000","last_change":"2024-06-02T22:52:03.582326+0000","last_active":"2024-06-02T22:52:09.867078+0000","last_peered":"2024-06-02T22:52:09.867078+0000","last_clean":"2024-06-02T22:52:09.867078+0000","last_became_active":"2024-06-02T22:52:03.581989+0000","last_became_peered":"2024-06-02T22:52:03.581989+0000","last_unstale":"2024-06-02T22:52:09.867078+0000","last_undegraded":"2024-06-02T22:52:09.867078+0000","last_fullsized":"2024-06-02T22:52:09.867078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:32.545502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867218+0000","last_change":"2024-06-02T22:52:02.574632+0000","last_active":"2024-06-02T22:52:09.867218+0000","last_peered":"2024-06-02T22:52:09.867218+0000","last_clean":"2024-06-02T22:52:09.867218+0000","last_became_active":"2024-06-02T22:52:02.573272+0000","last_became_peered":"2024-06-02T22:52:02.573272+0000","last_unstale":"2024-06-02T22:52:09.867218+0000","last_undegraded":"2024-06-02T22:52:09.867218+0000","last_fullsized":"2024-06-02T22:52:09.867218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:29.459302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866384+0000","last_change":"2024-06-02T22:52:07.598965+0000","last_active":"2024-06-02T22:52:09.866384+0000","last_peered":"2024-06-02T22:52:09.866384+0000","last_clean":"2024-06-02T22:52:09.866384+0000","last_became_active":"2024-06-02T22:52:07.597987+0000","last_became_peered":"2024-06-02T22:52:07.597987+0000","last_unstale":"2024-06-02T22:52:09.866384+0000","last_undegraded":"2024-06-02T22:52:09.866384+0000","last_fullsized":"2024-06-02T22:52:09.866384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609823+0000","last_change":"2024-06-02T22:52:03.566069+0000","last_active":"2024-06-02T22:52:08.609823+0000","last_peered":"2024-06-02T22:52:08.609823+0000","last_clean":"2024-06-02T22:52:08.609823+0000","last_became_active":"2024-06-02T22:52:03.565771+0000","last_became_peered":"2024-06-02T22:52:03.565771+0000","last_unstale":"2024-06-02T22:52:08.609823+0000","last_undegraded":"2024-06-02T22:52:08.609823+0000","last_fullsized":"2024-06-02T22:52:08.609823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:21.517626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866865+0000","last_change":"2024-06-02T22:52:02.568991+0000","last_active":"2024-06-02T22:52:09.866865+0000","last_peered":"2024-06-02T22:52:09.866865+0000","last_clean":"2024-06-02T22:52:09.866865+0000","last_became_active":"2024-06-02T22:52:02.568707+0000","last_became_peered":"2024-06-02T22:52:02.568707+0000","last_unstale":"2024-06-02T22:52:09.866865+0000","last_undegraded":"2024-06-02T22:52:09.866865+0000","last_fullsized":"2024-06-02T22:52:09.866865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867124+0000","last_change":"2024-06-02T22:52:07.599911+0000","last_active":"2024-06-02T22:52:09.867124+0000","last_peered":"2024-06-02T22:52:09.867124+0000","last_clean":"2024-06-02T22:52:09.867124+0000","last_became_active":"2024-06-02T22:52:07.599511+0000","last_became_peered":"2024-06-02T22:52:07.599511+0000","last_unstale":"2024-06-02T22:52:09.867124+0000","last_undegraded":"2024-06-02T22:52:09.867124+0000","last_fullsized":"2024-06-02T22:52:09.867124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:12.840435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867482+0000","last_change":"2024-06-02T22:52:03.569708+0000","last_active":"2024-06-02T22:52:09.867482+0000","last_peered":"2024-06-02T22:52:09.867482+0000","last_clean":"2024-06-02T22:52:09.867482+0000","last_became_active":"2024-06-02T22:52:03.568694+0000","last_became_peered":"2024-06-02T22:52:03.568694+0000","last_unstale":"2024-06-02T22:52:09.867482+0000","last_undegraded":"2024-06-02T22:52:09.867482+0000","last_fullsized":"2024-06-02T22:52:09.867482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610009+0000","last_change":"2024-06-02T22:52:02.567971+0000","last_active":"2024-06-02T22:52:08.610009+0000","last_peered":"2024-06-02T22:52:08.610009+0000","last_clean":"2024-06-02T22:52:08.610009+0000","last_became_active":"2024-06-02T22:52:02.567623+0000","last_became_peered":"2024-06-02T22:52:02.567623+0000","last_unstale":"2024-06-02T22:52:08.610009+0000","last_undegraded":"2024-06-02T22:52:08.610009+0000","last_fullsized":"2024-06-02T22:52:08.610009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866990+0000","last_change":"2024-06-02T22:52:07.602117+0000","last_active":"2024-06-02T22:52:09.866990+0000","last_peered":"2024-06-02T22:52:09.866990+0000","last_clean":"2024-06-02T22:52:09.866990+0000","last_became_active":"2024-06-02T22:52:07.599651+0000","last_became_peered":"2024-06-02T22:52:07.599651+0000","last_unstale":"2024-06-02T22:52:09.866990+0000","last_undegraded":"2024-06-02T22:52:09.866990+0000","last_fullsized":"2024-06-02T22:52:09.866990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:36.573360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866296+0000","last_change":"2024-06-02T22:52:03.563190+0000","last_active":"2024-06-02T22:52:09.866296+0000","last_peered":"2024-06-02T22:52:09.866296+0000","last_clean":"2024-06-02T22:52:09.866296+0000","last_became_active":"2024-06-02T22:52:03.562873+0000","last_became_peered":"2024-06-02T22:52:03.562873+0000","last_unstale":"2024-06-02T22:52:09.866296+0000","last_undegraded":"2024-06-02T22:52:09.866296+0000","last_fullsized":"2024-06-02T22:52:09.866296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:31.146827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365584+0000","last_change":"2024-06-02T22:52:02.570735+0000","last_active":"2024-06-02T22:52:09.365584+0000","last_peered":"2024-06-02T22:52:09.365584+0000","last_clean":"2024-06-02T22:52:09.365584+0000","last_became_active":"2024-06-02T22:52:02.570459+0000","last_became_peered":"2024-06-02T22:52:02.570459+0000","last_unstale":"2024-06-02T22:52:09.365584+0000","last_undegraded":"2024-06-02T22:52:09.365584+0000","last_fullsized":"2024-06-02T22:52:09.365584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867640+0000","last_change":"2024-06-02T22:52:07.612607+0000","last_active":"2024-06-02T22:52:09.867640+0000","last_peered":"2024-06-02T22:52:09.867640+0000","last_clean":"2024-06-02T22:52:09.867640+0000","last_became_active":"2024-06-02T22:52:07.612210+0000","last_became_peered":"2024-06-02T22:52:07.612210+0000","last_unstale":"2024-06-02T22:52:09.867640+0000","last_undegraded":"2024-06-02T22:52:09.867640+0000","last_fullsized":"2024-06-02T22:52:09.867640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:12.840435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802134+0000","last_change":"2024-06-02T22:52:03.581959+0000","last_active":"2024-06-02T22:52:09.802134+0000","last_peered":"2024-06-02T22:52:09.802134+0000","last_clean":"2024-06-02T22:52:09.802134+0000","last_became_active":"2024-06-02T22:52:03.581625+0000","last_became_peered":"2024-06-02T22:52:03.581625+0000","last_unstale":"2024-06-02T22:52:09.802134+0000","last_undegraded":"2024-06-02T22:52:09.802134+0000","last_fullsized":"2024-06-02T22:52:09.802134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866575+0000","last_change":"2024-06-02T22:52:02.565526+0000","last_active":"2024-06-02T22:52:09.866575+0000","last_peered":"2024-06-02T22:52:09.866575+0000","last_clean":"2024-06-02T22:52:09.866575+0000","last_became_active":"2024-06-02T22:52:02.565197+0000","last_became_peered":"2024-06-02T22:52:02.565197+0000","last_unstale":"2024-06-02T22:52:09.866575+0000","last_undegraded":"2024-06-02T22:52:09.866575+0000","last_fullsized":"2024-06-02T22:52:09.866575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365701+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:52:09.365701+0000","last_peered":"2024-06-02T22:52:09.365701+0000","last_clean":"2024-06-02T22:52:09.365701+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:52:09.365701+0000","last_undegraded":"2024-06-02T22:52:09.365701+0000","last_fullsized":"2024-06-02T22:52:09.365701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608822+0000","last_change":"2024-06-02T22:52:07.615952+0000","last_active":"2024-06-02T22:52:08.608822+0000","last_peered":"2024-06-02T22:52:08.608822+0000","last_clean":"2024-06-02T22:52:08.608822+0000","last_became_active":"2024-06-02T22:52:07.615538+0000","last_became_peered":"2024-06-02T22:52:07.615538+0000","last_unstale":"2024-06-02T22:52:08.608822+0000","last_undegraded":"2024-06-02T22:52:08.608822+0000","last_fullsized":"2024-06-02T22:52:08.608822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:11.213283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366025+0000","last_change":"2024-06-02T22:52:03.577819+0000","last_active":"2024-06-02T22:52:09.366025+0000","last_peered":"2024-06-02T22:52:09.366025+0000","last_clean":"2024-06-02T22:52:09.366025+0000","last_became_active":"2024-06-02T22:52:03.577525+0000","last_became_peered":"2024-06-02T22:52:03.577525+0000","last_unstale":"2024-06-02T22:52:09.366025+0000","last_undegraded":"2024-06-02T22:52:09.366025+0000","last_fullsized":"2024-06-02T22:52:09.366025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:02.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610185+0000","last_change":"2024-06-02T22:52:02.565482+0000","last_active":"2024-06-02T22:52:08.610185+0000","last_peered":"2024-06-02T22:52:08.610185+0000","last_clean":"2024-06-02T22:52:08.610185+0000","last_became_active":"2024-06-02T22:52:02.565172+0000","last_became_peered":"2024-06-02T22:52:02.565172+0000","last_unstale":"2024-06-02T22:52:08.610185+0000","last_undegraded":"2024-06-02T22:52:08.610185+0000","last_fullsized":"2024-06-02T22:52:08.610185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:37:05.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608322+0000","last_change":"2024-06-02T22:52:07.612701+0000","last_active":"2024-06-02T22:52:08.608322+0000","last_peered":"2024-06-02T22:52:08.608322+0000","last_clean":"2024-06-02T22:52:08.608322+0000","last_became_active":"2024-06-02T22:52:07.612260+0000","last_became_peered":"2024-06-02T22:52:07.612260+0000","last_unstale":"2024-06-02T22:52:08.608322+0000","last_undegraded":"2024-06-02T22:52:08.608322+0000","last_fullsized":"2024-06-02T22:52:08.608322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:47.081866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866731+0000","last_change":"2024-06-02T22:52:03.587460+0000","last_active":"2024-06-02T22:52:09.866731+0000","last_peered":"2024-06-02T22:52:09.866731+0000","last_clean":"2024-06-02T22:52:09.866731+0000","last_became_active":"2024-06-02T22:52:03.587183+0000","last_became_peered":"2024-06-02T22:52:03.587183+0000","last_unstale":"2024-06-02T22:52:09.866731+0000","last_undegraded":"2024-06-02T22:52:09.866731+0000","last_fullsized":"2024-06-02T22:52:09.866731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:43.054007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866861+0000","last_change":"2024-06-02T22:52:02.570822+0000","last_active":"2024-06-02T22:52:09.866861+0000","last_peered":"2024-06-02T22:52:09.866861+0000","last_clean":"2024-06-02T22:52:09.866861+0000","last_became_active":"2024-06-02T22:52:02.570425+0000","last_became_peered":"2024-06-02T22:52:02.570425+0000","last_unstale":"2024-06-02T22:52:09.866861+0000","last_undegraded":"2024-06-02T22:52:09.866861+0000","last_fullsized":"2024-06-02T22:52:09.866861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:22.565230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866793+0000","last_change":"2024-06-02T22:52:07.596605+0000","last_active":"2024-06-02T22:52:09.866793+0000","last_peered":"2024-06-02T22:52:09.866793+0000","last_clean":"2024-06-02T22:52:09.866793+0000","last_became_active":"2024-06-02T22:52:07.596062+0000","last_became_peered":"2024-06-02T22:52:07.596062+0000","last_unstale":"2024-06-02T22:52:09.866793+0000","last_undegraded":"2024-06-02T22:52:09.866793+0000","last_fullsized":"2024-06-02T22:52:09.866793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:57.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366406+0000","last_change":"2024-06-02T22:52:03.583665+0000","last_active":"2024-06-02T22:52:09.366406+0000","last_peered":"2024-06-02T22:52:09.366406+0000","last_clean":"2024-06-02T22:52:09.366406+0000","last_became_active":"2024-06-02T22:52:03.583405+0000","last_became_peered":"2024-06-02T22:52:03.583405+0000","last_unstale":"2024-06-02T22:52:09.366406+0000","last_undegraded":"2024-06-02T22:52:09.366406+0000","last_fullsized":"2024-06-02T22:52:09.366406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.055543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610318+0000","last_change":"2024-06-02T22:52:02.568513+0000","last_active":"2024-06-02T22:52:08.610318+0000","last_peered":"2024-06-02T22:52:08.610318+0000","last_clean":"2024-06-02T22:52:08.610318+0000","last_became_active":"2024-06-02T22:52:02.567653+0000","last_became_peered":"2024-06-02T22:52:02.567653+0000","last_unstale":"2024-06-02T22:52:08.610318+0000","last_undegraded":"2024-06-02T22:52:08.610318+0000","last_fullsized":"2024-06-02T22:52:08.610318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866292+0000","last_change":"2024-06-02T22:52:07.612655+0000","last_active":"2024-06-02T22:52:09.866292+0000","last_peered":"2024-06-02T22:52:09.866292+0000","last_clean":"2024-06-02T22:52:09.866292+0000","last_became_active":"2024-06-02T22:52:07.612255+0000","last_became_peered":"2024-06-02T22:52:07.612255+0000","last_unstale":"2024-06-02T22:52:09.866292+0000","last_undegraded":"2024-06-02T22:52:09.866292+0000","last_fullsized":"2024-06-02T22:52:09.866292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:19.408730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366212+0000","last_change":"2024-06-02T22:52:03.584406+0000","last_active":"2024-06-02T22:52:09.366212+0000","last_peered":"2024-06-02T22:52:09.366212+0000","last_clean":"2024-06-02T22:52:09.366212+0000","last_became_active":"2024-06-02T22:52:03.584128+0000","last_became_peered":"2024-06-02T22:52:03.584128+0000","last_unstale":"2024-06-02T22:52:09.366212+0000","last_undegraded":"2024-06-02T22:52:09.366212+0000","last_fullsized":"2024-06-02T22:52:09.366212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:02.241694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608660+0000","last_change":"2024-06-02T22:52:02.567072+0000","last_active":"2024-06-02T22:52:08.608660+0000","last_peered":"2024-06-02T22:52:08.608660+0000","last_clean":"2024-06-02T22:52:08.608660+0000","last_became_active":"2024-06-02T22:52:02.566757+0000","last_became_peered":"2024-06-02T22:52:02.566757+0000","last_unstale":"2024-06-02T22:52:08.608660+0000","last_undegraded":"2024-06-02T22:52:08.608660+0000","last_fullsized":"2024-06-02T22:52:08.608660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:57.107796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609128+0000","last_change":"2024-06-02T22:52:07.601781+0000","last_active":"2024-06-02T22:52:08.609128+0000","last_peered":"2024-06-02T22:52:08.609128+0000","last_clean":"2024-06-02T22:52:08.609128+0000","last_became_active":"2024-06-02T22:52:07.601121+0000","last_became_peered":"2024-06-02T22:52:07.601121+0000","last_unstale":"2024-06-02T22:52:08.609128+0000","last_undegraded":"2024-06-02T22:52:08.609128+0000","last_fullsized":"2024-06-02T22:52:08.609128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:40.819611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365745+0000","last_change":"2024-06-02T22:52:03.583571+0000","last_active":"2024-06-02T22:52:09.365745+0000","last_peered":"2024-06-02T22:52:09.365745+0000","last_clean":"2024-06-02T22:52:09.365745+0000","last_became_active":"2024-06-02T22:52:03.583035+0000","last_became_peered":"2024-06-02T22:52:03.583035+0000","last_unstale":"2024-06-02T22:52:09.365745+0000","last_undegraded":"2024-06-02T22:52:09.365745+0000","last_fullsized":"2024-06-02T22:52:09.365745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609832+0000","last_change":"2024-06-02T22:52:02.568253+0000","last_active":"2024-06-02T22:52:08.609832+0000","last_peered":"2024-06-02T22:52:08.609832+0000","last_clean":"2024-06-02T22:52:08.609832+0000","last_became_active":"2024-06-02T22:52:02.567725+0000","last_became_peered":"2024-06-02T22:52:02.567725+0000","last_unstale":"2024-06-02T22:52:08.609832+0000","last_undegraded":"2024-06-02T22:52:08.609832+0000","last_fullsized":"2024-06-02T22:52:08.609832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867536+0000","last_change":"2024-06-02T22:52:07.601097+0000","last_active":"2024-06-02T22:52:09.867536+0000","last_peered":"2024-06-02T22:52:09.867536+0000","last_clean":"2024-06-02T22:52:09.867536+0000","last_became_active":"2024-06-02T22:52:07.600696+0000","last_became_peered":"2024-06-02T22:52:07.600696+0000","last_unstale":"2024-06-02T22:52:09.867536+0000","last_undegraded":"2024-06-02T22:52:09.867536+0000","last_fullsized":"2024-06-02T22:52:09.867536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:36.573360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608536+0000","last_change":"2024-06-02T22:52:03.579404+0000","last_active":"2024-06-02T22:52:08.608536+0000","last_peered":"2024-06-02T22:52:08.608536+0000","last_clean":"2024-06-02T22:52:08.608536+0000","last_became_active":"2024-06-02T22:52:03.579057+0000","last_became_peered":"2024-06-02T22:52:03.579057+0000","last_unstale":"2024-06-02T22:52:08.608536+0000","last_undegraded":"2024-06-02T22:52:08.608536+0000","last_fullsized":"2024-06-02T22:52:08.608536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609446+0000","last_change":"2024-06-02T22:52:02.566374+0000","last_active":"2024-06-02T22:52:08.609446+0000","last_peered":"2024-06-02T22:52:08.609446+0000","last_clean":"2024-06-02T22:52:08.609446+0000","last_became_active":"2024-06-02T22:52:02.566091+0000","last_became_peered":"2024-06-02T22:52:02.566091+0000","last_unstale":"2024-06-02T22:52:08.609446+0000","last_undegraded":"2024-06-02T22:52:08.609446+0000","last_fullsized":"2024-06-02T22:52:08.609446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802585+0000","last_change":"2024-06-02T22:52:07.615876+0000","last_active":"2024-06-02T22:52:09.802585+0000","last_peered":"2024-06-02T22:52:09.802585+0000","last_clean":"2024-06-02T22:52:09.802585+0000","last_became_active":"2024-06-02T22:52:07.615423+0000","last_became_peered":"2024-06-02T22:52:07.615423+0000","last_unstale":"2024-06-02T22:52:09.802585+0000","last_undegraded":"2024-06-02T22:52:09.802585+0000","last_fullsized":"2024-06-02T22:52:09.802585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:20:08.691545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365895+0000","last_change":"2024-06-02T22:52:03.579077+0000","last_active":"2024-06-02T22:52:09.365895+0000","last_peered":"2024-06-02T22:52:09.365895+0000","last_clean":"2024-06-02T22:52:09.365895+0000","last_became_active":"2024-06-02T22:52:03.578126+0000","last_became_peered":"2024-06-02T22:52:03.578126+0000","last_unstale":"2024-06-02T22:52:09.365895+0000","last_undegraded":"2024-06-02T22:52:09.365895+0000","last_fullsized":"2024-06-02T22:52:09.365895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:43.054007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866722+0000","last_change":"2024-06-02T22:52:02.570439+0000","last_active":"2024-06-02T22:52:09.866722+0000","last_peered":"2024-06-02T22:52:09.866722+0000","last_clean":"2024-06-02T22:52:09.866722+0000","last_became_active":"2024-06-02T22:52:02.569937+0000","last_became_peered":"2024-06-02T22:52:02.569937+0000","last_unstale":"2024-06-02T22:52:09.866722+0000","last_undegraded":"2024-06-02T22:52:09.866722+0000","last_fullsized":"2024-06-02T22:52:09.866722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802494+0000","last_change":"2024-06-02T22:52:07.612603+0000","last_active":"2024-06-02T22:52:09.802494+0000","last_peered":"2024-06-02T22:52:09.802494+0000","last_clean":"2024-06-02T22:52:09.802494+0000","last_became_active":"2024-06-02T22:52:07.612214+0000","last_became_peered":"2024-06-02T22:52:07.612214+0000","last_unstale":"2024-06-02T22:52:09.802494+0000","last_undegraded":"2024-06-02T22:52:09.802494+0000","last_fullsized":"2024-06-02T22:52:09.802494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:20:19.247700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867054+0000","last_change":"2024-06-02T22:52:03.579566+0000","last_active":"2024-06-02T22:52:09.867054+0000","last_peered":"2024-06-02T22:52:09.867054+0000","last_clean":"2024-06-02T22:52:09.867054+0000","last_became_active":"2024-06-02T22:52:03.579295+0000","last_became_peered":"2024-06-02T22:52:03.579295+0000","last_unstale":"2024-06-02T22:52:09.867054+0000","last_undegraded":"2024-06-02T22:52:09.867054+0000","last_fullsized":"2024-06-02T22:52:09.867054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867327+0000","last_change":"2024-06-02T22:52:02.563970+0000","last_active":"2024-06-02T22:52:09.867327+0000","last_peered":"2024-06-02T22:52:09.867327+0000","last_clean":"2024-06-02T22:52:09.867327+0000","last_became_active":"2024-06-02T22:52:02.563675+0000","last_became_peered":"2024-06-02T22:52:02.563675+0000","last_unstale":"2024-06-02T22:52:09.867327+0000","last_undegraded":"2024-06-02T22:52:09.867327+0000","last_fullsized":"2024-06-02T22:52:09.867327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:31.842742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866976+0000","last_change":"2024-06-02T22:52:07.615973+0000","last_active":"2024-06-02T22:52:09.866976+0000","last_peered":"2024-06-02T22:52:09.866976+0000","last_clean":"2024-06-02T22:52:09.866976+0000","last_became_active":"2024-06-02T22:52:07.615586+0000","last_became_peered":"2024-06-02T22:52:07.615586+0000","last_unstale":"2024-06-02T22:52:09.866976+0000","last_undegraded":"2024-06-02T22:52:09.866976+0000","last_fullsized":"2024-06-02T22:52:09.866976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:27:30.054564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365923+0000","last_change":"2024-06-02T22:52:03.584686+0000","last_active":"2024-06-02T22:52:09.365923+0000","last_peered":"2024-06-02T22:52:09.365923+0000","last_clean":"2024-06-02T22:52:09.365923+0000","last_became_active":"2024-06-02T22:52:03.584398+0000","last_became_peered":"2024-06-02T22:52:03.584398+0000","last_unstale":"2024-06-02T22:52:09.365923+0000","last_undegraded":"2024-06-02T22:52:09.365923+0000","last_fullsized":"2024-06-02T22:52:09.365923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:07.185424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:12.944886+0000","last_change":"2024-06-02T22:52:02.568278+0000","last_active":"2024-06-02T22:52:12.944886+0000","last_peered":"2024-06-02T22:52:12.944886+0000","last_clean":"2024-06-02T22:52:12.944886+0000","last_became_active":"2024-06-02T22:52:02.567915+0000","last_became_peered":"2024-06-02T22:52:02.567915+0000","last_unstale":"2024-06-02T22:52:12.944886+0000","last_undegraded":"2024-06-02T22:52:12.944886+0000","last_fullsized":"2024-06-02T22:52:12.944886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866737+0000","last_change":"2024-06-02T22:52:07.596273+0000","last_active":"2024-06-02T22:52:09.866737+0000","last_peered":"2024-06-02T22:52:09.866737+0000","last_clean":"2024-06-02T22:52:09.866737+0000","last_became_active":"2024-06-02T22:52:07.595893+0000","last_became_peered":"2024-06-02T22:52:07.595893+0000","last_unstale":"2024-06-02T22:52:09.866737+0000","last_undegraded":"2024-06-02T22:52:09.866737+0000","last_fullsized":"2024-06-02T22:52:09.866737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:57.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609245+0000","last_change":"2024-06-02T22:52:03.576403+0000","last_active":"2024-06-02T22:52:08.609245+0000","last_peered":"2024-06-02T22:52:08.609245+0000","last_clean":"2024-06-02T22:52:08.609245+0000","last_became_active":"2024-06-02T22:52:03.574665+0000","last_became_peered":"2024-06-02T22:52:03.574665+0000","last_unstale":"2024-06-02T22:52:08.609245+0000","last_undegraded":"2024-06-02T22:52:08.609245+0000","last_fullsized":"2024-06-02T22:52:08.609245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:30.466832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866748+0000","last_change":"2024-06-02T22:52:02.572661+0000","last_active":"2024-06-02T22:52:09.866748+0000","last_peered":"2024-06-02T22:52:09.866748+0000","last_clean":"2024-06-02T22:52:09.866748+0000","last_became_active":"2024-06-02T22:52:02.571128+0000","last_became_peered":"2024-06-02T22:52:02.571128+0000","last_unstale":"2024-06-02T22:52:09.866748+0000","last_undegraded":"2024-06-02T22:52:09.866748+0000","last_fullsized":"2024-06-02T22:52:09.866748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609673+0000","last_change":"2024-06-02T22:52:07.595758+0000","last_active":"2024-06-02T22:52:08.609673+0000","last_peered":"2024-06-02T22:52:08.609673+0000","last_clean":"2024-06-02T22:52:08.609673+0000","last_became_active":"2024-06-02T22:52:07.595359+0000","last_became_peered":"2024-06-02T22:52:07.595359+0000","last_unstale":"2024-06-02T22:52:08.609673+0000","last_undegraded":"2024-06-02T22:52:08.609673+0000","last_fullsized":"2024-06-02T22:52:08.609673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:11.213283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867361+0000","last_change":"2024-06-02T22:52:03.575977+0000","last_active":"2024-06-02T22:52:09.867361+0000","last_peered":"2024-06-02T22:52:09.867361+0000","last_clean":"2024-06-02T22:52:09.867361+0000","last_became_active":"2024-06-02T22:52:03.575690+0000","last_became_peered":"2024-06-02T22:52:03.575690+0000","last_unstale":"2024-06-02T22:52:09.867361+0000","last_undegraded":"2024-06-02T22:52:09.867361+0000","last_fullsized":"2024-06-02T22:52:09.867361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866849+0000","last_change":"2024-06-02T22:52:02.571504+0000","last_active":"2024-06-02T22:52:09.866849+0000","last_peered":"2024-06-02T22:52:09.866849+0000","last_clean":"2024-06-02T22:52:09.866849+0000","last_became_active":"2024-06-02T22:52:02.571227+0000","last_became_peered":"2024-06-02T22:52:02.571227+0000","last_unstale":"2024-06-02T22:52:09.866849+0000","last_undegraded":"2024-06-02T22:52:09.866849+0000","last_fullsized":"2024-06-02T22:52:09.866849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801961+0000","last_change":"2024-06-02T22:52:07.599829+0000","last_active":"2024-06-02T22:52:09.801961+0000","last_peered":"2024-06-02T22:52:09.801961+0000","last_clean":"2024-06-02T22:52:09.801961+0000","last_became_active":"2024-06-02T22:52:07.599407+0000","last_became_peered":"2024-06-02T22:52:07.599407+0000","last_unstale":"2024-06-02T22:52:09.801961+0000","last_undegraded":"2024-06-02T22:52:09.801961+0000","last_fullsized":"2024-06-02T22:52:09.801961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:33:49.412166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866795+0000","last_change":"2024-06-02T22:52:03.585466+0000","last_active":"2024-06-02T22:52:09.866795+0000","last_peered":"2024-06-02T22:52:09.866795+0000","last_clean":"2024-06-02T22:52:09.866795+0000","last_became_active":"2024-06-02T22:52:03.584977+0000","last_became_peered":"2024-06-02T22:52:03.584977+0000","last_unstale":"2024-06-02T22:52:09.866795+0000","last_undegraded":"2024-06-02T22:52:09.866795+0000","last_fullsized":"2024-06-02T22:52:09.866795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:07.185424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609512+0000","last_change":"2024-06-02T22:52:02.566185+0000","last_active":"2024-06-02T22:52:08.609512+0000","last_peered":"2024-06-02T22:52:08.609512+0000","last_clean":"2024-06-02T22:52:08.609512+0000","last_became_active":"2024-06-02T22:52:02.565884+0000","last_became_peered":"2024-06-02T22:52:02.565884+0000","last_unstale":"2024-06-02T22:52:08.609512+0000","last_undegraded":"2024-06-02T22:52:08.609512+0000","last_fullsized":"2024-06-02T22:52:08.609512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801946+0000","last_change":"2024-06-02T22:52:07.613267+0000","last_active":"2024-06-02T22:52:09.801946+0000","last_peered":"2024-06-02T22:52:09.801946+0000","last_clean":"2024-06-02T22:52:09.801946+0000","last_became_active":"2024-06-02T22:52:07.612830+0000","last_became_peered":"2024-06-02T22:52:07.612830+0000","last_unstale":"2024-06-02T22:52:09.801946+0000","last_undegraded":"2024-06-02T22:52:09.801946+0000","last_fullsized":"2024-06-02T22:52:09.801946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:08:51.327311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867496+0000","last_change":"2024-06-02T22:52:07.615985+0000","last_active":"2024-06-02T22:52:09.867496+0000","last_peered":"2024-06-02T22:52:09.867496+0000","last_clean":"2024-06-02T22:52:09.867496+0000","last_became_active":"2024-06-02T22:52:07.615499+0000","last_became_peered":"2024-06-02T22:52:07.615499+0000","last_unstale":"2024-06-02T22:52:09.867496+0000","last_undegraded":"2024-06-02T22:52:09.867496+0000","last_fullsized":"2024-06-02T22:52:09.867496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:06.782146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866321+0000","last_change":"2024-06-02T22:52:03.582276+0000","last_active":"2024-06-02T22:52:09.866321+0000","last_peered":"2024-06-02T22:52:09.866321+0000","last_clean":"2024-06-02T22:52:09.866321+0000","last_became_active":"2024-06-02T22:52:03.582024+0000","last_became_peered":"2024-06-02T22:52:03.582024+0000","last_unstale":"2024-06-02T22:52:09.866321+0000","last_undegraded":"2024-06-02T22:52:09.866321+0000","last_fullsized":"2024-06-02T22:52:09.866321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866520+0000","last_change":"2024-06-02T22:52:02.566673+0000","last_active":"2024-06-02T22:52:09.866520+0000","last_peered":"2024-06-02T22:52:09.866520+0000","last_clean":"2024-06-02T22:52:09.866520+0000","last_became_active":"2024-06-02T22:52:02.566382+0000","last_became_peered":"2024-06-02T22:52:02.566382+0000","last_unstale":"2024-06-02T22:52:09.866520+0000","last_undegraded":"2024-06-02T22:52:09.866520+0000","last_fullsized":"2024-06-02T22:52:09.866520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609482+0000","last_change":"2024-06-02T22:52:07.595868+0000","last_active":"2024-06-02T22:52:08.609482+0000","last_peered":"2024-06-02T22:52:08.609482+0000","last_clean":"2024-06-02T22:52:08.609482+0000","last_became_active":"2024-06-02T22:52:07.595443+0000","last_became_peered":"2024-06-02T22:52:07.595443+0000","last_unstale":"2024-06-02T22:52:08.609482+0000","last_undegraded":"2024-06-02T22:52:08.609482+0000","last_fullsized":"2024-06-02T22:52:08.609482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801957+0000","last_change":"2024-06-02T22:52:03.577756+0000","last_active":"2024-06-02T22:52:09.801957+0000","last_peered":"2024-06-02T22:52:09.801957+0000","last_clean":"2024-06-02T22:52:09.801957+0000","last_became_active":"2024-06-02T22:52:03.577464+0000","last_became_peered":"2024-06-02T22:52:03.577464+0000","last_unstale":"2024-06-02T22:52:09.801957+0000","last_undegraded":"2024-06-02T22:52:09.801957+0000","last_fullsized":"2024-06-02T22:52:09.801957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802322+0000","last_change":"2024-06-02T22:52:02.573076+0000","last_active":"2024-06-02T22:52:09.802322+0000","last_peered":"2024-06-02T22:52:09.802322+0000","last_clean":"2024-06-02T22:52:09.802322+0000","last_became_active":"2024-06-02T22:52:02.572774+0000","last_became_peered":"2024-06-02T22:52:02.572774+0000","last_unstale":"2024-06-02T22:52:09.802322+0000","last_undegraded":"2024-06-02T22:52:09.802322+0000","last_fullsized":"2024-06-02T22:52:09.802322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:37:05.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609292+0000","last_change":"2024-06-02T22:52:02.567544+0000","last_active":"2024-06-02T22:52:08.609292+0000","last_peered":"2024-06-02T22:52:08.609292+0000","last_clean":"2024-06-02T22:52:08.609292+0000","last_became_active":"2024-06-02T22:52:02.566808+0000","last_became_peered":"2024-06-02T22:52:02.566808+0000","last_unstale":"2024-06-02T22:52:08.609292+0000","last_undegraded":"2024-06-02T22:52:08.609292+0000","last_fullsized":"2024-06-02T22:52:08.609292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867244+0000","last_change":"2024-06-02T22:52:03.562967+0000","last_active":"2024-06-02T22:52:09.867244+0000","last_peered":"2024-06-02T22:52:09.867244+0000","last_clean":"2024-06-02T22:52:09.867244+0000","last_became_active":"2024-06-02T22:52:03.562081+0000","last_became_peered":"2024-06-02T22:52:03.562081+0000","last_unstale":"2024-06-02T22:52:09.867244+0000","last_undegraded":"2024-06-02T22:52:09.867244+0000","last_fullsized":"2024-06-02T22:52:09.867244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610074+0000","last_change":"2024-06-02T22:52:07.601119+0000","last_active":"2024-06-02T22:52:08.610074+0000","last_peered":"2024-06-02T22:52:08.610074+0000","last_clean":"2024-06-02T22:52:08.610074+0000","last_became_active":"2024-06-02T22:52:07.600750+0000","last_became_peered":"2024-06-02T22:52:07.600750+0000","last_unstale":"2024-06-02T22:52:08.610074+0000","last_undegraded":"2024-06-02T22:52:08.610074+0000","last_fullsized":"2024-06-02T22:52:08.610074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:35.174685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802437+0000","last_change":"2024-06-02T22:52:02.571567+0000","last_active":"2024-06-02T22:52:09.802437+0000","last_peered":"2024-06-02T22:52:09.802437+0000","last_clean":"2024-06-02T22:52:09.802437+0000","last_became_active":"2024-06-02T22:52:02.571287+0000","last_became_peered":"2024-06-02T22:52:02.571287+0000","last_unstale":"2024-06-02T22:52:09.802437+0000","last_undegraded":"2024-06-02T22:52:09.802437+0000","last_fullsized":"2024-06-02T22:52:09.802437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:31:16.566686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608886+0000","last_change":"2024-06-02T22:52:03.570359+0000","last_active":"2024-06-02T22:52:08.608886+0000","last_peered":"2024-06-02T22:52:08.608886+0000","last_clean":"2024-06-02T22:52:08.608886+0000","last_became_active":"2024-06-02T22:52:03.570078+0000","last_became_peered":"2024-06-02T22:52:03.570078+0000","last_unstale":"2024-06-02T22:52:08.608886+0000","last_undegraded":"2024-06-02T22:52:08.608886+0000","last_fullsized":"2024-06-02T22:52:08.608886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:23.572760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802391+0000","last_change":"2024-06-02T22:52:07.599308+0000","last_active":"2024-06-02T22:52:09.802391+0000","last_peered":"2024-06-02T22:52:09.802391+0000","last_clean":"2024-06-02T22:52:09.802391+0000","last_became_active":"2024-06-02T22:52:07.598853+0000","last_became_peered":"2024-06-02T22:52:07.598853+0000","last_unstale":"2024-06-02T22:52:09.802391+0000","last_undegraded":"2024-06-02T22:52:09.802391+0000","last_fullsized":"2024-06-02T22:52:09.802391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:58:51.080840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608325+0000","last_change":"2024-06-02T22:52:03.579154+0000","last_active":"2024-06-02T22:52:08.608325+0000","last_peered":"2024-06-02T22:52:08.608325+0000","last_clean":"2024-06-02T22:52:08.608325+0000","last_became_active":"2024-06-02T22:52:03.578832+0000","last_became_peered":"2024-06-02T22:52:03.578832+0000","last_unstale":"2024-06-02T22:52:08.608325+0000","last_undegraded":"2024-06-02T22:52:08.608325+0000","last_fullsized":"2024-06-02T22:52:08.608325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609855+0000","last_change":"2024-06-02T22:52:03.575695+0000","last_active":"2024-06-02T22:52:08.609855+0000","last_peered":"2024-06-02T22:52:08.609855+0000","last_clean":"2024-06-02T22:52:08.609855+0000","last_became_active":"2024-06-02T22:52:03.575447+0000","last_became_peered":"2024-06-02T22:52:03.575447+0000","last_unstale":"2024-06-02T22:52:08.609855+0000","last_undegraded":"2024-06-02T22:52:08.609855+0000","last_fullsized":"2024-06-02T22:52:08.609855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:23.572760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866720+0000","last_change":"2024-06-02T22:52:03.579412+0000","last_active":"2024-06-02T22:52:09.866720+0000","last_peered":"2024-06-02T22:52:09.866720+0000","last_clean":"2024-06-02T22:52:09.866720+0000","last_became_active":"2024-06-02T22:52:03.578767+0000","last_became_peered":"2024-06-02T22:52:03.578767+0000","last_unstale":"2024-06-02T22:52:09.866720+0000","last_undegraded":"2024-06-02T22:52:09.866720+0000","last_fullsized":"2024-06-02T22:52:09.866720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867151+0000","last_change":"2024-06-02T22:52:03.578192+0000","last_active":"2024-06-02T22:52:09.867151+0000","last_peered":"2024-06-02T22:52:09.867151+0000","last_clean":"2024-06-02T22:52:09.867151+0000","last_became_active":"2024-06-02T22:52:03.577899+0000","last_became_peered":"2024-06-02T22:52:03.577899+0000","last_unstale":"2024-06-02T22:52:09.867151+0000","last_undegraded":"2024-06-02T22:52:09.867151+0000","last_fullsized":"2024-06-02T22:52:09.867151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802510+0000","last_change":"2024-06-02T22:52:03.585412+0000","last_active":"2024-06-02T22:52:09.802510+0000","last_peered":"2024-06-02T22:52:09.802510+0000","last_clean":"2024-06-02T22:52:09.802510+0000","last_became_active":"2024-06-02T22:52:03.585003+0000","last_became_peered":"2024-06-02T22:52:03.585003+0000","last_unstale":"2024-06-02T22:52:09.802510+0000","last_undegraded":"2024-06-02T22:52:09.802510+0000","last_fullsized":"2024-06-02T22:52:09.802510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866492+0000","last_change":"2024-06-02T22:52:03.581743+0000","last_active":"2024-06-02T22:52:09.866492+0000","last_peered":"2024-06-02T22:52:09.866492+0000","last_clean":"2024-06-02T22:52:09.866492+0000","last_became_active":"2024-06-02T22:52:03.581485+0000","last_became_peered":"2024-06-02T22:52:03.581485+0000","last_unstale":"2024-06-02T22:52:09.866492+0000","last_undegraded":"2024-06-02T22:52:09.866492+0000","last_fullsized":"2024-06-02T22:52:09.866492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609761+0000","last_change":"2024-06-02T22:52:03.578703+0000","last_active":"2024-06-02T22:52:08.609761+0000","last_peered":"2024-06-02T22:52:08.609761+0000","last_clean":"2024-06-02T22:52:08.609761+0000","last_became_active":"2024-06-02T22:52:03.578406+0000","last_became_peered":"2024-06-02T22:52:03.578406+0000","last_unstale":"2024-06-02T22:52:08.609761+0000","last_undegraded":"2024-06-02T22:52:08.609761+0000","last_fullsized":"2024-06-02T22:52:08.609761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802540+0000","last_change":"2024-06-02T22:52:03.585351+0000","last_active":"2024-06-02T22:52:09.802540+0000","last_peered":"2024-06-02T22:52:09.802540+0000","last_clean":"2024-06-02T22:52:09.802540+0000","last_became_active":"2024-06-02T22:52:03.585010+0000","last_became_peered":"2024-06-02T22:52:03.585010+0000","last_unstale":"2024-06-02T22:52:09.802540+0000","last_undegraded":"2024-06-02T22:52:09.802540+0000","last_fullsized":"2024-06-02T22:52:09.802540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866426+0000","last_change":"2024-06-02T22:52:03.583268+0000","last_active":"2024-06-02T22:52:09.866426+0000","last_peered":"2024-06-02T22:52:09.866426+0000","last_clean":"2024-06-02T22:52:09.866426+0000","last_became_active":"2024-06-02T22:52:03.582821+0000","last_became_peered":"2024-06-02T22:52:03.582821+0000","last_unstale":"2024-06-02T22:52:09.866426+0000","last_undegraded":"2024-06-02T22:52:09.866426+0000","last_fullsized":"2024-06-02T22:52:09.866426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802429+0000","last_change":"2024-06-02T22:52:03.585232+0000","last_active":"2024-06-02T22:52:09.802429+0000","last_peered":"2024-06-02T22:52:09.802429+0000","last_clean":"2024-06-02T22:52:09.802429+0000","last_became_active":"2024-06-02T22:52:03.584909+0000","last_became_peered":"2024-06-02T22:52:03.584909+0000","last_unstale":"2024-06-02T22:52:09.802429+0000","last_undegraded":"2024-06-02T22:52:09.802429+0000","last_fullsized":"2024-06-02T22:52:09.802429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866614+0000","last_change":"2024-06-02T22:52:03.580413+0000","last_active":"2024-06-02T22:52:09.866614+0000","last_peered":"2024-06-02T22:52:09.866614+0000","last_clean":"2024-06-02T22:52:09.866614+0000","last_became_active":"2024-06-02T22:52:03.580073+0000","last_became_peered":"2024-06-02T22:52:03.580073+0000","last_unstale":"2024-06-02T22:52:09.866614+0000","last_undegraded":"2024-06-02T22:52:09.866614+0000","last_fullsized":"2024-06-02T22:52:09.866614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866640+0000","last_change":"2024-06-02T22:52:03.579729+0000","last_active":"2024-06-02T22:52:09.866640+0000","last_peered":"2024-06-02T22:52:09.866640+0000","last_clean":"2024-06-02T22:52:09.866640+0000","last_became_active":"2024-06-02T22:52:03.578651+0000","last_became_peered":"2024-06-02T22:52:03.578651+0000","last_unstale":"2024-06-02T22:52:09.866640+0000","last_undegraded":"2024-06-02T22:52:09.866640+0000","last_fullsized":"2024-06-02T22:52:09.866640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608916+0000","last_change":"2024-06-02T22:52:03.566626+0000","last_active":"2024-06-02T22:52:08.608916+0000","last_peered":"2024-06-02T22:52:08.608916+0000","last_clean":"2024-06-02T22:52:08.608916+0000","last_became_active":"2024-06-02T22:52:03.566318+0000","last_became_peered":"2024-06-02T22:52:03.566318+0000","last_unstale":"2024-06-02T22:52:08.608916+0000","last_undegraded":"2024-06-02T22:52:08.608916+0000","last_fullsized":"2024-06-02T22:52:08.608916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366167+0000","last_change":"2024-06-02T22:52:03.576084+0000","last_active":"2024-06-02T22:52:09.366167+0000","last_peered":"2024-06-02T22:52:09.366167+0000","last_clean":"2024-06-02T22:52:09.366167+0000","last_became_active":"2024-06-02T22:52:03.574965+0000","last_became_peered":"2024-06-02T22:52:03.574965+0000","last_unstale":"2024-06-02T22:52:09.366167+0000","last_undegraded":"2024-06-02T22:52:09.366167+0000","last_fullsized":"2024-06-02T22:52:09.366167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:08.812577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610259+0000","last_change":"2024-06-02T22:52:03.566226+0000","last_active":"2024-06-02T22:52:08.610259+0000","last_peered":"2024-06-02T22:52:08.610259+0000","last_clean":"2024-06-02T22:52:08.610259+0000","last_became_active":"2024-06-02T22:52:03.565402+0000","last_became_peered":"2024-06-02T22:52:03.565402+0000","last_unstale":"2024-06-02T22:52:08.610259+0000","last_undegraded":"2024-06-02T22:52:08.610259+0000","last_fullsized":"2024-06-02T22:52:08.610259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:30.466832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867094+0000","last_change":"2024-06-02T22:52:03.586071+0000","last_active":"2024-06-02T22:52:09.867094+0000","last_peered":"2024-06-02T22:52:09.867094+0000","last_clean":"2024-06-02T22:52:09.867094+0000","last_became_active":"2024-06-02T22:52:03.585280+0000","last_became_peered":"2024-06-02T22:52:03.585280+0000","last_unstale":"2024-06-02T22:52:09.867094+0000","last_undegraded":"2024-06-02T22:52:09.867094+0000","last_fullsized":"2024-06-02T22:52:09.867094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:02.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866301+0000","last_change":"2024-06-02T22:52:03.579486+0000","last_active":"2024-06-02T22:52:09.866301+0000","last_peered":"2024-06-02T22:52:09.866301+0000","last_clean":"2024-06-02T22:52:09.866301+0000","last_became_active":"2024-06-02T22:52:03.579239+0000","last_became_peered":"2024-06-02T22:52:03.579239+0000","last_unstale":"2024-06-02T22:52:09.866301+0000","last_undegraded":"2024-06-02T22:52:09.866301+0000","last_fullsized":"2024-06-02T22:52:09.866301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866412+0000","last_change":"2024-06-02T22:52:03.575434+0000","last_active":"2024-06-02T22:52:09.866412+0000","last_peered":"2024-06-02T22:52:09.866412+0000","last_clean":"2024-06-02T22:52:09.866412+0000","last_became_active":"2024-06-02T22:52:03.575156+0000","last_became_peered":"2024-06-02T22:52:03.575156+0000","last_unstale":"2024-06-02T22:52:09.866412+0000","last_undegraded":"2024-06-02T22:52:09.866412+0000","last_fullsized":"2024-06-02T22:52:09.866412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867007+0000","last_change":"2024-06-02T22:52:03.573576+0000","last_active":"2024-06-02T22:52:09.867007+0000","last_peered":"2024-06-02T22:52:09.867007+0000","last_clean":"2024-06-02T22:52:09.867007+0000","last_became_active":"2024-06-02T22:52:03.573309+0000","last_became_peered":"2024-06-02T22:52:03.573309+0000","last_unstale":"2024-06-02T22:52:09.867007+0000","last_undegraded":"2024-06-02T22:52:09.867007+0000","last_fullsized":"2024-06-02T22:52:09.867007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:16.007531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802158+0000","last_change":"2024-06-02T22:52:03.581040+0000","last_active":"2024-06-02T22:52:09.802158+0000","last_peered":"2024-06-02T22:52:09.802158+0000","last_clean":"2024-06-02T22:52:09.802158+0000","last_became_active":"2024-06-02T22:52:03.580786+0000","last_became_peered":"2024-06-02T22:52:03.580786+0000","last_unstale":"2024-06-02T22:52:09.802158+0000","last_undegraded":"2024-06-02T22:52:09.802158+0000","last_fullsized":"2024-06-02T22:52:09.802158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609154+0000","last_change":"2024-06-02T22:52:03.564691+0000","last_active":"2024-06-02T22:52:08.609154+0000","last_peered":"2024-06-02T22:52:08.609154+0000","last_clean":"2024-06-02T22:52:08.609154+0000","last_became_active":"2024-06-02T22:52:03.564367+0000","last_became_peered":"2024-06-02T22:52:03.564367+0000","last_unstale":"2024-06-02T22:52:08.609154+0000","last_undegraded":"2024-06-02T22:52:08.609154+0000","last_fullsized":"2024-06-02T22:52:08.609154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:32.549919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609176+0000","last_change":"2024-06-02T22:52:03.579026+0000","last_active":"2024-06-02T22:52:08.609176+0000","last_peered":"2024-06-02T22:52:08.609176+0000","last_clean":"2024-06-02T22:52:08.609176+0000","last_became_active":"2024-06-02T22:52:03.578719+0000","last_became_peered":"2024-06-02T22:52:03.578719+0000","last_unstale":"2024-06-02T22:52:08.609176+0000","last_undegraded":"2024-06-02T22:52:08.609176+0000","last_fullsized":"2024-06-02T22:52:08.609176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609690+0000","last_change":"2024-06-02T22:52:03.576967+0000","last_active":"2024-06-02T22:52:08.609690+0000","last_peered":"2024-06-02T22:52:08.609690+0000","last_clean":"2024-06-02T22:52:08.609690+0000","last_became_active":"2024-06-02T22:52:03.576347+0000","last_became_peered":"2024-06-02T22:52:03.576347+0000","last_unstale":"2024-06-02T22:52:08.609690+0000","last_undegraded":"2024-06-02T22:52:08.609690+0000","last_fullsized":"2024-06-02T22:52:08.609690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366345+0000","last_change":"2024-06-02T22:52:03.582428+0000","last_active":"2024-06-02T22:52:09.366345+0000","last_peered":"2024-06-02T22:52:09.366345+0000","last_clean":"2024-06-02T22:52:09.366345+0000","last_became_active":"2024-06-02T22:52:03.582154+0000","last_became_peered":"2024-06-02T22:52:03.582154+0000","last_unstale":"2024-06-02T22:52:09.366345+0000","last_undegraded":"2024-06-02T22:52:09.366345+0000","last_fullsized":"2024-06-02T22:52:09.366345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:32.545502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801844+0000","last_change":"2024-06-02T22:52:03.577725+0000","last_active":"2024-06-02T22:52:09.801844+0000","last_peered":"2024-06-02T22:52:09.801844+0000","last_clean":"2024-06-02T22:52:09.801844+0000","last_became_active":"2024-06-02T22:52:03.577449+0000","last_became_peered":"2024-06-02T22:52:03.577449+0000","last_unstale":"2024-06-02T22:52:09.801844+0000","last_undegraded":"2024-06-02T22:52:09.801844+0000","last_fullsized":"2024-06-02T22:52:09.801844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365700+0000","last_change":"2024-06-02T22:52:03.578806+0000","last_active":"2024-06-02T22:52:09.365700+0000","last_peered":"2024-06-02T22:52:09.365700+0000","last_clean":"2024-06-02T22:52:09.365700+0000","last_became_active":"2024-06-02T22:52:03.578505+0000","last_became_peered":"2024-06-02T22:52:03.578505+0000","last_unstale":"2024-06-02T22:52:09.365700+0000","last_undegraded":"2024-06-02T22:52:09.365700+0000","last_fullsized":"2024-06-02T22:52:09.365700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866425+0000","last_change":"2024-06-02T22:52:03.579621+0000","last_active":"2024-06-02T22:52:09.866425+0000","last_peered":"2024-06-02T22:52:09.866425+0000","last_clean":"2024-06-02T22:52:09.866425+0000","last_became_active":"2024-06-02T22:52:03.579140+0000","last_became_peered":"2024-06-02T22:52:03.579140+0000","last_unstale":"2024-06-02T22:52:09.866425+0000","last_undegraded":"2024-06-02T22:52:09.866425+0000","last_fullsized":"2024-06-02T22:52:09.866425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:12.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365766+0000","last_change":"2024-06-02T22:52:03.575446+0000","last_active":"2024-06-02T22:52:09.365766+0000","last_peered":"2024-06-02T22:52:09.365766+0000","last_clean":"2024-06-02T22:52:09.365766+0000","last_became_active":"2024-06-02T22:52:03.573953+0000","last_became_peered":"2024-06-02T22:52:03.573953+0000","last_unstale":"2024-06-02T22:52:09.365766+0000","last_undegraded":"2024-06-02T22:52:09.365766+0000","last_fullsized":"2024-06-02T22:52:09.365766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866605+0000","last_change":"2024-06-02T22:52:03.585130+0000","last_active":"2024-06-02T22:52:09.866605+0000","last_peered":"2024-06-02T22:52:09.866605+0000","last_clean":"2024-06-02T22:52:09.866605+0000","last_became_active":"2024-06-02T22:52:03.584816+0000","last_became_peered":"2024-06-02T22:52:03.584816+0000","last_unstale":"2024-06-02T22:52:09.866605+0000","last_undegraded":"2024-06-02T22:52:09.866605+0000","last_fullsized":"2024-06-02T22:52:09.866605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:02.241694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867276+0000","last_change":"2024-06-02T22:52:03.571403+0000","last_active":"2024-06-02T22:52:09.867276+0000","last_peered":"2024-06-02T22:52:09.867276+0000","last_clean":"2024-06-02T22:52:09.867276+0000","last_became_active":"2024-06-02T22:52:03.568977+0000","last_became_peered":"2024-06-02T22:52:03.568977+0000","last_unstale":"2024-06-02T22:52:09.867276+0000","last_undegraded":"2024-06-02T22:52:09.867276+0000","last_fullsized":"2024-06-02T22:52:09.867276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866695+0000","last_change":"2024-06-02T22:52:03.577758+0000","last_active":"2024-06-02T22:52:09.866695+0000","last_peered":"2024-06-02T22:52:09.866695+0000","last_clean":"2024-06-02T22:52:09.866695+0000","last_became_active":"2024-06-02T22:52:03.577260+0000","last_became_peered":"2024-06-02T22:52:03.577260+0000","last_unstale":"2024-06-02T22:52:09.866695+0000","last_undegraded":"2024-06-02T22:52:09.866695+0000","last_fullsized":"2024-06-02T22:52:09.866695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366256+0000","last_change":"2024-06-02T22:52:03.576942+0000","last_active":"2024-06-02T22:52:09.366256+0000","last_peered":"2024-06-02T22:52:09.366256+0000","last_clean":"2024-06-02T22:52:09.366256+0000","last_became_active":"2024-06-02T22:52:03.576652+0000","last_became_peered":"2024-06-02T22:52:03.576652+0000","last_unstale":"2024-06-02T22:52:09.366256+0000","last_undegraded":"2024-06-02T22:52:09.366256+0000","last_fullsized":"2024-06-02T22:52:09.366256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:53.784824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:52:27.996 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:52:28.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.132+0000 7f8a3d215640 1 Processor -- start 2024-06-02T22:52:28.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.132+0000 7f8a3d215640 1 -- start start 2024-06-02T22:52:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a3d215640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a38158770 0x7f8a3806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a3d215640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a3806e670 con 0x7f8a38158b50 2024-06-02T22:52:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a3d215640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a3806e950 con 0x7f8a3806e0c0 2024-06-02T22:52:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a3d215640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8a3806ec30 con 0x7f8a38158770 2024-06-02T22:52:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a36d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a38158770 0x7f8a3806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a36d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a38158770 0x7f8a3806c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34708/0 (socket says 172.21.15.82:34708) 2024-06-02T22:52:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a36d9d640 1 -- 172.21.15.82:0/174824681 learned_addr learned my addr 172.21.15.82:0/174824681 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a3659c640 1 --1- 172.21.15.82:0/174824681 >> v1:172.21.15.82:6789/0 conn(0x7f8a38158b50 0x7f8a3806d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48200/0 (socket says 172.21.15.82:48200) 2024-06-02T22:52:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a36d9d640 1 -- 172.21.15.82:0/174824681 >> v1:172.21.15.184:6789/0 conn(0x7f8a3806e0c0 legacy=0x7f8a380aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a36d9d640 1 -- 172.21.15.82:0/174824681 >> v1:172.21.15.82:6789/0 conn(0x7f8a38158b50 legacy=0x7f8a3806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a36d9d640 1 -- 172.21.15.82:0/174824681 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a380ae890 con 0x7f8a38158770 2024-06-02T22:52:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.133+0000 7f8a35d9b640 1 -- 172.21.15.82:0/174824681 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4043934331 0 0) 0x7f8a3806e670 con 0x7f8a38158b50 2024-06-02T22:52:28.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.134+0000 7f8a36d9d640 1 --2- 172.21.15.82:0/174824681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a38158770 0x7f8a3806c3d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009e50 tx=0x7f8a2802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79216e681f2b2834 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:28.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.134+0000 7f8a35d9b640 1 -- 172.21.15.82:0/174824681 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28036070 con 0x7f8a38158770 2024-06-02T22:52:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.134+0000 7f8a35d9b640 1 -- 172.21.15.82:0/174824681 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a28031600 con 0x7f8a38158770 2024-06-02T22:52:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.134+0000 7f8a35d9b640 1 -- 172.21.15.82:0/174824681 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a280319d0 con 0x7f8a38158770 2024-06-02T22:52:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.135+0000 7f8a3d215640 1 -- 172.21.15.82:0/174824681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a38158770 msgr2=0x7f8a3806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.135+0000 7f8a3d215640 1 --2- 172.21.15.82:0/174824681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a38158770 0x7f8a3806c3d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009e50 tx=0x7f8a2802a730 comp rx=0 tx=0).stop 2024-06-02T22:52:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.135+0000 7f8a3d215640 1 -- 172.21.15.82:0/174824681 shutdown_connections 2024-06-02T22:52:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.135+0000 7f8a3d215640 1 --2- 172.21.15.82:0/174824681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a38158770 0x7f8a3806c3d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.135+0000 7f8a3d215640 1 -- 172.21.15.82:0/174824681 >> 172.21.15.82:0/174824681 conn(0x7f8a38071950 msgr2=0x7f8a38071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.135+0000 7f8a3d215640 1 -- 172.21.15.82:0/174824681 shutdown_connections 2024-06-02T22:52:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.135+0000 7f8a3d215640 1 -- 172.21.15.82:0/174824681 wait complete. 2024-06-02T22:52:28.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.136+0000 7f8a3d215640 1 Processor -- start 2024-06-02T22:52:28.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.136+0000 7f8a3d215640 1 -- start start 2024-06-02T22:52:28.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3d215640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a3806e0c0 0x7f8a381f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3d215640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a38158770 0x7f8a381f7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3d215640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a38158b50 0x7f8a38158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3d215640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3806ca90 con 0x7f8a38158770 2024-06-02T22:52:28.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3d215640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3806c910 con 0x7f8a3806e0c0 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3d215640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3806cc10 con 0x7f8a38158b50 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a38158770 0x7f8a381f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a38158770 0x7f8a381f7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34712/0 (socket says 172.21.15.82:34712) 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3659c640 1 -- 172.21.15.82:0/1318986626 learned_addr learned my addr 172.21.15.82:0/1318986626 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a36d9d640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a3806e0c0 0x7f8a381f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3659c640 1 -- 172.21.15.82:0/1318986626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a38158b50 msgr2=0x7f8a38158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3759e640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a38158b50 0x7f8a38158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3659c640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a38158b50 0x7f8a38158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.137+0000 7f8a3659c640 1 -- 172.21.15.82:0/1318986626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a3806e0c0 msgr2=0x7f8a381f72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.138+0000 7f8a3659c640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a3806e0c0 0x7f8a381f72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.138+0000 7f8a3659c640 1 -- 172.21.15.82:0/1318986626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a38159c40 con 0x7f8a38158770 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.138+0000 7f8a3659c640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a38158770 0x7f8a381f7810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00c460 tx=0x7f8a2c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.138+0000 7f8a1f7fe640 1 -- 172.21.15.82:0/1318986626 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c018070 con 0x7f8a38158770 2024-06-02T22:52:28.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.138+0000 7f8a1f7fe640 1 -- 172.21.15.82:0/1318986626 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2c007520 con 0x7f8a38158770 2024-06-02T22:52:28.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.138+0000 7f8a1f7fe640 1 -- 172.21.15.82:0/1318986626 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c004a20 con 0x7f8a38158770 2024-06-02T22:52:28.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.138+0000 7f8a3d215640 1 -- 172.21.15.82:0/1318986626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a38159f20 con 0x7f8a38158770 2024-06-02T22:52:28.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.138+0000 7f8a3d215640 1 -- 172.21.15.82:0/1318986626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3815a4e0 con 0x7f8a38158770 2024-06-02T22:52:28.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.139+0000 7f8a3d215640 1 -- 172.21.15.82:0/1318986626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a3815a820 con 0x7f8a38158770 2024-06-02T22:52:28.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.139+0000 7f8a1f7fe640 1 -- 172.21.15.82:0/1318986626 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a2c004bc0 con 0x7f8a38158770 2024-06-02T22:52:28.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.140+0000 7f8a1f7fe640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8a2406be30 0x7f8a2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.140+0000 7f8a36d9d640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8a2406be30 0x7f8a2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.140+0000 7f8a1f7fe640 1 -- 172.21.15.82:0/1318986626 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8a2c08a390 con 0x7f8a38158770 2024-06-02T22:52:28.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.140+0000 7f8a36d9d640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8a2406be30 0x7f8a2406e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8a28033000 tx=0x7f8a28009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:28.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.144+0000 7f8a1f7fe640 1 -- 172.21.15.82:0/1318986626 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8a3815a820 con 0x7f8a38158770 2024-06-02T22:52:28.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.315+0000 7f8a3d215640 1 -- 172.21.15.82:0/1318986626 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a38068430 con 0x7f8a2406be30 2024-06-02T22:52:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.322+0000 7f8a1f7fe640 1 -- 172.21.15.82:0/1318986626 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f8a38068430 con 0x7f8a2406be30 2024-06-02T22:52:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:28.327 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:52:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 -- 172.21.15.82:0/1318986626 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8a2406be30 msgr2=0x7f8a2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8a2406be30 0x7f8a2406e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8a28033000 tx=0x7f8a28009000 comp rx=0 tx=0).stop 2024-06-02T22:52:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 -- 172.21.15.82:0/1318986626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a38158770 msgr2=0x7f8a381f7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a38158770 0x7f8a381f7810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00c460 tx=0x7f8a2c00c920 comp rx=0 tx=0).stop 2024-06-02T22:52:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 -- 172.21.15.82:0/1318986626 shutdown_connections 2024-06-02T22:52:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8a2406be30 0x7f8a2406e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a38158b50 0x7f8a38158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a38158770 0x7f8a381f7810 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 --2- 172.21.15.82:0/1318986626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a3806e0c0 0x7f8a381f72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 -- 172.21.15.82:0/1318986626 >> 172.21.15.82:0/1318986626 conn(0x7f8a38071950 msgr2=0x7f8a380b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 -- 172.21.15.82:0/1318986626 shutdown_connections 2024-06-02T22:52:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.326+0000 7f8a3d215640 1 -- 172.21.15.82:0/1318986626 wait complete. 2024-06-02T22:52:28.337 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-06-02T22:52:27.827721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002655"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867448+0000","last_change":"2024-06-02T22:52:02.575295+0000","last_active":"2024-06-02T22:52:09.867448+0000","last_peered":"2024-06-02T22:52:09.867448+0000","last_clean":"2024-06-02T22:52:09.867448+0000","last_became_active":"2024-06-02T22:52:02.575023+0000","last_became_peered":"2024-06-02T22:52:02.575023+0000","last_unstale":"2024-06-02T22:52:09.867448+0000","last_undegraded":"2024-06-02T22:52:09.867448+0000","last_fullsized":"2024-06-02T22:52:09.867448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:31:16.566686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802284+0000","last_change":"2024-06-02T22:52:03.580611+0000","last_active":"2024-06-02T22:52:09.802284+0000","last_peered":"2024-06-02T22:52:09.802284+0000","last_clean":"2024-06-02T22:52:09.802284+0000","last_became_active":"2024-06-02T22:52:03.580225+0000","last_became_peered":"2024-06-02T22:52:03.580225+0000","last_unstale":"2024-06-02T22:52:09.802284+0000","last_undegraded":"2024-06-02T22:52:09.802284+0000","last_fullsized":"2024-06-02T22:52:09.802284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801869+0000","last_change":"2024-06-02T22:52:07.615955+0000","last_active":"2024-06-02T22:52:09.801869+0000","last_peered":"2024-06-02T22:52:09.801869+0000","last_clean":"2024-06-02T22:52:09.801869+0000","last_became_active":"2024-06-02T22:52:07.615566+0000","last_became_peered":"2024-06-02T22:52:07.615566+0000","last_unstale":"2024-06-02T22:52:09.801869+0000","last_undegraded":"2024-06-02T22:52:09.801869+0000","last_fullsized":"2024-06-02T22:52:09.801869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:27:30.054564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802388+0000","last_change":"2024-06-02T22:52:02.574379+0000","last_active":"2024-06-02T22:52:09.802388+0000","last_peered":"2024-06-02T22:52:09.802388+0000","last_clean":"2024-06-02T22:52:09.802388+0000","last_became_active":"2024-06-02T22:52:02.574045+0000","last_became_peered":"2024-06-02T22:52:02.574045+0000","last_unstale":"2024-06-02T22:52:09.802388+0000","last_undegraded":"2024-06-02T22:52:09.802388+0000","last_fullsized":"2024-06-02T22:52:09.802388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867282+0000","last_change":"2024-06-02T22:52:03.576563+0000","last_active":"2024-06-02T22:52:09.867282+0000","last_peered":"2024-06-02T22:52:09.867282+0000","last_clean":"2024-06-02T22:52:09.867282+0000","last_became_active":"2024-06-02T22:52:03.576270+0000","last_became_peered":"2024-06-02T22:52:03.576270+0000","last_unstale":"2024-06-02T22:52:09.867282+0000","last_undegraded":"2024-06-02T22:52:09.867282+0000","last_fullsized":"2024-06-02T22:52:09.867282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:18:18.561237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608375+0000","last_change":"2024-06-02T22:52:07.602568+0000","last_active":"2024-06-02T22:52:08.608375+0000","last_peered":"2024-06-02T22:52:08.608375+0000","last_clean":"2024-06-02T22:52:08.608375+0000","last_became_active":"2024-06-02T22:52:07.602120+0000","last_became_peered":"2024-06-02T22:52:07.602120+0000","last_unstale":"2024-06-02T22:52:08.608375+0000","last_undegraded":"2024-06-02T22:52:08.608375+0000","last_fullsized":"2024-06-02T22:52:08.608375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:47.081866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366155+0000","last_change":"2024-06-02T22:52:02.571940+0000","last_active":"2024-06-02T22:52:09.366155+0000","last_peered":"2024-06-02T22:52:09.366155+0000","last_clean":"2024-06-02T22:52:09.366155+0000","last_became_active":"2024-06-02T22:52:02.571659+0000","last_became_peered":"2024-06-02T22:52:02.571659+0000","last_unstale":"2024-06-02T22:52:09.366155+0000","last_undegraded":"2024-06-02T22:52:09.366155+0000","last_fullsized":"2024-06-02T22:52:09.366155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:38:20.818313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866687+0000","last_change":"2024-06-02T22:52:03.585947+0000","last_active":"2024-06-02T22:52:09.866687+0000","last_peered":"2024-06-02T22:52:09.866687+0000","last_clean":"2024-06-02T22:52:09.866687+0000","last_became_active":"2024-06-02T22:52:03.585500+0000","last_became_peered":"2024-06-02T22:52:03.585500+0000","last_unstale":"2024-06-02T22:52:09.866687+0000","last_undegraded":"2024-06-02T22:52:09.866687+0000","last_fullsized":"2024-06-02T22:52:09.866687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609695+0000","last_change":"2024-06-02T22:52:07.601710+0000","last_active":"2024-06-02T22:52:08.609695+0000","last_peered":"2024-06-02T22:52:08.609695+0000","last_clean":"2024-06-02T22:52:08.609695+0000","last_became_active":"2024-06-02T22:52:07.601102+0000","last_became_peered":"2024-06-02T22:52:07.601102+0000","last_unstale":"2024-06-02T22:52:08.609695+0000","last_undegraded":"2024-06-02T22:52:08.609695+0000","last_fullsized":"2024-06-02T22:52:08.609695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365966+0000","last_change":"2024-06-02T22:52:02.571116+0000","last_active":"2024-06-02T22:52:09.365966+0000","last_peered":"2024-06-02T22:52:09.365966+0000","last_clean":"2024-06-02T22:52:09.365966+0000","last_became_active":"2024-06-02T22:52:02.570844+0000","last_became_peered":"2024-06-02T22:52:02.570844+0000","last_unstale":"2024-06-02T22:52:09.365966+0000","last_undegraded":"2024-06-02T22:52:09.365966+0000","last_fullsized":"2024-06-02T22:52:09.365966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:29.459302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866964+0000","last_change":"2024-06-02T22:52:03.586616+0000","last_active":"2024-06-02T22:52:09.866964+0000","last_peered":"2024-06-02T22:52:09.866964+0000","last_clean":"2024-06-02T22:52:09.866964+0000","last_became_active":"2024-06-02T22:52:03.586329+0000","last_became_peered":"2024-06-02T22:52:03.586329+0000","last_unstale":"2024-06-02T22:52:09.866964+0000","last_undegraded":"2024-06-02T22:52:09.866964+0000","last_fullsized":"2024-06-02T22:52:09.866964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:53.784824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608637+0000","last_change":"2024-06-02T22:52:07.601892+0000","last_active":"2024-06-02T22:52:08.608637+0000","last_peered":"2024-06-02T22:52:08.608637+0000","last_clean":"2024-06-02T22:52:08.608637+0000","last_became_active":"2024-06-02T22:52:07.601456+0000","last_became_peered":"2024-06-02T22:52:07.601456+0000","last_unstale":"2024-06-02T22:52:08.608637+0000","last_undegraded":"2024-06-02T22:52:08.608637+0000","last_fullsized":"2024-06-02T22:52:08.608637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:36.100904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609102+0000","last_change":"2024-06-02T22:52:03.565750+0000","last_active":"2024-06-02T22:52:08.609102+0000","last_peered":"2024-06-02T22:52:08.609102+0000","last_clean":"2024-06-02T22:52:08.609102+0000","last_became_active":"2024-06-02T22:52:03.565467+0000","last_became_peered":"2024-06-02T22:52:03.565467+0000","last_unstale":"2024-06-02T22:52:08.609102+0000","last_undegraded":"2024-06-02T22:52:08.609102+0000","last_fullsized":"2024-06-02T22:52:08.609102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365983+0000","last_change":"2024-06-02T22:52:02.570379+0000","last_active":"2024-06-02T22:52:09.365983+0000","last_peered":"2024-06-02T22:52:09.365983+0000","last_clean":"2024-06-02T22:52:09.365983+0000","last_became_active":"2024-06-02T22:52:02.570030+0000","last_became_peered":"2024-06-02T22:52:02.570030+0000","last_unstale":"2024-06-02T22:52:09.365983+0000","last_undegraded":"2024-06-02T22:52:09.365983+0000","last_fullsized":"2024-06-02T22:52:09.365983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:22.565230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609584+0000","last_change":"2024-06-02T22:52:07.595784+0000","last_active":"2024-06-02T22:52:08.609584+0000","last_peered":"2024-06-02T22:52:08.609584+0000","last_clean":"2024-06-02T22:52:08.609584+0000","last_became_active":"2024-06-02T22:52:07.595380+0000","last_became_peered":"2024-06-02T22:52:07.595380+0000","last_unstale":"2024-06-02T22:52:08.609584+0000","last_undegraded":"2024-06-02T22:52:08.609584+0000","last_fullsized":"2024-06-02T22:52:08.609584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:58.268207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802173+0000","last_change":"2024-06-02T22:52:03.576639+0000","last_active":"2024-06-02T22:52:09.802173+0000","last_peered":"2024-06-02T22:52:09.802173+0000","last_clean":"2024-06-02T22:52:09.802173+0000","last_became_active":"2024-06-02T22:52:03.576309+0000","last_became_peered":"2024-06-02T22:52:03.576309+0000","last_unstale":"2024-06-02T22:52:09.802173+0000","last_undegraded":"2024-06-02T22:52:09.802173+0000","last_fullsized":"2024-06-02T22:52:09.802173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:12.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867086+0000","last_change":"2024-06-02T22:52:02.571697+0000","last_active":"2024-06-02T22:52:09.867086+0000","last_peered":"2024-06-02T22:52:09.867086+0000","last_clean":"2024-06-02T22:52:09.867086+0000","last_became_active":"2024-06-02T22:52:02.571334+0000","last_became_peered":"2024-06-02T22:52:02.571334+0000","last_unstale":"2024-06-02T22:52:09.867086+0000","last_undegraded":"2024-06-02T22:52:09.867086+0000","last_fullsized":"2024-06-02T22:52:09.867086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608904+0000","last_change":"2024-06-02T22:52:07.602282+0000","last_active":"2024-06-02T22:52:08.608904+0000","last_peered":"2024-06-02T22:52:08.608904+0000","last_clean":"2024-06-02T22:52:08.608904+0000","last_became_active":"2024-06-02T22:52:07.601727+0000","last_became_peered":"2024-06-02T22:52:07.601727+0000","last_unstale":"2024-06-02T22:52:08.608904+0000","last_undegraded":"2024-06-02T22:52:08.608904+0000","last_fullsized":"2024-06-02T22:52:08.608904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:16.624490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802324+0000","last_change":"2024-06-02T22:52:03.581537+0000","last_active":"2024-06-02T22:52:09.802324+0000","last_peered":"2024-06-02T22:52:09.802324+0000","last_clean":"2024-06-02T22:52:09.802324+0000","last_became_active":"2024-06-02T22:52:03.581246+0000","last_became_peered":"2024-06-02T22:52:03.581246+0000","last_unstale":"2024-06-02T22:52:09.802324+0000","last_undegraded":"2024-06-02T22:52:09.802324+0000","last_fullsized":"2024-06-02T22:52:09.802324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866507+0000","last_change":"2024-06-02T22:52:02.572402+0000","last_active":"2024-06-02T22:52:09.866507+0000","last_peered":"2024-06-02T22:52:09.866507+0000","last_clean":"2024-06-02T22:52:09.866507+0000","last_became_active":"2024-06-02T22:52:02.572115+0000","last_became_peered":"2024-06-02T22:52:02.572115+0000","last_unstale":"2024-06-02T22:52:09.866507+0000","last_undegraded":"2024-06-02T22:52:09.866507+0000","last_fullsized":"2024-06-02T22:52:09.866507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866967+0000","last_change":"2024-06-02T22:52:07.612631+0000","last_active":"2024-06-02T22:52:09.866967+0000","last_peered":"2024-06-02T22:52:09.866967+0000","last_clean":"2024-06-02T22:52:09.866967+0000","last_became_active":"2024-06-02T22:52:07.612232+0000","last_became_peered":"2024-06-02T22:52:07.612232+0000","last_unstale":"2024-06-02T22:52:09.866967+0000","last_undegraded":"2024-06-02T22:52:09.866967+0000","last_fullsized":"2024-06-02T22:52:09.866967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:06.782146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609382+0000","last_change":"2024-06-02T22:52:03.572261+0000","last_active":"2024-06-02T22:52:08.609382+0000","last_peered":"2024-06-02T22:52:08.609382+0000","last_clean":"2024-06-02T22:52:08.609382+0000","last_became_active":"2024-06-02T22:52:03.571880+0000","last_became_peered":"2024-06-02T22:52:03.571880+0000","last_unstale":"2024-06-02T22:52:08.609382+0000","last_undegraded":"2024-06-02T22:52:08.609382+0000","last_fullsized":"2024-06-02T22:52:08.609382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:12.138755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365549+0000","last_change":"2024-06-02T22:52:02.577529+0000","last_active":"2024-06-02T22:52:09.365549+0000","last_peered":"2024-06-02T22:52:09.365549+0000","last_clean":"2024-06-02T22:52:09.365549+0000","last_became_active":"2024-06-02T22:52:02.577284+0000","last_became_peered":"2024-06-02T22:52:02.577284+0000","last_unstale":"2024-06-02T22:52:09.365549+0000","last_undegraded":"2024-06-02T22:52:09.365549+0000","last_fullsized":"2024-06-02T22:52:09.365549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608462+0000","last_change":"2024-06-02T22:52:07.602336+0000","last_active":"2024-06-02T22:52:08.608462+0000","last_peered":"2024-06-02T22:52:08.608462+0000","last_clean":"2024-06-02T22:52:08.608462+0000","last_became_active":"2024-06-02T22:52:07.601622+0000","last_became_peered":"2024-06-02T22:52:07.601622+0000","last_unstale":"2024-06-02T22:52:08.608462+0000","last_undegraded":"2024-06-02T22:52:08.608462+0000","last_fullsized":"2024-06-02T22:52:08.608462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:51.634356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867716+0000","last_change":"2024-06-02T22:52:03.572653+0000","last_active":"2024-06-02T22:52:09.867716+0000","last_peered":"2024-06-02T22:52:09.867716+0000","last_clean":"2024-06-02T22:52:09.867716+0000","last_became_active":"2024-06-02T22:52:03.570668+0000","last_became_peered":"2024-06-02T22:52:03.570668+0000","last_unstale":"2024-06-02T22:52:09.867716+0000","last_undegraded":"2024-06-02T22:52:09.867716+0000","last_fullsized":"2024-06-02T22:52:09.867716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609605+0000","last_change":"2024-06-02T22:52:02.567590+0000","last_active":"2024-06-02T22:52:08.609605+0000","last_peered":"2024-06-02T22:52:08.609605+0000","last_clean":"2024-06-02T22:52:08.609605+0000","last_became_active":"2024-06-02T22:52:02.567282+0000","last_became_peered":"2024-06-02T22:52:02.567282+0000","last_unstale":"2024-06-02T22:52:08.609605+0000","last_undegraded":"2024-06-02T22:52:08.609605+0000","last_fullsized":"2024-06-02T22:52:08.609605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609106+0000","last_change":"2024-06-02T22:52:07.612665+0000","last_active":"2024-06-02T22:52:08.609106+0000","last_peered":"2024-06-02T22:52:08.609106+0000","last_clean":"2024-06-02T22:52:08.609106+0000","last_became_active":"2024-06-02T22:52:07.612285+0000","last_became_peered":"2024-06-02T22:52:07.612285+0000","last_unstale":"2024-06-02T22:52:08.609106+0000","last_undegraded":"2024-06-02T22:52:08.609106+0000","last_fullsized":"2024-06-02T22:52:08.609106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:16.674095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802607+0000","last_change":"2024-06-02T22:52:03.582904+0000","last_active":"2024-06-02T22:52:09.802607+0000","last_peered":"2024-06-02T22:52:09.802607+0000","last_clean":"2024-06-02T22:52:09.802607+0000","last_became_active":"2024-06-02T22:52:03.582518+0000","last_became_peered":"2024-06-02T22:52:03.582518+0000","last_unstale":"2024-06-02T22:52:09.802607+0000","last_undegraded":"2024-06-02T22:52:09.802607+0000","last_fullsized":"2024-06-02T22:52:09.802607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866796+0000","last_change":"2024-06-02T22:52:02.573748+0000","last_active":"2024-06-02T22:52:09.866796+0000","last_peered":"2024-06-02T22:52:09.866796+0000","last_clean":"2024-06-02T22:52:09.866796+0000","last_became_active":"2024-06-02T22:52:02.573176+0000","last_became_peered":"2024-06-02T22:52:02.573176+0000","last_unstale":"2024-06-02T22:52:09.866796+0000","last_undegraded":"2024-06-02T22:52:09.866796+0000","last_fullsized":"2024-06-02T22:52:09.866796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801791+0000","last_change":"2024-06-02T22:52:07.616184+0000","last_active":"2024-06-02T22:52:09.801791+0000","last_peered":"2024-06-02T22:52:09.801791+0000","last_clean":"2024-06-02T22:52:09.801791+0000","last_became_active":"2024-06-02T22:52:07.615819+0000","last_became_peered":"2024-06-02T22:52:07.615819+0000","last_unstale":"2024-06-02T22:52:09.801791+0000","last_undegraded":"2024-06-02T22:52:09.801791+0000","last_fullsized":"2024-06-02T22:52:09.801791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:19.408730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867127+0000","last_change":"2024-06-02T22:52:03.569758+0000","last_active":"2024-06-02T22:52:09.867127+0000","last_peered":"2024-06-02T22:52:09.867127+0000","last_clean":"2024-06-02T22:52:09.867127+0000","last_became_active":"2024-06-02T22:52:03.569452+0000","last_became_peered":"2024-06-02T22:52:03.569452+0000","last_unstale":"2024-06-02T22:52:09.867127+0000","last_undegraded":"2024-06-02T22:52:09.867127+0000","last_fullsized":"2024-06-02T22:52:09.867127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366261+0000","last_change":"2024-06-02T22:52:02.580385+0000","last_active":"2024-06-02T22:52:09.366261+0000","last_peered":"2024-06-02T22:52:09.366261+0000","last_clean":"2024-06-02T22:52:09.366261+0000","last_became_active":"2024-06-02T22:52:02.580155+0000","last_became_peered":"2024-06-02T22:52:02.580155+0000","last_unstale":"2024-06-02T22:52:09.366261+0000","last_undegraded":"2024-06-02T22:52:09.366261+0000","last_fullsized":"2024-06-02T22:52:09.366261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:13:02.259557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866547+0000","last_change":"2024-06-02T22:52:07.613087+0000","last_active":"2024-06-02T22:52:09.866547+0000","last_peered":"2024-06-02T22:52:09.866547+0000","last_clean":"2024-06-02T22:52:09.866547+0000","last_became_active":"2024-06-02T22:52:07.612654+0000","last_became_peered":"2024-06-02T22:52:07.612654+0000","last_unstale":"2024-06-02T22:52:09.866547+0000","last_undegraded":"2024-06-02T22:52:09.866547+0000","last_fullsized":"2024-06-02T22:52:09.866547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867078+0000","last_change":"2024-06-02T22:52:03.582326+0000","last_active":"2024-06-02T22:52:09.867078+0000","last_peered":"2024-06-02T22:52:09.867078+0000","last_clean":"2024-06-02T22:52:09.867078+0000","last_became_active":"2024-06-02T22:52:03.581989+0000","last_became_peered":"2024-06-02T22:52:03.581989+0000","last_unstale":"2024-06-02T22:52:09.867078+0000","last_undegraded":"2024-06-02T22:52:09.867078+0000","last_fullsized":"2024-06-02T22:52:09.867078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:32.545502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867218+0000","last_change":"2024-06-02T22:52:02.574632+0000","last_active":"2024-06-02T22:52:09.867218+0000","last_peered":"2024-06-02T22:52:09.867218+0000","last_clean":"2024-06-02T22:52:09.867218+0000","last_became_active":"2024-06-02T22:52:02.573272+0000","last_became_peered":"2024-06-02T22:52:02.573272+0000","last_unstale":"2024-06-02T22:52:09.867218+0000","last_undegraded":"2024-06-02T22:52:09.867218+0000","last_fullsized":"2024-06-02T22:52:09.867218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:29.459302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866384+0000","last_change":"2024-06-02T22:52:07.598965+0000","last_active":"2024-06-02T22:52:09.866384+0000","last_peered":"2024-06-02T22:52:09.866384+0000","last_clean":"2024-06-02T22:52:09.866384+0000","last_became_active":"2024-06-02T22:52:07.597987+0000","last_became_peered":"2024-06-02T22:52:07.597987+0000","last_unstale":"2024-06-02T22:52:09.866384+0000","last_undegraded":"2024-06-02T22:52:09.866384+0000","last_fullsized":"2024-06-02T22:52:09.866384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609823+0000","last_change":"2024-06-02T22:52:03.566069+0000","last_active":"2024-06-02T22:52:08.609823+0000","last_peered":"2024-06-02T22:52:08.609823+0000","last_clean":"2024-06-02T22:52:08.609823+0000","last_became_active":"2024-06-02T22:52:03.565771+0000","last_became_peered":"2024-06-02T22:52:03.565771+0000","last_unstale":"2024-06-02T22:52:08.609823+0000","last_undegraded":"2024-06-02T22:52:08.609823+0000","last_fullsized":"2024-06-02T22:52:08.609823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:21.517626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866865+0000","last_change":"2024-06-02T22:52:02.568991+0000","last_active":"2024-06-02T22:52:09.866865+0000","last_peered":"2024-06-02T22:52:09.866865+0000","last_clean":"2024-06-02T22:52:09.866865+0000","last_became_active":"2024-06-02T22:52:02.568707+0000","last_became_peered":"2024-06-02T22:52:02.568707+0000","last_unstale":"2024-06-02T22:52:09.866865+0000","last_undegraded":"2024-06-02T22:52:09.866865+0000","last_fullsized":"2024-06-02T22:52:09.866865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867124+0000","last_change":"2024-06-02T22:52:07.599911+0000","last_active":"2024-06-02T22:52:09.867124+0000","last_peered":"2024-06-02T22:52:09.867124+0000","last_clean":"2024-06-02T22:52:09.867124+0000","last_became_active":"2024-06-02T22:52:07.599511+0000","last_became_peered":"2024-06-02T22:52:07.599511+0000","last_unstale":"2024-06-02T22:52:09.867124+0000","last_undegraded":"2024-06-02T22:52:09.867124+0000","last_fullsized":"2024-06-02T22:52:09.867124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:12.840435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867482+0000","last_change":"2024-06-02T22:52:03.569708+0000","last_active":"2024-06-02T22:52:09.867482+0000","last_peered":"2024-06-02T22:52:09.867482+0000","last_clean":"2024-06-02T22:52:09.867482+0000","last_became_active":"2024-06-02T22:52:03.568694+0000","last_became_peered":"2024-06-02T22:52:03.568694+0000","last_unstale":"2024-06-02T22:52:09.867482+0000","last_undegraded":"2024-06-02T22:52:09.867482+0000","last_fullsized":"2024-06-02T22:52:09.867482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610009+0000","last_change":"2024-06-02T22:52:02.567971+0000","last_active":"2024-06-02T22:52:08.610009+0000","last_peered":"2024-06-02T22:52:08.610009+0000","last_clean":"2024-06-02T22:52:08.610009+0000","last_became_active":"2024-06-02T22:52:02.567623+0000","last_became_peered":"2024-06-02T22:52:02.567623+0000","last_unstale":"2024-06-02T22:52:08.610009+0000","last_undegraded":"2024-06-02T22:52:08.610009+0000","last_fullsized":"2024-06-02T22:52:08.610009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866990+0000","last_change":"2024-06-02T22:52:07.602117+0000","last_active":"2024-06-02T22:52:09.866990+0000","last_peered":"2024-06-02T22:52:09.866990+0000","last_clean":"2024-06-02T22:52:09.866990+0000","last_became_active":"2024-06-02T22:52:07.599651+0000","last_became_peered":"2024-06-02T22:52:07.599651+0000","last_unstale":"2024-06-02T22:52:09.866990+0000","last_undegraded":"2024-06-02T22:52:09.866990+0000","last_fullsized":"2024-06-02T22:52:09.866990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:36.573360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866296+0000","last_change":"2024-06-02T22:52:03.563190+0000","last_active":"2024-06-02T22:52:09.866296+0000","last_peered":"2024-06-02T22:52:09.866296+0000","last_clean":"2024-06-02T22:52:09.866296+0000","last_became_active":"2024-06-02T22:52:03.562873+0000","last_became_peered":"2024-06-02T22:52:03.562873+0000","last_unstale":"2024-06-02T22:52:09.866296+0000","last_undegraded":"2024-06-02T22:52:09.866296+0000","last_fullsized":"2024-06-02T22:52:09.866296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:31.146827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365584+0000","last_change":"2024-06-02T22:52:02.570735+0000","last_active":"2024-06-02T22:52:09.365584+0000","last_peered":"2024-06-02T22:52:09.365584+0000","last_clean":"2024-06-02T22:52:09.365584+0000","last_became_active":"2024-06-02T22:52:02.570459+0000","last_became_peered":"2024-06-02T22:52:02.570459+0000","last_unstale":"2024-06-02T22:52:09.365584+0000","last_undegraded":"2024-06-02T22:52:09.365584+0000","last_fullsized":"2024-06-02T22:52:09.365584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867640+0000","last_change":"2024-06-02T22:52:07.612607+0000","last_active":"2024-06-02T22:52:09.867640+0000","last_peered":"2024-06-02T22:52:09.867640+0000","last_clean":"2024-06-02T22:52:09.867640+0000","last_became_active":"2024-06-02T22:52:07.612210+0000","last_became_peered":"2024-06-02T22:52:07.612210+0000","last_unstale":"2024-06-02T22:52:09.867640+0000","last_undegraded":"2024-06-02T22:52:09.867640+0000","last_fullsized":"2024-06-02T22:52:09.867640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:12.840435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802134+0000","last_change":"2024-06-02T22:52:03.581959+0000","last_active":"2024-06-02T22:52:09.802134+0000","last_peered":"2024-06-02T22:52:09.802134+0000","last_clean":"2024-06-02T22:52:09.802134+0000","last_became_active":"2024-06-02T22:52:03.581625+0000","last_became_peered":"2024-06-02T22:52:03.581625+0000","last_unstale":"2024-06-02T22:52:09.802134+0000","last_undegraded":"2024-06-02T22:52:09.802134+0000","last_fullsized":"2024-06-02T22:52:09.802134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866575+0000","last_change":"2024-06-02T22:52:02.565526+0000","last_active":"2024-06-02T22:52:09.866575+0000","last_peered":"2024-06-02T22:52:09.866575+0000","last_clean":"2024-06-02T22:52:09.866575+0000","last_became_active":"2024-06-02T22:52:02.565197+0000","last_became_peered":"2024-06-02T22:52:02.565197+0000","last_unstale":"2024-06-02T22:52:09.866575+0000","last_undegraded":"2024-06-02T22:52:09.866575+0000","last_fullsized":"2024-06-02T22:52:09.866575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365701+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:52:09.365701+0000","last_peered":"2024-06-02T22:52:09.365701+0000","last_clean":"2024-06-02T22:52:09.365701+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:52:09.365701+0000","last_undegraded":"2024-06-02T22:52:09.365701+0000","last_fullsized":"2024-06-02T22:52:09.365701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608822+0000","last_change":"2024-06-02T22:52:07.615952+0000","last_active":"2024-06-02T22:52:08.608822+0000","last_peered":"2024-06-02T22:52:08.608822+0000","last_clean":"2024-06-02T22:52:08.608822+0000","last_became_active":"2024-06-02T22:52:07.615538+0000","last_became_peered":"2024-06-02T22:52:07.615538+0000","last_unstale":"2024-06-02T22:52:08.608822+0000","last_undegraded":"2024-06-02T22:52:08.608822+0000","last_fullsized":"2024-06-02T22:52:08.608822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:11.213283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366025+0000","last_change":"2024-06-02T22:52:03.577819+0000","last_active":"2024-06-02T22:52:09.366025+0000","last_peered":"2024-06-02T22:52:09.366025+0000","last_clean":"2024-06-02T22:52:09.366025+0000","last_became_active":"2024-06-02T22:52:03.577525+0000","last_became_peered":"2024-06-02T22:52:03.577525+0000","last_unstale":"2024-06-02T22:52:09.366025+0000","last_undegraded":"2024-06-02T22:52:09.366025+0000","last_fullsized":"2024-06-02T22:52:09.366025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:02.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610185+0000","last_change":"2024-06-02T22:52:02.565482+0000","last_active":"2024-06-02T22:52:08.610185+0000","last_peered":"2024-06-02T22:52:08.610185+0000","last_clean":"2024-06-02T22:52:08.610185+0000","last_became_active":"2024-06-02T22:52:02.565172+0000","last_became_peered":"2024-06-02T22:52:02.565172+0000","last_unstale":"2024-06-02T22:52:08.610185+0000","last_undegraded":"2024-06-02T22:52:08.610185+0000","last_fullsized":"2024-06-02T22:52:08.610185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:37:05.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608322+0000","last_change":"2024-06-02T22:52:07.612701+0000","last_active":"2024-06-02T22:52:08.608322+0000","last_peered":"2024-06-02T22:52:08.608322+0000","last_clean":"2024-06-02T22:52:08.608322+0000","last_became_active":"2024-06-02T22:52:07.612260+0000","last_became_peered":"2024-06-02T22:52:07.612260+0000","last_unstale":"2024-06-02T22:52:08.608322+0000","last_undegraded":"2024-06-02T22:52:08.608322+0000","last_fullsized":"2024-06-02T22:52:08.608322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:47.081866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866731+0000","last_change":"2024-06-02T22:52:03.587460+0000","last_active":"2024-06-02T22:52:09.866731+0000","last_peered":"2024-06-02T22:52:09.866731+0000","last_clean":"2024-06-02T22:52:09.866731+0000","last_became_active":"2024-06-02T22:52:03.587183+0000","last_became_peered":"2024-06-02T22:52:03.587183+0000","last_unstale":"2024-06-02T22:52:09.866731+0000","last_undegraded":"2024-06-02T22:52:09.866731+0000","last_fullsized":"2024-06-02T22:52:09.866731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:43.054007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866861+0000","last_change":"2024-06-02T22:52:02.570822+0000","last_active":"2024-06-02T22:52:09.866861+0000","last_peered":"2024-06-02T22:52:09.866861+0000","last_clean":"2024-06-02T22:52:09.866861+0000","last_became_active":"2024-06-02T22:52:02.570425+0000","last_became_peered":"2024-06-02T22:52:02.570425+0000","last_unstale":"2024-06-02T22:52:09.866861+0000","last_undegraded":"2024-06-02T22:52:09.866861+0000","last_fullsized":"2024-06-02T22:52:09.866861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:22.565230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866793+0000","last_change":"2024-06-02T22:52:07.596605+0000","last_active":"2024-06-02T22:52:09.866793+0000","last_peered":"2024-06-02T22:52:09.866793+0000","last_clean":"2024-06-02T22:52:09.866793+0000","last_became_active":"2024-06-02T22:52:07.596062+0000","last_became_peered":"2024-06-02T22:52:07.596062+0000","last_unstale":"2024-06-02T22:52:09.866793+0000","last_undegraded":"2024-06-02T22:52:09.866793+0000","last_fullsized":"2024-06-02T22:52:09.866793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:57.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366406+0000","last_change":"2024-06-02T22:52:03.583665+0000","last_active":"2024-06-02T22:52:09.366406+0000","last_peered":"2024-06-02T22:52:09.366406+0000","last_clean":"2024-06-02T22:52:09.366406+0000","last_became_active":"2024-06-02T22:52:03.583405+0000","last_became_peered":"2024-06-02T22:52:03.583405+0000","last_unstale":"2024-06-02T22:52:09.366406+0000","last_undegraded":"2024-06-02T22:52:09.366406+0000","last_fullsized":"2024-06-02T22:52:09.366406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:07.055543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610318+0000","last_change":"2024-06-02T22:52:02.568513+0000","last_active":"2024-06-02T22:52:08.610318+0000","last_peered":"2024-06-02T22:52:08.610318+0000","last_clean":"2024-06-02T22:52:08.610318+0000","last_became_active":"2024-06-02T22:52:02.567653+0000","last_became_peered":"2024-06-02T22:52:02.567653+0000","last_unstale":"2024-06-02T22:52:08.610318+0000","last_undegraded":"2024-06-02T22:52:08.610318+0000","last_fullsized":"2024-06-02T22:52:08.610318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866292+0000","last_change":"2024-06-02T22:52:07.612655+0000","last_active":"2024-06-02T22:52:09.866292+0000","last_peered":"2024-06-02T22:52:09.866292+0000","last_clean":"2024-06-02T22:52:09.866292+0000","last_became_active":"2024-06-02T22:52:07.612255+0000","last_became_peered":"2024-06-02T22:52:07.612255+0000","last_unstale":"2024-06-02T22:52:09.866292+0000","last_undegraded":"2024-06-02T22:52:09.866292+0000","last_fullsized":"2024-06-02T22:52:09.866292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:19.408730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366212+0000","last_change":"2024-06-02T22:52:03.584406+0000","last_active":"2024-06-02T22:52:09.366212+0000","last_peered":"2024-06-02T22:52:09.366212+0000","last_clean":"2024-06-02T22:52:09.366212+0000","last_became_active":"2024-06-02T22:52:03.584128+0000","last_became_peered":"2024-06-02T22:52:03.584128+0000","last_unstale":"2024-06-02T22:52:09.366212+0000","last_undegraded":"2024-06-02T22:52:09.366212+0000","last_fullsized":"2024-06-02T22:52:09.366212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:02.241694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608660+0000","last_change":"2024-06-02T22:52:02.567072+0000","last_active":"2024-06-02T22:52:08.608660+0000","last_peered":"2024-06-02T22:52:08.608660+0000","last_clean":"2024-06-02T22:52:08.608660+0000","last_became_active":"2024-06-02T22:52:02.566757+0000","last_became_peered":"2024-06-02T22:52:02.566757+0000","last_unstale":"2024-06-02T22:52:08.608660+0000","last_undegraded":"2024-06-02T22:52:08.608660+0000","last_fullsized":"2024-06-02T22:52:08.608660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:57.107796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609128+0000","last_change":"2024-06-02T22:52:07.601781+0000","last_active":"2024-06-02T22:52:08.609128+0000","last_peered":"2024-06-02T22:52:08.609128+0000","last_clean":"2024-06-02T22:52:08.609128+0000","last_became_active":"2024-06-02T22:52:07.601121+0000","last_became_peered":"2024-06-02T22:52:07.601121+0000","last_unstale":"2024-06-02T22:52:08.609128+0000","last_undegraded":"2024-06-02T22:52:08.609128+0000","last_fullsized":"2024-06-02T22:52:08.609128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:40.819611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365745+0000","last_change":"2024-06-02T22:52:03.583571+0000","last_active":"2024-06-02T22:52:09.365745+0000","last_peered":"2024-06-02T22:52:09.365745+0000","last_clean":"2024-06-02T22:52:09.365745+0000","last_became_active":"2024-06-02T22:52:03.583035+0000","last_became_peered":"2024-06-02T22:52:03.583035+0000","last_unstale":"2024-06-02T22:52:09.365745+0000","last_undegraded":"2024-06-02T22:52:09.365745+0000","last_fullsized":"2024-06-02T22:52:09.365745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609832+0000","last_change":"2024-06-02T22:52:02.568253+0000","last_active":"2024-06-02T22:52:08.609832+0000","last_peered":"2024-06-02T22:52:08.609832+0000","last_clean":"2024-06-02T22:52:08.609832+0000","last_became_active":"2024-06-02T22:52:02.567725+0000","last_became_peered":"2024-06-02T22:52:02.567725+0000","last_unstale":"2024-06-02T22:52:08.609832+0000","last_undegraded":"2024-06-02T22:52:08.609832+0000","last_fullsized":"2024-06-02T22:52:08.609832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867536+0000","last_change":"2024-06-02T22:52:07.601097+0000","last_active":"2024-06-02T22:52:09.867536+0000","last_peered":"2024-06-02T22:52:09.867536+0000","last_clean":"2024-06-02T22:52:09.867536+0000","last_became_active":"2024-06-02T22:52:07.600696+0000","last_became_peered":"2024-06-02T22:52:07.600696+0000","last_unstale":"2024-06-02T22:52:09.867536+0000","last_undegraded":"2024-06-02T22:52:09.867536+0000","last_fullsized":"2024-06-02T22:52:09.867536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:36.573360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608536+0000","last_change":"2024-06-02T22:52:03.579404+0000","last_active":"2024-06-02T22:52:08.608536+0000","last_peered":"2024-06-02T22:52:08.608536+0000","last_clean":"2024-06-02T22:52:08.608536+0000","last_became_active":"2024-06-02T22:52:03.579057+0000","last_became_peered":"2024-06-02T22:52:03.579057+0000","last_unstale":"2024-06-02T22:52:08.608536+0000","last_undegraded":"2024-06-02T22:52:08.608536+0000","last_fullsized":"2024-06-02T22:52:08.608536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609446+0000","last_change":"2024-06-02T22:52:02.566374+0000","last_active":"2024-06-02T22:52:08.609446+0000","last_peered":"2024-06-02T22:52:08.609446+0000","last_clean":"2024-06-02T22:52:08.609446+0000","last_became_active":"2024-06-02T22:52:02.566091+0000","last_became_peered":"2024-06-02T22:52:02.566091+0000","last_unstale":"2024-06-02T22:52:08.609446+0000","last_undegraded":"2024-06-02T22:52:08.609446+0000","last_fullsized":"2024-06-02T22:52:08.609446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802585+0000","last_change":"2024-06-02T22:52:07.615876+0000","last_active":"2024-06-02T22:52:09.802585+0000","last_peered":"2024-06-02T22:52:09.802585+0000","last_clean":"2024-06-02T22:52:09.802585+0000","last_became_active":"2024-06-02T22:52:07.615423+0000","last_became_peered":"2024-06-02T22:52:07.615423+0000","last_unstale":"2024-06-02T22:52:09.802585+0000","last_undegraded":"2024-06-02T22:52:09.802585+0000","last_fullsized":"2024-06-02T22:52:09.802585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:20:08.691545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365895+0000","last_change":"2024-06-02T22:52:03.579077+0000","last_active":"2024-06-02T22:52:09.365895+0000","last_peered":"2024-06-02T22:52:09.365895+0000","last_clean":"2024-06-02T22:52:09.365895+0000","last_became_active":"2024-06-02T22:52:03.578126+0000","last_became_peered":"2024-06-02T22:52:03.578126+0000","last_unstale":"2024-06-02T22:52:09.365895+0000","last_undegraded":"2024-06-02T22:52:09.365895+0000","last_fullsized":"2024-06-02T22:52:09.365895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:43.054007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866722+0000","last_change":"2024-06-02T22:52:02.570439+0000","last_active":"2024-06-02T22:52:09.866722+0000","last_peered":"2024-06-02T22:52:09.866722+0000","last_clean":"2024-06-02T22:52:09.866722+0000","last_became_active":"2024-06-02T22:52:02.569937+0000","last_became_peered":"2024-06-02T22:52:02.569937+0000","last_unstale":"2024-06-02T22:52:09.866722+0000","last_undegraded":"2024-06-02T22:52:09.866722+0000","last_fullsized":"2024-06-02T22:52:09.866722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802494+0000","last_change":"2024-06-02T22:52:07.612603+0000","last_active":"2024-06-02T22:52:09.802494+0000","last_peered":"2024-06-02T22:52:09.802494+0000","last_clean":"2024-06-02T22:52:09.802494+0000","last_became_active":"2024-06-02T22:52:07.612214+0000","last_became_peered":"2024-06-02T22:52:07.612214+0000","last_unstale":"2024-06-02T22:52:09.802494+0000","last_undegraded":"2024-06-02T22:52:09.802494+0000","last_fullsized":"2024-06-02T22:52:09.802494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:20:19.247700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867054+0000","last_change":"2024-06-02T22:52:03.579566+0000","last_active":"2024-06-02T22:52:09.867054+0000","last_peered":"2024-06-02T22:52:09.867054+0000","last_clean":"2024-06-02T22:52:09.867054+0000","last_became_active":"2024-06-02T22:52:03.579295+0000","last_became_peered":"2024-06-02T22:52:03.579295+0000","last_unstale":"2024-06-02T22:52:09.867054+0000","last_undegraded":"2024-06-02T22:52:09.867054+0000","last_fullsized":"2024-06-02T22:52:09.867054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867327+0000","last_change":"2024-06-02T22:52:02.563970+0000","last_active":"2024-06-02T22:52:09.867327+0000","last_peered":"2024-06-02T22:52:09.867327+0000","last_clean":"2024-06-02T22:52:09.867327+0000","last_became_active":"2024-06-02T22:52:02.563675+0000","last_became_peered":"2024-06-02T22:52:02.563675+0000","last_unstale":"2024-06-02T22:52:09.867327+0000","last_undegraded":"2024-06-02T22:52:09.867327+0000","last_fullsized":"2024-06-02T22:52:09.867327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:31.842742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866976+0000","last_change":"2024-06-02T22:52:07.615973+0000","last_active":"2024-06-02T22:52:09.866976+0000","last_peered":"2024-06-02T22:52:09.866976+0000","last_clean":"2024-06-02T22:52:09.866976+0000","last_became_active":"2024-06-02T22:52:07.615586+0000","last_became_peered":"2024-06-02T22:52:07.615586+0000","last_unstale":"2024-06-02T22:52:09.866976+0000","last_undegraded":"2024-06-02T22:52:09.866976+0000","last_fullsized":"2024-06-02T22:52:09.866976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:27:30.054564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365923+0000","last_change":"2024-06-02T22:52:03.584686+0000","last_active":"2024-06-02T22:52:09.365923+0000","last_peered":"2024-06-02T22:52:09.365923+0000","last_clean":"2024-06-02T22:52:09.365923+0000","last_became_active":"2024-06-02T22:52:03.584398+0000","last_became_peered":"2024-06-02T22:52:03.584398+0000","last_unstale":"2024-06-02T22:52:09.365923+0000","last_undegraded":"2024-06-02T22:52:09.365923+0000","last_fullsized":"2024-06-02T22:52:09.365923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:07.185424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:12.944886+0000","last_change":"2024-06-02T22:52:02.568278+0000","last_active":"2024-06-02T22:52:12.944886+0000","last_peered":"2024-06-02T22:52:12.944886+0000","last_clean":"2024-06-02T22:52:12.944886+0000","last_became_active":"2024-06-02T22:52:02.567915+0000","last_became_peered":"2024-06-02T22:52:02.567915+0000","last_unstale":"2024-06-02T22:52:12.944886+0000","last_undegraded":"2024-06-02T22:52:12.944886+0000","last_fullsized":"2024-06-02T22:52:12.944886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866737+0000","last_change":"2024-06-02T22:52:07.596273+0000","last_active":"2024-06-02T22:52:09.866737+0000","last_peered":"2024-06-02T22:52:09.866737+0000","last_clean":"2024-06-02T22:52:09.866737+0000","last_became_active":"2024-06-02T22:52:07.595893+0000","last_became_peered":"2024-06-02T22:52:07.595893+0000","last_unstale":"2024-06-02T22:52:09.866737+0000","last_undegraded":"2024-06-02T22:52:09.866737+0000","last_fullsized":"2024-06-02T22:52:09.866737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:57.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609245+0000","last_change":"2024-06-02T22:52:03.576403+0000","last_active":"2024-06-02T22:52:08.609245+0000","last_peered":"2024-06-02T22:52:08.609245+0000","last_clean":"2024-06-02T22:52:08.609245+0000","last_became_active":"2024-06-02T22:52:03.574665+0000","last_became_peered":"2024-06-02T22:52:03.574665+0000","last_unstale":"2024-06-02T22:52:08.609245+0000","last_undegraded":"2024-06-02T22:52:08.609245+0000","last_fullsized":"2024-06-02T22:52:08.609245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:30.466832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866748+0000","last_change":"2024-06-02T22:52:02.572661+0000","last_active":"2024-06-02T22:52:09.866748+0000","last_peered":"2024-06-02T22:52:09.866748+0000","last_clean":"2024-06-02T22:52:09.866748+0000","last_became_active":"2024-06-02T22:52:02.571128+0000","last_became_peered":"2024-06-02T22:52:02.571128+0000","last_unstale":"2024-06-02T22:52:09.866748+0000","last_undegraded":"2024-06-02T22:52:09.866748+0000","last_fullsized":"2024-06-02T22:52:09.866748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:31.542389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609673+0000","last_change":"2024-06-02T22:52:07.595758+0000","last_active":"2024-06-02T22:52:08.609673+0000","last_peered":"2024-06-02T22:52:08.609673+0000","last_clean":"2024-06-02T22:52:08.609673+0000","last_became_active":"2024-06-02T22:52:07.595359+0000","last_became_peered":"2024-06-02T22:52:07.595359+0000","last_unstale":"2024-06-02T22:52:08.609673+0000","last_undegraded":"2024-06-02T22:52:08.609673+0000","last_fullsized":"2024-06-02T22:52:08.609673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:11.213283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867361+0000","last_change":"2024-06-02T22:52:03.575977+0000","last_active":"2024-06-02T22:52:09.867361+0000","last_peered":"2024-06-02T22:52:09.867361+0000","last_clean":"2024-06-02T22:52:09.867361+0000","last_became_active":"2024-06-02T22:52:03.575690+0000","last_became_peered":"2024-06-02T22:52:03.575690+0000","last_unstale":"2024-06-02T22:52:09.867361+0000","last_undegraded":"2024-06-02T22:52:09.867361+0000","last_fullsized":"2024-06-02T22:52:09.867361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866849+0000","last_change":"2024-06-02T22:52:02.571504+0000","last_active":"2024-06-02T22:52:09.866849+0000","last_peered":"2024-06-02T22:52:09.866849+0000","last_clean":"2024-06-02T22:52:09.866849+0000","last_became_active":"2024-06-02T22:52:02.571227+0000","last_became_peered":"2024-06-02T22:52:02.571227+0000","last_unstale":"2024-06-02T22:52:09.866849+0000","last_undegraded":"2024-06-02T22:52:09.866849+0000","last_fullsized":"2024-06-02T22:52:09.866849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:31:08.107248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801961+0000","last_change":"2024-06-02T22:52:07.599829+0000","last_active":"2024-06-02T22:52:09.801961+0000","last_peered":"2024-06-02T22:52:09.801961+0000","last_clean":"2024-06-02T22:52:09.801961+0000","last_became_active":"2024-06-02T22:52:07.599407+0000","last_became_peered":"2024-06-02T22:52:07.599407+0000","last_unstale":"2024-06-02T22:52:09.801961+0000","last_undegraded":"2024-06-02T22:52:09.801961+0000","last_fullsized":"2024-06-02T22:52:09.801961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:33:49.412166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866795+0000","last_change":"2024-06-02T22:52:03.585466+0000","last_active":"2024-06-02T22:52:09.866795+0000","last_peered":"2024-06-02T22:52:09.866795+0000","last_clean":"2024-06-02T22:52:09.866795+0000","last_became_active":"2024-06-02T22:52:03.584977+0000","last_became_peered":"2024-06-02T22:52:03.584977+0000","last_unstale":"2024-06-02T22:52:09.866795+0000","last_undegraded":"2024-06-02T22:52:09.866795+0000","last_fullsized":"2024-06-02T22:52:09.866795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:07.185424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609512+0000","last_change":"2024-06-02T22:52:02.566185+0000","last_active":"2024-06-02T22:52:08.609512+0000","last_peered":"2024-06-02T22:52:08.609512+0000","last_clean":"2024-06-02T22:52:08.609512+0000","last_became_active":"2024-06-02T22:52:02.565884+0000","last_became_peered":"2024-06-02T22:52:02.565884+0000","last_unstale":"2024-06-02T22:52:08.609512+0000","last_undegraded":"2024-06-02T22:52:08.609512+0000","last_fullsized":"2024-06-02T22:52:08.609512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:53:11.131225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801946+0000","last_change":"2024-06-02T22:52:07.613267+0000","last_active":"2024-06-02T22:52:09.801946+0000","last_peered":"2024-06-02T22:52:09.801946+0000","last_clean":"2024-06-02T22:52:09.801946+0000","last_became_active":"2024-06-02T22:52:07.612830+0000","last_became_peered":"2024-06-02T22:52:07.612830+0000","last_unstale":"2024-06-02T22:52:09.801946+0000","last_undegraded":"2024-06-02T22:52:09.801946+0000","last_fullsized":"2024-06-02T22:52:09.801946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:08:51.327311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867496+0000","last_change":"2024-06-02T22:52:07.615985+0000","last_active":"2024-06-02T22:52:09.867496+0000","last_peered":"2024-06-02T22:52:09.867496+0000","last_clean":"2024-06-02T22:52:09.867496+0000","last_became_active":"2024-06-02T22:52:07.615499+0000","last_became_peered":"2024-06-02T22:52:07.615499+0000","last_unstale":"2024-06-02T22:52:09.867496+0000","last_undegraded":"2024-06-02T22:52:09.867496+0000","last_fullsized":"2024-06-02T22:52:09.867496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:06.782146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866321+0000","last_change":"2024-06-02T22:52:03.582276+0000","last_active":"2024-06-02T22:52:09.866321+0000","last_peered":"2024-06-02T22:52:09.866321+0000","last_clean":"2024-06-02T22:52:09.866321+0000","last_became_active":"2024-06-02T22:52:03.582024+0000","last_became_peered":"2024-06-02T22:52:03.582024+0000","last_unstale":"2024-06-02T22:52:09.866321+0000","last_undegraded":"2024-06-02T22:52:09.866321+0000","last_fullsized":"2024-06-02T22:52:09.866321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866520+0000","last_change":"2024-06-02T22:52:02.566673+0000","last_active":"2024-06-02T22:52:09.866520+0000","last_peered":"2024-06-02T22:52:09.866520+0000","last_clean":"2024-06-02T22:52:09.866520+0000","last_became_active":"2024-06-02T22:52:02.566382+0000","last_became_peered":"2024-06-02T22:52:02.566382+0000","last_unstale":"2024-06-02T22:52:09.866520+0000","last_undegraded":"2024-06-02T22:52:09.866520+0000","last_fullsized":"2024-06-02T22:52:09.866520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:20.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609482+0000","last_change":"2024-06-02T22:52:07.595868+0000","last_active":"2024-06-02T22:52:08.609482+0000","last_peered":"2024-06-02T22:52:08.609482+0000","last_clean":"2024-06-02T22:52:08.609482+0000","last_became_active":"2024-06-02T22:52:07.595443+0000","last_became_peered":"2024-06-02T22:52:07.595443+0000","last_unstale":"2024-06-02T22:52:08.609482+0000","last_undegraded":"2024-06-02T22:52:08.609482+0000","last_fullsized":"2024-06-02T22:52:08.609482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:06.269552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801957+0000","last_change":"2024-06-02T22:52:03.577756+0000","last_active":"2024-06-02T22:52:09.801957+0000","last_peered":"2024-06-02T22:52:09.801957+0000","last_clean":"2024-06-02T22:52:09.801957+0000","last_became_active":"2024-06-02T22:52:03.577464+0000","last_became_peered":"2024-06-02T22:52:03.577464+0000","last_unstale":"2024-06-02T22:52:09.801957+0000","last_undegraded":"2024-06-02T22:52:09.801957+0000","last_fullsized":"2024-06-02T22:52:09.801957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802322+0000","last_change":"2024-06-02T22:52:02.573076+0000","last_active":"2024-06-02T22:52:09.802322+0000","last_peered":"2024-06-02T22:52:09.802322+0000","last_clean":"2024-06-02T22:52:09.802322+0000","last_became_active":"2024-06-02T22:52:02.572774+0000","last_became_peered":"2024-06-02T22:52:02.572774+0000","last_unstale":"2024-06-02T22:52:09.802322+0000","last_undegraded":"2024-06-02T22:52:09.802322+0000","last_fullsized":"2024-06-02T22:52:09.802322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:37:05.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609292+0000","last_change":"2024-06-02T22:52:02.567544+0000","last_active":"2024-06-02T22:52:08.609292+0000","last_peered":"2024-06-02T22:52:08.609292+0000","last_clean":"2024-06-02T22:52:08.609292+0000","last_became_active":"2024-06-02T22:52:02.566808+0000","last_became_peered":"2024-06-02T22:52:02.566808+0000","last_unstale":"2024-06-02T22:52:08.609292+0000","last_undegraded":"2024-06-02T22:52:08.609292+0000","last_fullsized":"2024-06-02T22:52:08.609292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:06.700633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867244+0000","last_change":"2024-06-02T22:52:03.562967+0000","last_active":"2024-06-02T22:52:09.867244+0000","last_peered":"2024-06-02T22:52:09.867244+0000","last_clean":"2024-06-02T22:52:09.867244+0000","last_became_active":"2024-06-02T22:52:03.562081+0000","last_became_peered":"2024-06-02T22:52:03.562081+0000","last_unstale":"2024-06-02T22:52:09.867244+0000","last_undegraded":"2024-06-02T22:52:09.867244+0000","last_fullsized":"2024-06-02T22:52:09.867244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610074+0000","last_change":"2024-06-02T22:52:07.601119+0000","last_active":"2024-06-02T22:52:08.610074+0000","last_peered":"2024-06-02T22:52:08.610074+0000","last_clean":"2024-06-02T22:52:08.610074+0000","last_became_active":"2024-06-02T22:52:07.600750+0000","last_became_peered":"2024-06-02T22:52:07.600750+0000","last_unstale":"2024-06-02T22:52:08.610074+0000","last_undegraded":"2024-06-02T22:52:08.610074+0000","last_fullsized":"2024-06-02T22:52:08.610074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:35.174685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802437+0000","last_change":"2024-06-02T22:52:02.571567+0000","last_active":"2024-06-02T22:52:09.802437+0000","last_peered":"2024-06-02T22:52:09.802437+0000","last_clean":"2024-06-02T22:52:09.802437+0000","last_became_active":"2024-06-02T22:52:02.571287+0000","last_became_peered":"2024-06-02T22:52:02.571287+0000","last_unstale":"2024-06-02T22:52:09.802437+0000","last_undegraded":"2024-06-02T22:52:09.802437+0000","last_fullsized":"2024-06-02T22:52:09.802437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:01.538934+0000","last_clean_scrub_stamp":"2024-06-02T22:52:01.538934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:31:16.566686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608886+0000","last_change":"2024-06-02T22:52:03.570359+0000","last_active":"2024-06-02T22:52:08.608886+0000","last_peered":"2024-06-02T22:52:08.608886+0000","last_clean":"2024-06-02T22:52:08.608886+0000","last_became_active":"2024-06-02T22:52:03.570078+0000","last_became_peered":"2024-06-02T22:52:03.570078+0000","last_unstale":"2024-06-02T22:52:08.608886+0000","last_undegraded":"2024-06-02T22:52:08.608886+0000","last_fullsized":"2024-06-02T22:52:08.608886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:23.572760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802391+0000","last_change":"2024-06-02T22:52:07.599308+0000","last_active":"2024-06-02T22:52:09.802391+0000","last_peered":"2024-06-02T22:52:09.802391+0000","last_clean":"2024-06-02T22:52:09.802391+0000","last_became_active":"2024-06-02T22:52:07.598853+0000","last_became_peered":"2024-06-02T22:52:07.598853+0000","last_unstale":"2024-06-02T22:52:09.802391+0000","last_undegraded":"2024-06-02T22:52:09.802391+0000","last_fullsized":"2024-06-02T22:52:09.802391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:06.574322+0000","last_clean_scrub_stamp":"2024-06-02T22:52:06.574322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:58:51.080840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608325+0000","last_change":"2024-06-02T22:52:03.579154+0000","last_active":"2024-06-02T22:52:08.608325+0000","last_peered":"2024-06-02T22:52:08.608325+0000","last_clean":"2024-06-02T22:52:08.608325+0000","last_became_active":"2024-06-02T22:52:03.578832+0000","last_became_peered":"2024-06-02T22:52:03.578832+0000","last_unstale":"2024-06-02T22:52:08.608325+0000","last_undegraded":"2024-06-02T22:52:08.608325+0000","last_fullsized":"2024-06-02T22:52:08.608325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609855+0000","last_change":"2024-06-02T22:52:03.575695+0000","last_active":"2024-06-02T22:52:08.609855+0000","last_peered":"2024-06-02T22:52:08.609855+0000","last_clean":"2024-06-02T22:52:08.609855+0000","last_became_active":"2024-06-02T22:52:03.575447+0000","last_became_peered":"2024-06-02T22:52:03.575447+0000","last_unstale":"2024-06-02T22:52:08.609855+0000","last_undegraded":"2024-06-02T22:52:08.609855+0000","last_fullsized":"2024-06-02T22:52:08.609855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:23.572760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866720+0000","last_change":"2024-06-02T22:52:03.579412+0000","last_active":"2024-06-02T22:52:09.866720+0000","last_peered":"2024-06-02T22:52:09.866720+0000","last_clean":"2024-06-02T22:52:09.866720+0000","last_became_active":"2024-06-02T22:52:03.578767+0000","last_became_peered":"2024-06-02T22:52:03.578767+0000","last_unstale":"2024-06-02T22:52:09.866720+0000","last_undegraded":"2024-06-02T22:52:09.866720+0000","last_fullsized":"2024-06-02T22:52:09.866720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:36.791752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867151+0000","last_change":"2024-06-02T22:52:03.578192+0000","last_active":"2024-06-02T22:52:09.867151+0000","last_peered":"2024-06-02T22:52:09.867151+0000","last_clean":"2024-06-02T22:52:09.867151+0000","last_became_active":"2024-06-02T22:52:03.577899+0000","last_became_peered":"2024-06-02T22:52:03.577899+0000","last_unstale":"2024-06-02T22:52:09.867151+0000","last_undegraded":"2024-06-02T22:52:09.867151+0000","last_fullsized":"2024-06-02T22:52:09.867151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802510+0000","last_change":"2024-06-02T22:52:03.585412+0000","last_active":"2024-06-02T22:52:09.802510+0000","last_peered":"2024-06-02T22:52:09.802510+0000","last_clean":"2024-06-02T22:52:09.802510+0000","last_became_active":"2024-06-02T22:52:03.585003+0000","last_became_peered":"2024-06-02T22:52:03.585003+0000","last_unstale":"2024-06-02T22:52:09.802510+0000","last_undegraded":"2024-06-02T22:52:09.802510+0000","last_fullsized":"2024-06-02T22:52:09.802510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866492+0000","last_change":"2024-06-02T22:52:03.581743+0000","last_active":"2024-06-02T22:52:09.866492+0000","last_peered":"2024-06-02T22:52:09.866492+0000","last_clean":"2024-06-02T22:52:09.866492+0000","last_became_active":"2024-06-02T22:52:03.581485+0000","last_became_peered":"2024-06-02T22:52:03.581485+0000","last_unstale":"2024-06-02T22:52:09.866492+0000","last_undegraded":"2024-06-02T22:52:09.866492+0000","last_fullsized":"2024-06-02T22:52:09.866492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609761+0000","last_change":"2024-06-02T22:52:03.578703+0000","last_active":"2024-06-02T22:52:08.609761+0000","last_peered":"2024-06-02T22:52:08.609761+0000","last_clean":"2024-06-02T22:52:08.609761+0000","last_became_active":"2024-06-02T22:52:03.578406+0000","last_became_peered":"2024-06-02T22:52:03.578406+0000","last_unstale":"2024-06-02T22:52:08.609761+0000","last_undegraded":"2024-06-02T22:52:08.609761+0000","last_fullsized":"2024-06-02T22:52:08.609761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802540+0000","last_change":"2024-06-02T22:52:03.585351+0000","last_active":"2024-06-02T22:52:09.802540+0000","last_peered":"2024-06-02T22:52:09.802540+0000","last_clean":"2024-06-02T22:52:09.802540+0000","last_became_active":"2024-06-02T22:52:03.585010+0000","last_became_peered":"2024-06-02T22:52:03.585010+0000","last_unstale":"2024-06-02T22:52:09.802540+0000","last_undegraded":"2024-06-02T22:52:09.802540+0000","last_fullsized":"2024-06-02T22:52:09.802540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866426+0000","last_change":"2024-06-02T22:52:03.583268+0000","last_active":"2024-06-02T22:52:09.866426+0000","last_peered":"2024-06-02T22:52:09.866426+0000","last_clean":"2024-06-02T22:52:09.866426+0000","last_became_active":"2024-06-02T22:52:03.582821+0000","last_became_peered":"2024-06-02T22:52:03.582821+0000","last_unstale":"2024-06-02T22:52:09.866426+0000","last_undegraded":"2024-06-02T22:52:09.866426+0000","last_fullsized":"2024-06-02T22:52:09.866426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:04:32.073046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802429+0000","last_change":"2024-06-02T22:52:03.585232+0000","last_active":"2024-06-02T22:52:09.802429+0000","last_peered":"2024-06-02T22:52:09.802429+0000","last_clean":"2024-06-02T22:52:09.802429+0000","last_became_active":"2024-06-02T22:52:03.584909+0000","last_became_peered":"2024-06-02T22:52:03.584909+0000","last_unstale":"2024-06-02T22:52:09.802429+0000","last_undegraded":"2024-06-02T22:52:09.802429+0000","last_fullsized":"2024-06-02T22:52:09.802429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866614+0000","last_change":"2024-06-02T22:52:03.580413+0000","last_active":"2024-06-02T22:52:09.866614+0000","last_peered":"2024-06-02T22:52:09.866614+0000","last_clean":"2024-06-02T22:52:09.866614+0000","last_became_active":"2024-06-02T22:52:03.580073+0000","last_became_peered":"2024-06-02T22:52:03.580073+0000","last_unstale":"2024-06-02T22:52:09.866614+0000","last_undegraded":"2024-06-02T22:52:09.866614+0000","last_fullsized":"2024-06-02T22:52:09.866614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866640+0000","last_change":"2024-06-02T22:52:03.579729+0000","last_active":"2024-06-02T22:52:09.866640+0000","last_peered":"2024-06-02T22:52:09.866640+0000","last_clean":"2024-06-02T22:52:09.866640+0000","last_became_active":"2024-06-02T22:52:03.578651+0000","last_became_peered":"2024-06-02T22:52:03.578651+0000","last_unstale":"2024-06-02T22:52:09.866640+0000","last_undegraded":"2024-06-02T22:52:09.866640+0000","last_fullsized":"2024-06-02T22:52:09.866640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.608916+0000","last_change":"2024-06-02T22:52:03.566626+0000","last_active":"2024-06-02T22:52:08.608916+0000","last_peered":"2024-06-02T22:52:08.608916+0000","last_clean":"2024-06-02T22:52:08.608916+0000","last_became_active":"2024-06-02T22:52:03.566318+0000","last_became_peered":"2024-06-02T22:52:03.566318+0000","last_unstale":"2024-06-02T22:52:08.608916+0000","last_undegraded":"2024-06-02T22:52:08.608916+0000","last_fullsized":"2024-06-02T22:52:08.608916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:30.394685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366167+0000","last_change":"2024-06-02T22:52:03.576084+0000","last_active":"2024-06-02T22:52:09.366167+0000","last_peered":"2024-06-02T22:52:09.366167+0000","last_clean":"2024-06-02T22:52:09.366167+0000","last_became_active":"2024-06-02T22:52:03.574965+0000","last_became_peered":"2024-06-02T22:52:03.574965+0000","last_unstale":"2024-06-02T22:52:09.366167+0000","last_undegraded":"2024-06-02T22:52:09.366167+0000","last_fullsized":"2024-06-02T22:52:09.366167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:08.812577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.610259+0000","last_change":"2024-06-02T22:52:03.566226+0000","last_active":"2024-06-02T22:52:08.610259+0000","last_peered":"2024-06-02T22:52:08.610259+0000","last_clean":"2024-06-02T22:52:08.610259+0000","last_became_active":"2024-06-02T22:52:03.565402+0000","last_became_peered":"2024-06-02T22:52:03.565402+0000","last_unstale":"2024-06-02T22:52:08.610259+0000","last_undegraded":"2024-06-02T22:52:08.610259+0000","last_fullsized":"2024-06-02T22:52:08.610259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:30.466832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867094+0000","last_change":"2024-06-02T22:52:03.586071+0000","last_active":"2024-06-02T22:52:09.867094+0000","last_peered":"2024-06-02T22:52:09.867094+0000","last_clean":"2024-06-02T22:52:09.867094+0000","last_became_active":"2024-06-02T22:52:03.585280+0000","last_became_peered":"2024-06-02T22:52:03.585280+0000","last_unstale":"2024-06-02T22:52:09.867094+0000","last_undegraded":"2024-06-02T22:52:09.867094+0000","last_fullsized":"2024-06-02T22:52:09.867094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:27:02.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866301+0000","last_change":"2024-06-02T22:52:03.579486+0000","last_active":"2024-06-02T22:52:09.866301+0000","last_peered":"2024-06-02T22:52:09.866301+0000","last_clean":"2024-06-02T22:52:09.866301+0000","last_became_active":"2024-06-02T22:52:03.579239+0000","last_became_peered":"2024-06-02T22:52:03.579239+0000","last_unstale":"2024-06-02T22:52:09.866301+0000","last_undegraded":"2024-06-02T22:52:09.866301+0000","last_fullsized":"2024-06-02T22:52:09.866301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866412+0000","last_change":"2024-06-02T22:52:03.575434+0000","last_active":"2024-06-02T22:52:09.866412+0000","last_peered":"2024-06-02T22:52:09.866412+0000","last_clean":"2024-06-02T22:52:09.866412+0000","last_became_active":"2024-06-02T22:52:03.575156+0000","last_became_peered":"2024-06-02T22:52:03.575156+0000","last_unstale":"2024-06-02T22:52:09.866412+0000","last_undegraded":"2024-06-02T22:52:09.866412+0000","last_fullsized":"2024-06-02T22:52:09.866412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867007+0000","last_change":"2024-06-02T22:52:03.573576+0000","last_active":"2024-06-02T22:52:09.867007+0000","last_peered":"2024-06-02T22:52:09.867007+0000","last_clean":"2024-06-02T22:52:09.867007+0000","last_became_active":"2024-06-02T22:52:03.573309+0000","last_became_peered":"2024-06-02T22:52:03.573309+0000","last_unstale":"2024-06-02T22:52:09.867007+0000","last_undegraded":"2024-06-02T22:52:09.867007+0000","last_fullsized":"2024-06-02T22:52:09.867007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:16.007531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.802158+0000","last_change":"2024-06-02T22:52:03.581040+0000","last_active":"2024-06-02T22:52:09.802158+0000","last_peered":"2024-06-02T22:52:09.802158+0000","last_clean":"2024-06-02T22:52:09.802158+0000","last_became_active":"2024-06-02T22:52:03.580786+0000","last_became_peered":"2024-06-02T22:52:03.580786+0000","last_unstale":"2024-06-02T22:52:09.802158+0000","last_undegraded":"2024-06-02T22:52:09.802158+0000","last_fullsized":"2024-06-02T22:52:09.802158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:47:11.449234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609154+0000","last_change":"2024-06-02T22:52:03.564691+0000","last_active":"2024-06-02T22:52:08.609154+0000","last_peered":"2024-06-02T22:52:08.609154+0000","last_clean":"2024-06-02T22:52:08.609154+0000","last_became_active":"2024-06-02T22:52:03.564367+0000","last_became_peered":"2024-06-02T22:52:03.564367+0000","last_unstale":"2024-06-02T22:52:08.609154+0000","last_undegraded":"2024-06-02T22:52:08.609154+0000","last_fullsized":"2024-06-02T22:52:08.609154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:32.549919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609176+0000","last_change":"2024-06-02T22:52:03.579026+0000","last_active":"2024-06-02T22:52:08.609176+0000","last_peered":"2024-06-02T22:52:08.609176+0000","last_clean":"2024-06-02T22:52:08.609176+0000","last_became_active":"2024-06-02T22:52:03.578719+0000","last_became_peered":"2024-06-02T22:52:03.578719+0000","last_unstale":"2024-06-02T22:52:08.609176+0000","last_undegraded":"2024-06-02T22:52:08.609176+0000","last_fullsized":"2024-06-02T22:52:08.609176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:30:53.249502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:08.609690+0000","last_change":"2024-06-02T22:52:03.576967+0000","last_active":"2024-06-02T22:52:08.609690+0000","last_peered":"2024-06-02T22:52:08.609690+0000","last_clean":"2024-06-02T22:52:08.609690+0000","last_became_active":"2024-06-02T22:52:03.576347+0000","last_became_peered":"2024-06-02T22:52:03.576347+0000","last_unstale":"2024-06-02T22:52:08.609690+0000","last_undegraded":"2024-06-02T22:52:08.609690+0000","last_fullsized":"2024-06-02T22:52:08.609690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366345+0000","last_change":"2024-06-02T22:52:03.582428+0000","last_active":"2024-06-02T22:52:09.366345+0000","last_peered":"2024-06-02T22:52:09.366345+0000","last_clean":"2024-06-02T22:52:09.366345+0000","last_became_active":"2024-06-02T22:52:03.582154+0000","last_became_peered":"2024-06-02T22:52:03.582154+0000","last_unstale":"2024-06-02T22:52:09.366345+0000","last_undegraded":"2024-06-02T22:52:09.366345+0000","last_fullsized":"2024-06-02T22:52:09.366345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:32.545502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.801844+0000","last_change":"2024-06-02T22:52:03.577725+0000","last_active":"2024-06-02T22:52:09.801844+0000","last_peered":"2024-06-02T22:52:09.801844+0000","last_clean":"2024-06-02T22:52:09.801844+0000","last_became_active":"2024-06-02T22:52:03.577449+0000","last_became_peered":"2024-06-02T22:52:03.577449+0000","last_unstale":"2024-06-02T22:52:09.801844+0000","last_undegraded":"2024-06-02T22:52:09.801844+0000","last_fullsized":"2024-06-02T22:52:09.801844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:46.515640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365700+0000","last_change":"2024-06-02T22:52:03.578806+0000","last_active":"2024-06-02T22:52:09.365700+0000","last_peered":"2024-06-02T22:52:09.365700+0000","last_clean":"2024-06-02T22:52:09.365700+0000","last_became_active":"2024-06-02T22:52:03.578505+0000","last_became_peered":"2024-06-02T22:52:03.578505+0000","last_unstale":"2024-06-02T22:52:09.365700+0000","last_undegraded":"2024-06-02T22:52:09.365700+0000","last_fullsized":"2024-06-02T22:52:09.365700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:06:12.646236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866425+0000","last_change":"2024-06-02T22:52:03.579621+0000","last_active":"2024-06-02T22:52:09.866425+0000","last_peered":"2024-06-02T22:52:09.866425+0000","last_clean":"2024-06-02T22:52:09.866425+0000","last_became_active":"2024-06-02T22:52:03.579140+0000","last_became_peered":"2024-06-02T22:52:03.579140+0000","last_unstale":"2024-06-02T22:52:09.866425+0000","last_undegraded":"2024-06-02T22:52:09.866425+0000","last_fullsized":"2024-06-02T22:52:09.866425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:12.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.365766+0000","last_change":"2024-06-02T22:52:03.575446+0000","last_active":"2024-06-02T22:52:09.365766+0000","last_peered":"2024-06-02T22:52:09.365766+0000","last_clean":"2024-06-02T22:52:09.365766+0000","last_became_active":"2024-06-02T22:52:03.573953+0000","last_became_peered":"2024-06-02T22:52:03.573953+0000","last_unstale":"2024-06-02T22:52:09.365766+0000","last_undegraded":"2024-06-02T22:52:09.365766+0000","last_fullsized":"2024-06-02T22:52:09.365766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:46:54.240348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866605+0000","last_change":"2024-06-02T22:52:03.585130+0000","last_active":"2024-06-02T22:52:09.866605+0000","last_peered":"2024-06-02T22:52:09.866605+0000","last_clean":"2024-06-02T22:52:09.866605+0000","last_became_active":"2024-06-02T22:52:03.584816+0000","last_became_peered":"2024-06-02T22:52:03.584816+0000","last_unstale":"2024-06-02T22:52:09.866605+0000","last_undegraded":"2024-06-02T22:52:09.866605+0000","last_fullsized":"2024-06-02T22:52:09.866605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:02.241694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.867276+0000","last_change":"2024-06-02T22:52:03.571403+0000","last_active":"2024-06-02T22:52:09.867276+0000","last_peered":"2024-06-02T22:52:09.867276+0000","last_clean":"2024-06-02T22:52:09.867276+0000","last_became_active":"2024-06-02T22:52:03.568977+0000","last_became_peered":"2024-06-02T22:52:03.568977+0000","last_unstale":"2024-06-02T22:52:09.867276+0000","last_undegraded":"2024-06-02T22:52:09.867276+0000","last_fullsized":"2024-06-02T22:52:09.867276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:03:46.379780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.866695+0000","last_change":"2024-06-02T22:52:03.577758+0000","last_active":"2024-06-02T22:52:09.866695+0000","last_peered":"2024-06-02T22:52:09.866695+0000","last_clean":"2024-06-02T22:52:09.866695+0000","last_became_active":"2024-06-02T22:52:03.577260+0000","last_became_peered":"2024-06-02T22:52:03.577260+0000","last_unstale":"2024-06-02T22:52:09.866695+0000","last_undegraded":"2024-06-02T22:52:09.866695+0000","last_fullsized":"2024-06-02T22:52:09.866695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:47.606498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T22:52:09.366256+0000","last_change":"2024-06-02T22:52:03.576942+0000","last_active":"2024-06-02T22:52:09.366256+0000","last_peered":"2024-06-02T22:52:09.366256+0000","last_clean":"2024-06-02T22:52:09.366256+0000","last_became_active":"2024-06-02T22:52:03.576652+0000","last_became_peered":"2024-06-02T22:52:03.576652+0000","last_unstale":"2024-06-02T22:52:09.366256+0000","last_undegraded":"2024-06-02T22:52:09.366256+0000","last_fullsized":"2024-06-02T22:52:09.366256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:02.546463+0000","last_clean_scrub_stamp":"2024-06-02T22:52:02.546463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:44:53.784824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:52:28.342 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T22:52:28.342 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-02T22:52:28.342 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-06-02T22:52:28.342 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-02T22:52:28.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.476+0000 7f934cada640 1 Processor -- start 2024-06-02T22:52:28.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.476+0000 7f934cada640 1 -- start start 2024-06-02T22:52:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.477+0000 7f934cada640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f93480ae910 0x7f934806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.477+0000 7f934cada640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93480cf360 0x7f93480acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.477+0000 7f934cada640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934806d130 con 0x7f934806ea20 2024-06-02T22:52:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.477+0000 7f934cada640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f934806ee90 con 0x7f93480ae910 2024-06-02T22:52:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.477+0000 7f934cada640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f934806d410 con 0x7f93480cf360 2024-06-02T22:52:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.477+0000 7f9346d9d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93480cf360 0x7f93480acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.477+0000 7f934659c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f93480ae910 0x7f934806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.477+0000 7f9345d9b640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f934806ea20 0x7f93480cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:35538/0 (socket says 172.21.15.82:35538) 2024-06-02T22:52:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.477+0000 7f9345d9b640 1 -- 172.21.15.82:0/2419827235 learned_addr learned my addr 172.21.15.82:0/2419827235 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.477+0000 7f9346d9d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93480cf360 0x7f93480acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:42928/0 (socket says 172.21.15.82:42928) 2024-06-02T22:52:28.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.477+0000 7f934659c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f93480ae910 0x7f934806e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45800/0 (socket says 172.21.15.82:45800) 2024-06-02T22:52:28.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.478+0000 7f9346d9d640 1 -- 172.21.15.82:0/2419827235 >> v2:172.21.15.184:3300/0 conn(0x7f93480ae910 msgr2=0x7f934806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:28.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.478+0000 7f9346d9d640 1 --2- 172.21.15.82:0/2419827235 >> v2:172.21.15.184:3300/0 conn(0x7f93480ae910 0x7f934806e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.478+0000 7f9346d9d640 1 -- 172.21.15.82:0/2419827235 >> v1:172.21.15.184:6789/0 conn(0x7f934806ea20 legacy=0x7f93480cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.478+0000 7f9346d9d640 1 -- 172.21.15.82:0/2419827235 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934806d6f0 con 0x7f93480cf360 2024-06-02T22:52:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f9346d9d640 1 --2- 172.21.15.82:0/2419827235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93480cf360 0x7f93480acd40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9340009d90 tx=0x7f934002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb5d38f7fd1cc0c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f934559a640 1 -- 172.21.15.82:0/2419827235 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340031600 con 0x7f93480cf360 2024-06-02T22:52:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f934559a640 1 -- 172.21.15.82:0/2419827235 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93400317a0 con 0x7f93480cf360 2024-06-02T22:52:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f934559a640 1 -- 172.21.15.82:0/2419827235 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340031b70 con 0x7f93480cf360 2024-06-02T22:52:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f934cada640 1 -- 172.21.15.82:0/2419827235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93480cf360 msgr2=0x7f93480acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f934cada640 1 --2- 172.21.15.82:0/2419827235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93480cf360 0x7f93480acd40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9340009d90 tx=0x7f934002a5d0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f934cada640 1 -- 172.21.15.82:0/2419827235 shutdown_connections 2024-06-02T22:52:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f934cada640 1 --2- 172.21.15.82:0/2419827235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93480cf360 0x7f93480acd40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f934cada640 1 --2- 172.21.15.82:0/2419827235 >> v2:172.21.15.184:3300/0 conn(0x7f93480ae910 0x7f934806e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f934cada640 1 -- 172.21.15.82:0/2419827235 >> 172.21.15.82:0/2419827235 conn(0x7f93480b19f0 msgr2=0x7f93480b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f934cada640 1 -- 172.21.15.82:0/2419827235 shutdown_connections 2024-06-02T22:52:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.479+0000 7f934cada640 1 -- 172.21.15.82:0/2419827235 wait complete. 2024-06-02T22:52:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.481+0000 7f934cada640 1 Processor -- start 2024-06-02T22:52:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.481+0000 7f934cada640 1 -- start start 2024-06-02T22:52:28.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.481+0000 7f934cada640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f934806ea20 0x7f934809c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.481+0000 7f934cada640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93480ae910 0x7f93481594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.481+0000 7f934cada640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93480cf360 0x7f934809ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.481+0000 7f934cada640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93480ad280 con 0x7f93480ae910 2024-06-02T22:52:28.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.481+0000 7f934cada640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f93480aecf0 con 0x7f93480cf360 2024-06-02T22:52:28.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.481+0000 7f934cada640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f93480ad400 con 0x7f934806ea20 2024-06-02T22:52:28.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9345d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93480ae910 0x7f93481594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9345d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93480ae910 0x7f93481594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34718/0 (socket says 172.21.15.82:34718) 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9345d9b640 1 -- 172.21.15.82:0/3322021231 learned_addr learned my addr 172.21.15.82:0/3322021231 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f934659c640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f934806ea20 0x7f934809c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9346d9d640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93480cf360 0x7f934809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9345d9b640 1 -- 172.21.15.82:0/3322021231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f934806ea20 msgr2=0x7f934809c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9345d9b640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f934806ea20 0x7f934809c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9345d9b640 1 -- 172.21.15.82:0/3322021231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93480cf360 msgr2=0x7f934809ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9345d9b640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93480cf360 0x7f934809ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9345d9b640 1 -- 172.21.15.82:0/3322021231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934809cc00 con 0x7f93480ae910 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9345d9b640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93480ae910 0x7f93481594a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f933c00c480 tx=0x7f933c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9336ffd640 1 -- 172.21.15.82:0/3322021231 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c017070 con 0x7f93480ae910 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9336ffd640 1 -- 172.21.15.82:0/3322021231 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933c005ce0 con 0x7f93480ae910 2024-06-02T22:52:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f934cada640 1 -- 172.21.15.82:0/3322021231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934809cee0 con 0x7f93480ae910 2024-06-02T22:52:28.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f9336ffd640 1 -- 172.21.15.82:0/3322021231 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c0072f0 con 0x7f93480ae910 2024-06-02T22:52:28.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.482+0000 7f934cada640 1 -- 172.21.15.82:0/3322021231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934809d4a0 con 0x7f93480ae910 2024-06-02T22:52:28.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.483+0000 7f934cada640 1 -- 172.21.15.82:0/3322021231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9348073300 con 0x7f93480ae910 2024-06-02T22:52:28.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.484+0000 7f9336ffd640 1 -- 172.21.15.82:0/3322021231 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f933c01a070 con 0x7f93480ae910 2024-06-02T22:52:28.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.484+0000 7f9336ffd640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f932806be30 0x7f932806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.484+0000 7f9336ffd640 1 -- 172.21.15.82:0/3322021231 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f933c08a430 con 0x7f93480ae910 2024-06-02T22:52:28.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.484+0000 7f934659c640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f932806be30 0x7f932806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.484+0000 7f934659c640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f932806be30 0x7f932806e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f933800bde0 tx=0x7f933800b3a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:28.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.488+0000 7f9336ffd640 1 -- 172.21.15.82:0/3322021231 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9348073300 con 0x7f93480ae910 2024-06-02T22:52:28.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.698+0000 7f934cada640 1 -- 172.21.15.82:0/3322021231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9348068430 con 0x7f93480ae910 2024-06-02T22:52:28.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.698+0000 7f9336ffd640 1 -- 172.21.15.82:0/3322021231 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f933c058460 con 0x7f93480ae910 2024-06-02T22:52:28.699 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:28.699 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-02T22:52:28.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 -- 172.21.15.82:0/3322021231 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f932806be30 msgr2=0x7f932806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f932806be30 0x7f932806e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f933800bde0 tx=0x7f933800b3a0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 -- 172.21.15.82:0/3322021231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93480ae910 msgr2=0x7f93481594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93480ae910 0x7f93481594a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f933c00c480 tx=0x7f933c00c940 comp rx=0 tx=0).stop 2024-06-02T22:52:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 -- 172.21.15.82:0/3322021231 shutdown_connections 2024-06-02T22:52:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f932806be30 0x7f932806e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93480cf360 0x7f934809ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93480ae910 0x7f93481594a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 --2- 172.21.15.82:0/3322021231 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f934806ea20 0x7f934809c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 -- 172.21.15.82:0/3322021231 >> 172.21.15.82:0/3322021231 conn(0x7f93480b19f0 msgr2=0x7f93480ae1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 -- 172.21.15.82:0/3322021231 shutdown_connections 2024-06-02T22:52:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.700+0000 7f934cada640 1 -- 172.21.15.82:0/3322021231 wait complete. 2024-06-02T22:52:28.711 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-06-02T22:52:28.711 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:52:28.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.811+0000 7fc19f190640 1 Processor -- start 2024-06-02T22:52:28.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.811+0000 7fc19f190640 1 -- start start 2024-06-02T22:52:28.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19f190640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc19815c7f0 0x7fc1980cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19f190640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1980b4530 0x7fc1980ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19f190640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1980725f0 con 0x7fc198156830 2024-06-02T22:52:28.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19f190640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc1980b3090 con 0x7fc1980b4530 2024-06-02T22:52:28.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19f190640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc1980728d0 con 0x7fc19815c7f0 2024-06-02T22:52:28.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19d72d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1980b4530 0x7fc1980ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19cf2c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc198156830 0x7fc198071bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48210/0 (socket says 172.21.15.82:48210) 2024-06-02T22:52:28.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19cf2c640 1 -- 172.21.15.82:0/315309383 learned_addr learned my addr 172.21.15.82:0/315309383 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:28.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc18ffff640 1 --2- 172.21.15.82:0/315309383 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc19815c7f0 0x7fc1980cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19d72d640 1 -- 172.21.15.82:0/315309383 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc19815c7f0 msgr2=0x7fc1980cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:28.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19d72d640 1 --2- 172.21.15.82:0/315309383 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc19815c7f0 0x7fc1980cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19d72d640 1 -- 172.21.15.82:0/315309383 >> v1:172.21.15.82:6789/0 conn(0x7fc198156830 legacy=0x7fc198071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc18f7fe640 1 -- 172.21.15.82:0/315309383 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3824880950 0 0) 0x7fc1980725f0 con 0x7fc198156830 2024-06-02T22:52:28.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.812+0000 7fc19d72d640 1 -- 172.21.15.82:0/315309383 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc198072bb0 con 0x7fc1980b4530 2024-06-02T22:52:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.813+0000 7fc19d72d640 1 --2- 172.21.15.82:0/315309383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1980b4530 0x7fc1980ccbb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc190009d90 tx=0x7fc19002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46452ce7b62616b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.813+0000 7fc18f7fe640 1 -- 172.21.15.82:0/315309383 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190007740 con 0x7fc1980b4530 2024-06-02T22:52:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.813+0000 7fc18f7fe640 1 -- 172.21.15.82:0/315309383 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1900078e0 con 0x7fc1980b4530 2024-06-02T22:52:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.813+0000 7fc18f7fe640 1 -- 172.21.15.82:0/315309383 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190007cb0 con 0x7fc1980b4530 2024-06-02T22:52:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.813+0000 7fc19f190640 1 -- 172.21.15.82:0/315309383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1980b4530 msgr2=0x7fc1980ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.813+0000 7fc19f190640 1 --2- 172.21.15.82:0/315309383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1980b4530 0x7fc1980ccbb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc190009d90 tx=0x7fc19002a660 comp rx=0 tx=0).stop 2024-06-02T22:52:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.814+0000 7fc19f190640 1 -- 172.21.15.82:0/315309383 shutdown_connections 2024-06-02T22:52:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.814+0000 7fc19f190640 1 --2- 172.21.15.82:0/315309383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1980b4530 0x7fc1980ccbb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.814+0000 7fc19f190640 1 --2- 172.21.15.82:0/315309383 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc19815c7f0 0x7fc1980cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.814+0000 7fc19f190640 1 -- 172.21.15.82:0/315309383 >> 172.21.15.82:0/315309383 conn(0x7fc1980b19f0 msgr2=0x7fc1980b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:28.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.814+0000 7fc19f190640 1 -- 172.21.15.82:0/315309383 shutdown_connections 2024-06-02T22:52:28.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.814+0000 7fc19f190640 1 -- 172.21.15.82:0/315309383 wait complete. 2024-06-02T22:52:28.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.815+0000 7fc19f190640 1 Processor -- start 2024-06-02T22:52:28.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.815+0000 7fc19f190640 1 -- start start 2024-06-02T22:52:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc19f190640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1980b4530 0x7fc198154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc19f190640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc198156830 0x7fc19814dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc19f190640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc19815c7f0 0x7fc1980ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc19f190640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc198165cc0 con 0x7fc198156830 2024-06-02T22:52:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc19f190640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc198072300 con 0x7fc1980b4530 2024-06-02T22:52:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc19f190640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc198165e40 con 0x7fc19815c7f0 2024-06-02T22:52:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc198156830 0x7fc19814dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc198156830 0x7fc19814dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34742/0 (socket says 172.21.15.82:34742) 2024-06-02T22:52:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18ffff640 1 -- 172.21.15.82:0/2431776628 learned_addr learned my addr 172.21.15.82:0/2431776628 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc19d72d640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc19815c7f0 0x7fc1980ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc19cf2c640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1980b4530 0x7fc198154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18ffff640 1 -- 172.21.15.82:0/2431776628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc19815c7f0 msgr2=0x7fc1980ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18ffff640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc19815c7f0 0x7fc1980ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18ffff640 1 -- 172.21.15.82:0/2431776628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1980b4530 msgr2=0x7fc198154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:28.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18ffff640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1980b4530 0x7fc198154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:28.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18ffff640 1 -- 172.21.15.82:0/2431776628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc198155180 con 0x7fc198156830 2024-06-02T22:52:28.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18ffff640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc198156830 0x7fc19814dbd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc18800d5f0 tx=0x7fc18800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:28.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18d7fa640 1 -- 172.21.15.82:0/2431776628 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880125f0 con 0x7fc198156830 2024-06-02T22:52:28.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18d7fa640 1 -- 172.21.15.82:0/2431776628 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188019070 con 0x7fc198156830 2024-06-02T22:52:28.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc19f190640 1 -- 172.21.15.82:0/2431776628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc198153ba0 con 0x7fc198156830 2024-06-02T22:52:28.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc18d7fa640 1 -- 172.21.15.82:0/2431776628 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880129d0 con 0x7fc198156830 2024-06-02T22:52:28.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.816+0000 7fc19f190640 1 -- 172.21.15.82:0/2431776628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc198154160 con 0x7fc198156830 2024-06-02T22:52:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.817+0000 7fc19f190640 1 -- 172.21.15.82:0/2431776628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc198068430 con 0x7fc198156830 2024-06-02T22:52:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.818+0000 7fc18d7fa640 1 -- 172.21.15.82:0/2431776628 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc188012b70 con 0x7fc198156830 2024-06-02T22:52:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.818+0000 7fc18d7fa640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc18406be30 0x7fc18406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.818+0000 7fc19cf2c640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc18406be30 0x7fc18406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.818+0000 7fc18d7fa640 1 -- 172.21.15.82:0/2431776628 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc18808b450 con 0x7fc198156830 2024-06-02T22:52:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.819+0000 7fc19cf2c640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc18406be30 0x7fc18406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc194000f60 tx=0x7fc194007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:28.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:28.823+0000 7fc18d7fa640 1 -- 172.21.15.82:0/2431776628 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc188059470 con 0x7fc198156830 2024-06-02T22:52:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.031+0000 7fc19f190640 1 -- 172.21.15.82:0/2431776628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1980ad070 con 0x7fc198156830 2024-06-02T22:52:29.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.031+0000 7fc18d7fa640 1 -- 172.21.15.82:0/2431776628 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7fc18805d770 con 0x7fc198156830 2024-06-02T22:52:29.032 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:29.032 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/598338197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":598338197},{"type":"v1","addr":"172.21.15.184:6835","nonce":598338197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2379089503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2379089503},{"type":"v1","addr":"172.21.15.82:6836","nonce":2379089503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:02.905481+0000","modified":"2024-06-02T22:52:21.989508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1449064574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1449064574},{"type":"v1","addr":"172.21.15.82:6837","nonce":1449064574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-06-02T22:52:29.032 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-06-02T22:52:29.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 -- 172.21.15.82:0/2431776628 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc18406be30 msgr2=0x7fc18406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc18406be30 0x7fc18406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc194000f60 tx=0x7fc194007d50 comp rx=0 tx=0).stop 2024-06-02T22:52:29.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 -- 172.21.15.82:0/2431776628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc198156830 msgr2=0x7fc19814dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc198156830 0x7fc19814dbd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc18800d5f0 tx=0x7fc18800dab0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 -- 172.21.15.82:0/2431776628 shutdown_connections 2024-06-02T22:52:29.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc18406be30 0x7fc18406e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc19815c7f0 0x7fc1980ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc198156830 0x7fc19814dbd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 --2- 172.21.15.82:0/2431776628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1980b4530 0x7fc198154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 -- 172.21.15.82:0/2431776628 >> 172.21.15.82:0/2431776628 conn(0x7fc1980b19f0 msgr2=0x7fc1980b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:29.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 -- 172.21.15.82:0/2431776628 shutdown_connections 2024-06-02T22:52:29.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.033+0000 7fc19f190640 1 -- 172.21.15.82:0/2431776628 wait complete. 2024-06-02T22:52:29.044 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:52:29.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.143+0000 7f8f0c812640 1 Processor -- start 2024-06-02T22:52:29.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.143+0000 7f8f0c812640 1 -- start start 2024-06-02T22:52:29.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.144+0000 7f8f0c812640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8f080ae910 0x7f8f0806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.144+0000 7f8f0c812640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f0806d130 con 0x7f8f080cf360 2024-06-02T22:52:29.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.144+0000 7f8f0c812640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f0806d410 con 0x7f8f0806ea20 2024-06-02T22:52:29.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.144+0000 7f8f0c812640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8f0806ee90 con 0x7f8f080ae910 2024-06-02T22:52:29.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.144+0000 7f8f0659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8f080ae910 0x7f8f0806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.144+0000 7f8f06d9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8f080cf360 0x7f8f080acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48216/0 (socket says 172.21.15.82:48216) 2024-06-02T22:52:29.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.144+0000 7f8f0659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8f080ae910 0x7f8f0806e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34750/0 (socket says 172.21.15.82:34750) 2024-06-02T22:52:29.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.144+0000 7f8f06d9d640 1 -- 172.21.15.82:0/3588944277 learned_addr learned my addr 172.21.15.82:0/3588944277 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:29.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.144+0000 7f8f0659c640 1 -- 172.21.15.82:0/3588944277 >> v1:172.21.15.184:6789/0 conn(0x7f8f0806ea20 legacy=0x7f8f080cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.144+0000 7f8f0659c640 1 -- 172.21.15.82:0/3588944277 >> v1:172.21.15.82:6789/0 conn(0x7f8f080cf360 legacy=0x7f8f080acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.144+0000 7f8f0659c640 1 -- 172.21.15.82:0/3588944277 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0806d6f0 con 0x7f8f080ae910 2024-06-02T22:52:29.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.145+0000 7f8f0659c640 1 --2- 172.21.15.82:0/3588944277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f080ae910 0x7f8f0806e4e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80097a0 tx=0x7f8ef802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375ab6396b78d533 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:29.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.145+0000 7f8f05d9b640 1 -- 172.21.15.82:0/3588944277 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8037070 con 0x7f8f080ae910 2024-06-02T22:52:29.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.145+0000 7f8f05d9b640 1 -- 172.21.15.82:0/3588944277 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef8032440 con 0x7f8f080ae910 2024-06-02T22:52:29.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.145+0000 7f8f05d9b640 1 -- 172.21.15.82:0/3588944277 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8032810 con 0x7f8f080ae910 2024-06-02T22:52:29.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.146+0000 7f8f0c812640 1 -- 172.21.15.82:0/3588944277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f080ae910 msgr2=0x7f8f0806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.146+0000 7f8f0c812640 1 --2- 172.21.15.82:0/3588944277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f080ae910 0x7f8f0806e4e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80097a0 tx=0x7f8ef802a1a0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.146+0000 7f8f0c812640 1 -- 172.21.15.82:0/3588944277 shutdown_connections 2024-06-02T22:52:29.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.146+0000 7f8f0c812640 1 --2- 172.21.15.82:0/3588944277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f080ae910 0x7f8f0806e4e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.146+0000 7f8f0c812640 1 -- 172.21.15.82:0/3588944277 >> 172.21.15.82:0/3588944277 conn(0x7f8f080b19f0 msgr2=0x7f8f080b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:29.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.146+0000 7f8f0c812640 1 -- 172.21.15.82:0/3588944277 shutdown_connections 2024-06-02T22:52:29.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.146+0000 7f8f0c812640 1 -- 172.21.15.82:0/3588944277 wait complete. 2024-06-02T22:52:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.147+0000 7f8f0c812640 1 Processor -- start 2024-06-02T22:52:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.147+0000 7f8f0c812640 1 -- start start 2024-06-02T22:52:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0c812640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0806ea20 0x7f8f08152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0c812640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f080ae910 0x7f8f08153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0c812640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f080cf360 0x7f8f080cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0c812640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8f080ad450 con 0x7f8f0806ea20 2024-06-02T22:52:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0c812640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8f080aecf0 con 0x7f8f080cf360 2024-06-02T22:52:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0c812640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8f080ad5d0 con 0x7f8f080ae910 2024-06-02T22:52:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0806ea20 0x7f8f08152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0806ea20 0x7f8f08152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34762/0 (socket says 172.21.15.82:34762) 2024-06-02T22:52:29.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0659c640 1 -- 172.21.15.82:0/1064700094 learned_addr learned my addr 172.21.15.82:0/1064700094 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0659c640 1 -- 172.21.15.82:0/1064700094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f080ae910 msgr2=0x7f8f08153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0659c640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f080ae910 0x7f8f08153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0659c640 1 -- 172.21.15.82:0/1064700094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f080cf360 msgr2=0x7f8f080cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f06d9d640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f080cf360 0x7f8f080cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0659c640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f080cf360 0x7f8f080cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0659c640 1 -- 172.21.15.82:0/1064700094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f081530e0 con 0x7f8f0806ea20 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.148+0000 7f8f0659c640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0806ea20 0x7f8f08152ba0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8035040 tx=0x7f8ef80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.149+0000 7f8eff7fe640 1 -- 172.21.15.82:0/1064700094 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8037040 con 0x7f8f0806ea20 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.149+0000 7f8eff7fe640 1 -- 172.21.15.82:0/1064700094 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef8030770 con 0x7f8f0806ea20 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.149+0000 7f8f0c812640 1 -- 172.21.15.82:0/1064700094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f08154770 con 0x7f8f0806ea20 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.149+0000 7f8eff7fe640 1 -- 172.21.15.82:0/1064700094 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8030b80 con 0x7f8f0806ea20 2024-06-02T22:52:29.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.149+0000 7f8f0c812640 1 -- 172.21.15.82:0/1064700094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f081f45d0 con 0x7f8f0806ea20 2024-06-02T22:52:29.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.150+0000 7f8f0c812640 1 -- 172.21.15.82:0/1064700094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f08068430 con 0x7f8f0806ea20 2024-06-02T22:52:29.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.150+0000 7f8eff7fe640 1 -- 172.21.15.82:0/1064700094 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ef8044020 con 0x7f8f0806ea20 2024-06-02T22:52:29.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.151+0000 7f8eff7fe640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ee806be60 0x7f8ee806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.151+0000 7f8eff7fe640 1 -- 172.21.15.82:0/1064700094 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8ef80ab740 con 0x7f8f0806ea20 2024-06-02T22:52:29.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.151+0000 7f8efdd9b640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ee806be60 0x7f8ee806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.151+0000 7f8efdd9b640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ee806be60 0x7f8ee806e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0000f60 tx=0x7f8ef00079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:29.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.155+0000 7f8eff7fe640 1 -- 172.21.15.82:0/1064700094 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8ef8032e20 con 0x7f8f0806ea20 2024-06-02T22:52:29.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.366+0000 7f8f0c812640 1 -- 172.21.15.82:0/1064700094 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f081f40c0 con 0x7f8f0806ea20 2024-06-02T22:52:29.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.366+0000 7f8eff7fe640 1 -- 172.21.15.82:0/1064700094 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f8ef80313a0 con 0x7f8f0806ea20 2024-06-02T22:52:29.366 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:29.366 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/598338197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":598338197},{"type":"v1","addr":"172.21.15.184:6835","nonce":598338197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2379089503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2379089503},{"type":"v1","addr":"172.21.15.82:6836","nonce":2379089503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:02.905481+0000","modified":"2024-06-02T22:52:21.989508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1449064574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1449064574},{"type":"v1","addr":"172.21.15.82:6837","nonce":1449064574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-06-02T22:52:29.367 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-06-02T22:52:29.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.368+0000 7f8f0c812640 1 -- 172.21.15.82:0/1064700094 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ee806be60 msgr2=0x7f8ee806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.368+0000 7f8f0c812640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ee806be60 0x7f8ee806e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0000f60 tx=0x7f8ef00079b0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.368+0000 7f8f0c812640 1 -- 172.21.15.82:0/1064700094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0806ea20 msgr2=0x7f8f08152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.368+0000 7f8f0c812640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0806ea20 0x7f8f08152ba0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8035040 tx=0x7f8ef80046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.368+0000 7f8f0c812640 1 -- 172.21.15.82:0/1064700094 shutdown_connections 2024-06-02T22:52:29.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.368+0000 7f8f0c812640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ee806be60 0x7f8ee806e320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.368+0000 7f8f0c812640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f080cf360 0x7f8f080cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.368+0000 7f8f0c812640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f080ae910 0x7f8f08153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.368+0000 7f8f0c812640 1 --2- 172.21.15.82:0/1064700094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f0806ea20 0x7f8f08152ba0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.368+0000 7f8f0c812640 1 -- 172.21.15.82:0/1064700094 >> 172.21.15.82:0/1064700094 conn(0x7f8f080b19f0 msgr2=0x7f8f08156870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:29.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.368+0000 7f8f0c812640 1 -- 172.21.15.82:0/1064700094 shutdown_connections 2024-06-02T22:52:29.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.369+0000 7f8f0c812640 1 -- 172.21.15.82:0/1064700094 wait complete. 2024-06-02T22:52:29.379 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:29.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.478+0000 7fd3d2ec3640 1 Processor -- start 2024-06-02T22:52:29.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.479+0000 7fd3d2ec3640 1 -- start start 2024-06-02T22:52:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.479+0000 7fd3d2ec3640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd3cc0d2680 0x7fd3cc15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.479+0000 7fd3d2ec3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3cc0d0ad0 con 0x7fd3cc0cef70 2024-06-02T22:52:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.479+0000 7fd3d2ec3640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3cc15f890 con 0x7fd3cc0d1fc0 2024-06-02T22:52:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.479+0000 7fd3d2ec3640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fd3cc0d13e0 con 0x7fd3cc0d2680 2024-06-02T22:52:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3d1460640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd3cc0cef70 0x7fd3cc0cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48218/0 (socket says 172.21.15.82:48218) 2024-06-02T22:52:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3d1460640 1 -- 172.21.15.82:0/4027920255 learned_addr learned my addr 172.21.15.82:0/4027920255 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3d0c5f640 1 --2- 172.21.15.82:0/4027920255 >> v2:172.21.15.184:3300/0 conn(0x7fd3cc0d2680 0x7fd3cc15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517912526 0 0) 0x7fd3cc0d0ad0 con 0x7fd3cc0cef70 2024-06-02T22:52:29.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3b4003520 con 0x7fd3cc0cef70 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3265731071 0 0) 0x7fd3b4003520 con 0x7fd3cc0cef70 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 >> v2:172.21.15.184:3300/0 conn(0x7fd3cc0d2680 msgr2=0x7fd3cc15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 --2- 172.21.15.82:0/4027920255 >> v2:172.21.15.184:3300/0 conn(0x7fd3cc0d2680 0x7fd3cc15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 >> v1:172.21.15.184:6789/0 conn(0x7fd3cc0d1fc0 legacy=0x7fd3cc0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3cc0d0d90 con 0x7fd3cc0cef70 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fd3c4001670 con 0x7fd3cc0cef70 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 >> v1:172.21.15.82:6789/0 conn(0x7fd3cc0cef70 legacy=0x7fd3cc0cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 --2- 172.21.15.82:0/4027920255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3b40039b0 0x7fd3b4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 --2- 172.21.15.82:0/4027920255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3b4004800 0x7fd3b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 --2- 172.21.15.82:0/4027920255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 0x7fd3b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc0d13e0 con 0x7fd3b40051c0 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b400c090 con 0x7fd3b4004800 2024-06-02T22:52:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b400c290 con 0x7fd3b40039b0 2024-06-02T22:52:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3d1460640 1 --2- 172.21.15.82:0/4027920255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 0x7fd3b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3d0c5f640 1 --2- 172.21.15.82:0/4027920255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3b40039b0 0x7fd3b4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.480+0000 7fd3cbfff640 1 --2- 172.21.15.82:0/4027920255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3b4004800 0x7fd3b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.481+0000 7fd3d1460640 1 -- 172.21.15.82:0/4027920255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3b40039b0 msgr2=0x7fd3b4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.481+0000 7fd3d1460640 1 --2- 172.21.15.82:0/4027920255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3b40039b0 0x7fd3b4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.481+0000 7fd3d1460640 1 -- 172.21.15.82:0/4027920255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3b4004800 msgr2=0x7fd3b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.481+0000 7fd3d1460640 1 --2- 172.21.15.82:0/4027920255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3b4004800 0x7fd3b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.481+0000 7fd3d1460640 1 -- 172.21.15.82:0/4027920255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b4003520 con 0x7fd3b40051c0 2024-06-02T22:52:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.481+0000 7fd3d1460640 1 -- 172.21.15.82:0/4027920255 reap_dead start 2024-06-02T22:52:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.481+0000 7fd3d1460640 1 --2- 172.21.15.82:0/4027920255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 0x7fd3b400b9c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400c240 tx=0x7fd3b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee92bca00cfca38 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.482+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4007d10 con 0x7fd3b40051c0 2024-06-02T22:52:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.482+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c4005ad0 con 0x7fd3b40051c0 2024-06-02T22:52:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.482+0000 7fd3cb7fe640 1 -- 172.21.15.82:0/4027920255 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4007070 con 0x7fd3b40051c0 2024-06-02T22:52:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.482+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/4027920255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 msgr2=0x7fd3b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.482+0000 7fd3d2ec3640 1 --2- 172.21.15.82:0/4027920255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 0x7fd3b400b9c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400c240 tx=0x7fd3b4005830 comp rx=0 tx=0).stop 2024-06-02T22:52:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.482+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/4027920255 shutdown_connections 2024-06-02T22:52:29.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.482+0000 7fd3d2ec3640 1 --2- 172.21.15.82:0/4027920255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 0x7fd3b400b9c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.482+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/4027920255 >> 172.21.15.82:0/4027920255 conn(0x7fd3cc09d3f0 msgr2=0x7fd3cc0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.482+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/4027920255 shutdown_connections 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.482+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/4027920255 wait complete. 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.484+0000 7fd3d2ec3640 1 Processor -- start 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.484+0000 7fd3d2ec3640 1 -- start start 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.484+0000 7fd3d2ec3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 0x7fd3cc159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.484+0000 7fd3d2ec3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3cc1f4420 0x7fd3cc1f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.484+0000 7fd3d2ec3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3cc15b350 0x7fd3cc15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.484+0000 7fd3d2ec3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc0d4f00 con 0x7fd3b40051c0 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.484+0000 7fd3d2ec3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc0d2400 con 0x7fd3cc1f4420 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.484+0000 7fd3d2ec3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd3cc0d1870 con 0x7fd3cc15b350 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d0c5f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 0x7fd3cc159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d0c5f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 0x7fd3cc159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34766/0 (socket says 172.21.15.82:34766) 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d0c5f640 1 -- 172.21.15.82:0/2169673213 learned_addr learned my addr 172.21.15.82:0/2169673213 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d0c5f640 1 -- 172.21.15.82:0/2169673213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3cc15b350 msgr2=0x7fd3cc15b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3cbfff640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3cc1f4420 0x7fd3cc1f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d1460640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3cc15b350 0x7fd3cc15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d0c5f640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3cc15b350 0x7fd3cc15b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d0c5f640 1 -- 172.21.15.82:0/2169673213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3cc1f4420 msgr2=0x7fd3cc1f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d0c5f640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3cc1f4420 0x7fd3cc1f4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d0c5f640 1 -- 172.21.15.82:0/2169673213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3cc15aa50 con 0x7fd3b40051c0 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3cbfff640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3cc1f4420 0x7fd3cc1f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d1460640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3cc15b350 0x7fd3cc15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d0c5f640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 0x7fd3cc159e90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0118e0 tx=0x7fd3bc011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3c97fa640 1 -- 172.21.15.82:0/2169673213 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00faf0 con 0x7fd3b40051c0 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3c97fa640 1 -- 172.21.15.82:0/2169673213 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00fc90 con 0x7fd3b40051c0 2024-06-02T22:52:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/2169673213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3cc15bec0 con 0x7fd3b40051c0 2024-06-02T22:52:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3c97fa640 1 -- 172.21.15.82:0/2169673213 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc014440 con 0x7fd3b40051c0 2024-06-02T22:52:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.485+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/2169673213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3cc15c480 con 0x7fd3b40051c0 2024-06-02T22:52:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.486+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/2169673213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3cc068430 con 0x7fd3b40051c0 2024-06-02T22:52:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.487+0000 7fd3c97fa640 1 -- 172.21.15.82:0/2169673213 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3bc012040 con 0x7fd3b40051c0 2024-06-02T22:52:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.487+0000 7fd3c97fa640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3b806be30 0x7fd3b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.487+0000 7fd3c97fa640 1 -- 172.21.15.82:0/2169673213 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd3bc08b8b0 con 0x7fd3b40051c0 2024-06-02T22:52:29.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.487+0000 7fd3cbfff640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3b806be30 0x7fd3b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.487+0000 7fd3cbfff640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3b806be30 0x7fd3b806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0000f80 tx=0x7fd3c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:29.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.492+0000 7fd3c97fa640 1 -- 172.21.15.82:0/2169673213 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd3bc019030 con 0x7fd3b40051c0 2024-06-02T22:52:29.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.666+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/2169673213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3cc0d04e0 con 0x7fd3b40051c0 2024-06-02T22:52:29.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.667+0000 7fd3c97fa640 1 -- 172.21.15.82:0/2169673213 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7fd3bc059f20 con 0x7fd3b40051c0 2024-06-02T22:52:29.667 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:29.668 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:07.942945+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:29.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.669+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/2169673213 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3b806be30 msgr2=0x7fd3b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.669+0000 7fd3d2ec3640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3b806be30 0x7fd3b806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0000f80 tx=0x7fd3c0009040 comp rx=0 tx=0).stop 2024-06-02T22:52:29.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.669+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/2169673213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 msgr2=0x7fd3cc159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.669+0000 7fd3d2ec3640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 0x7fd3cc159e90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0118e0 tx=0x7fd3bc011da0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.670+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/2169673213 shutdown_connections 2024-06-02T22:52:29.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.670+0000 7fd3d2ec3640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd3b806be30 0x7fd3b806e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.670+0000 7fd3d2ec3640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3cc15b350 0x7fd3cc15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.670+0000 7fd3d2ec3640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3cc1f4420 0x7fd3cc1f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.670+0000 7fd3d2ec3640 1 --2- 172.21.15.82:0/2169673213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3b40051c0 0x7fd3cc159e90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.670+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/2169673213 >> 172.21.15.82:0/2169673213 conn(0x7fd3cc09d3f0 msgr2=0x7fd3cc161130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:29.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.670+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/2169673213 shutdown_connections 2024-06-02T22:52:29.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.670+0000 7fd3d2ec3640 1 -- 172.21.15.82:0/2169673213 wait complete. 2024-06-02T22:52:29.681 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:52:29.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.780+0000 7fbef0e58640 1 Processor -- start 2024-06-02T22:52:29.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.780+0000 7fbef0e58640 1 -- start start 2024-06-02T22:52:29.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.781+0000 7fbef0e58640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbeec0d2680 0x7fbeec15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.781+0000 7fbef0e58640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbeec0d1fc0 0x7fbeec0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.781+0000 7fbef0e58640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbeec161fa0 0x7fbeec162430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.781+0000 7fbef0e58640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbeec0d13e0 con 0x7fbeec161fa0 2024-06-02T22:52:29.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.781+0000 7fbef0e58640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fbeec0d2fa0 con 0x7fbeec0d1fc0 2024-06-02T22:52:29.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.781+0000 7fbef0e58640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbeec0d0ad0 con 0x7fbeec0d2680 2024-06-02T22:52:29.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.781+0000 7fbeead9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbeec161fa0 0x7fbeec162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.781+0000 7fbeead9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbeec161fa0 0x7fbeec162430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34768/0 (socket says 172.21.15.82:34768) 2024-06-02T22:52:29.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.781+0000 7fbeead9d640 1 -- 172.21.15.82:0/3285556866 learned_addr learned my addr 172.21.15.82:0/3285556866 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:29.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.781+0000 7fbee1d9b640 1 --2- 172.21.15.82:0/3285556866 >> v2:172.21.15.184:3300/0 conn(0x7fbeec0d1fc0 0x7fbeec0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.782+0000 7fbeea59c640 1 --2- 172.21.15.82:0/3285556866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbeec0d2680 0x7fbeec15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.782+0000 7fbeead9d640 1 -- 172.21.15.82:0/3285556866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbeec0d2680 msgr2=0x7fbeec15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:29.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.782+0000 7fbeead9d640 1 --2- 172.21.15.82:0/3285556866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbeec0d2680 0x7fbeec15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.782+0000 7fbeead9d640 1 -- 172.21.15.82:0/3285556866 >> v2:172.21.15.184:3300/0 conn(0x7fbeec0d1fc0 msgr2=0x7fbeec0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:29.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.782+0000 7fbeead9d640 1 --2- 172.21.15.82:0/3285556866 >> v2:172.21.15.184:3300/0 conn(0x7fbeec0d1fc0 0x7fbeec0d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.782+0000 7fbeead9d640 1 -- 172.21.15.82:0/3285556866 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeec15f890 con 0x7fbeec161fa0 2024-06-02T22:52:29.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.782+0000 7fbee1d9b640 1 --2- 172.21.15.82:0/3285556866 >> v2:172.21.15.184:3300/0 conn(0x7fbeec0d1fc0 0x7fbeec0d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:29.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.782+0000 7fbeead9d640 1 --2- 172.21.15.82:0/3285556866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec161fa0 0x7fbeec162430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbeec08cb20 tx=0x7fbee402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f724bcf53d6e374 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:29.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.782+0000 7fbee9d9b640 1 -- 172.21.15.82:0/3285556866 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4036070 con 0x7fbeec161fa0 2024-06-02T22:52:29.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.783+0000 7fbee9d9b640 1 -- 172.21.15.82:0/3285556866 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee4031600 con 0x7fbeec161fa0 2024-06-02T22:52:29.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.783+0000 7fbee9d9b640 1 -- 172.21.15.82:0/3285556866 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee40319d0 con 0x7fbeec161fa0 2024-06-02T22:52:29.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.783+0000 7fbef0e58640 1 -- 172.21.15.82:0/3285556866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec161fa0 msgr2=0x7fbeec162430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.783+0000 7fbef0e58640 1 --2- 172.21.15.82:0/3285556866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec161fa0 0x7fbeec162430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbeec08cb20 tx=0x7fbee402a6a0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.783+0000 7fbef0e58640 1 -- 172.21.15.82:0/3285556866 shutdown_connections 2024-06-02T22:52:29.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.783+0000 7fbef0e58640 1 --2- 172.21.15.82:0/3285556866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec161fa0 0x7fbeec162430 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.783+0000 7fbef0e58640 1 --2- 172.21.15.82:0/3285556866 >> v2:172.21.15.184:3300/0 conn(0x7fbeec0d1fc0 0x7fbeec0d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.783+0000 7fbef0e58640 1 --2- 172.21.15.82:0/3285556866 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbeec0d2680 0x7fbeec15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.783+0000 7fbef0e58640 1 -- 172.21.15.82:0/3285556866 >> 172.21.15.82:0/3285556866 conn(0x7fbeec09d3f0 msgr2=0x7fbeec0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:29.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.783+0000 7fbef0e58640 1 -- 172.21.15.82:0/3285556866 shutdown_connections 2024-06-02T22:52:29.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.783+0000 7fbef0e58640 1 -- 172.21.15.82:0/3285556866 wait complete. 2024-06-02T22:52:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.785+0000 7fbef0e58640 1 Processor -- start 2024-06-02T22:52:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.785+0000 7fbef0e58640 1 -- start start 2024-06-02T22:52:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.785+0000 7fbef0e58640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec0d1fc0 0x7fbeec0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.785+0000 7fbef0e58640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbeec0d2680 0x7fbeec1f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.785+0000 7fbef0e58640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec161fa0 0x7fbeec0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.785+0000 7fbef0e58640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec0d2400 con 0x7fbeec0d1fc0 2024-06-02T22:52:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.785+0000 7fbef0e58640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec0d1070 con 0x7fbeec161fa0 2024-06-02T22:52:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.785+0000 7fbef0e58640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbeec0d4f00 con 0x7fbeec0d2680 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.785+0000 7fbeea59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec0d1fc0 0x7fbeec0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.785+0000 7fbeea59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec0d1fc0 0x7fbeec0b8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34776/0 (socket says 172.21.15.82:34776) 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.785+0000 7fbeea59c640 1 -- 172.21.15.82:0/1863792679 learned_addr learned my addr 172.21.15.82:0/1863792679 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbeead9d640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec161fa0 0x7fbeec0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbee1d9b640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbeec0d2680 0x7fbeec1f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbeea59c640 1 -- 172.21.15.82:0/1863792679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbeec0d2680 msgr2=0x7fbeec1f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbeea59c640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbeec0d2680 0x7fbeec1f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbeea59c640 1 -- 172.21.15.82:0/1863792679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec161fa0 msgr2=0x7fbeec0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbeea59c640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec161fa0 0x7fbeec0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbeea59c640 1 -- 172.21.15.82:0/1863792679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeec15c2c0 con 0x7fbeec0d1fc0 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbeea59c640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec0d1fc0 0x7fbeec0b8b20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00d800 tx=0x7fbedc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbee37fe640 1 -- 172.21.15.82:0/1863792679 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00b6c0 con 0x7fbeec0d1fc0 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbee37fe640 1 -- 172.21.15.82:0/1863792679 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbedc019070 con 0x7fbeec0d1fc0 2024-06-02T22:52:29.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbef0e58640 1 -- 172.21.15.82:0/1863792679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeec15c5a0 con 0x7fbeec0d1fc0 2024-06-02T22:52:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbee37fe640 1 -- 172.21.15.82:0/1863792679 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00ba80 con 0x7fbeec0d1fc0 2024-06-02T22:52:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.786+0000 7fbef0e58640 1 -- 172.21.15.82:0/1863792679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeec15cb60 con 0x7fbeec0d1fc0 2024-06-02T22:52:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.787+0000 7fbef0e58640 1 -- 172.21.15.82:0/1863792679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeec068430 con 0x7fbeec0d1fc0 2024-06-02T22:52:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.788+0000 7fbee37fe640 1 -- 172.21.15.82:0/1863792679 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbedc00bc20 con 0x7fbeec0d1fc0 2024-06-02T22:52:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.788+0000 7fbee37fe640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbecc06be30 0x7fbecc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.788+0000 7fbee37fe640 1 -- 172.21.15.82:0/1863792679 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbedc08b670 con 0x7fbeec0d1fc0 2024-06-02T22:52:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.788+0000 7fbee1d9b640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbecc06be30 0x7fbecc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.788+0000 7fbee1d9b640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbecc06be30 0x7fbecc06e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbed4006fd0 tx=0x7fbed4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:29.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:29.792+0000 7fbee37fe640 1 -- 172.21.15.82:0/1863792679 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbedc059ce0 con 0x7fbeec0d1fc0 2024-06-02T22:52:30.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.004+0000 7fbef0e58640 1 -- 172.21.15.82:0/1863792679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbeec0ce3f0 con 0x7fbeec0d1fc0 2024-06-02T22:52:30.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.005+0000 7fbee37fe640 1 -- 172.21.15.82:0/1863792679 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7fbedc0595e0 con 0x7fbeec0d1fc0 2024-06-02T22:52:30.005 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:30.005 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/598338197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":598338197},{"type":"v1","addr":"172.21.15.184:6835","nonce":598338197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2379089503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2379089503},{"type":"v1","addr":"172.21.15.82:6836","nonce":2379089503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:02.905481+0000","modified":"2024-06-02T22:52:21.989508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1449064574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1449064574},{"type":"v1","addr":"172.21.15.82:6837","nonce":1449064574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-06-02T22:52:30.005 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-06-02T22:52:30.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 -- 172.21.15.82:0/1863792679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbecc06be30 msgr2=0x7fbecc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbecc06be30 0x7fbecc06e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbed4006fd0 tx=0x7fbed4008040 comp rx=0 tx=0).stop 2024-06-02T22:52:30.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 -- 172.21.15.82:0/1863792679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec0d1fc0 msgr2=0x7fbeec0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec0d1fc0 0x7fbeec0b8b20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00d800 tx=0x7fbedc00dcc0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 -- 172.21.15.82:0/1863792679 shutdown_connections 2024-06-02T22:52:30.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbecc06be30 0x7fbecc06e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec161fa0 0x7fbeec0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbeec0d2680 0x7fbeec1f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 --2- 172.21.15.82:0/1863792679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec0d1fc0 0x7fbeec0b8b20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 -- 172.21.15.82:0/1863792679 >> 172.21.15.82:0/1863792679 conn(0x7fbeec09d3f0 msgr2=0x7fbeec06c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 -- 172.21.15.82:0/1863792679 shutdown_connections 2024-06-02T22:52:30.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.007+0000 7fbef0e58640 1 -- 172.21.15.82:0/1863792679 wait complete. 2024-06-02T22:52:30.421 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T22:52:02.905481+0000', 'modified': '2024-06-02T22:52:21.989508+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/1449064574', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6835', 'nonce': 1449064574}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 1449064574}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-06-02T22:52:30.421 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T22:52:30.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-06-02T22:52:30.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.523+0000 7fca3b29a640 1 Processor -- start 2024-06-02T22:52:30.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.524+0000 7fca3b29a640 1 -- start start 2024-06-02T22:52:30.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.524+0000 7fca3b29a640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fca3415e1f0 0x7fca340b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.524+0000 7fca3b29a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca340b2430 0x7fca3409aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.524+0000 7fca3b29a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca340b5800 con 0x7fca3409aa10 2024-06-02T22:52:30.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.524+0000 7fca3b29a640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fca3415e5d0 con 0x7fca3415e1f0 2024-06-02T22:52:30.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.524+0000 7fca3b29a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fca340b5ae0 con 0x7fca340b2430 2024-06-02T22:52:30.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca38835640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fca3409aa10 0x7fca340b1d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48224/0 (socket says 172.21.15.82:48224) 2024-06-02T22:52:30.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca38835640 1 -- 172.21.15.82:0/3731275775 learned_addr learned my addr 172.21.15.82:0/3731275775 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca39036640 1 --2- 172.21.15.82:0/3731275775 >> v2:172.21.15.184:3300/0 conn(0x7fca3415e1f0 0x7fca340b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca39837640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca340b2430 0x7fca3409aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 175700583 0 0) 0x7fca340b5800 con 0x7fca3409aa10 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca1c003520 con 0x7fca3409aa10 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4217844043 0 0) 0x7fca1c003520 con 0x7fca3409aa10 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca340b2430 msgr2=0x7fca3409aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca340b2430 0x7fca3409aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 >> v2:172.21.15.184:3300/0 conn(0x7fca3415e1f0 msgr2=0x7fca340b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 --2- 172.21.15.82:0/3731275775 >> v2:172.21.15.184:3300/0 conn(0x7fca3415e1f0 0x7fca340b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca340b5dc0 con 0x7fca3409aa10 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fca28001670 con 0x7fca3409aa10 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 >> v1:172.21.15.82:6789/0 conn(0x7fca3409aa10 legacy=0x7fca340b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca340b2430 0x7fca1c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1c003f30 0x7fca1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca1c004d40 0x7fca1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca3415e5d0 con 0x7fca1c003f30 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fca340b5ae0 con 0x7fca1c004d40 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fca1c00b9c0 con 0x7fca340b2430 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca38835640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1c003f30 0x7fca1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca39036640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca340b2430 0x7fca1c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.525+0000 7fca39837640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca1c004d40 0x7fca1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.526+0000 7fca38835640 1 -- 172.21.15.82:0/3731275775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca340b2430 msgr2=0x7fca1c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.526+0000 7fca38835640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca340b2430 0x7fca1c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.526+0000 7fca38835640 1 -- 172.21.15.82:0/3731275775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca1c004d40 msgr2=0x7fca1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.526+0000 7fca38835640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca1c004d40 0x7fca1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.526+0000 7fca38835640 1 -- 172.21.15.82:0/3731275775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c003520 con 0x7fca1c003f30 2024-06-02T22:52:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.526+0000 7fca38835640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1c003f30 0x7fca1c004800 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c240 tx=0x7fca1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4aa4cd0be94959 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.526+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28007cf0 con 0x7fca1c003f30 2024-06-02T22:52:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.526+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca280058d0 con 0x7fca1c003f30 2024-06-02T22:52:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.526+0000 7fca33fff640 1 -- 172.21.15.82:0/3731275775 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28005d20 con 0x7fca1c003f30 2024-06-02T22:52:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.527+0000 7fca3b29a640 1 -- 172.21.15.82:0/3731275775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1c003f30 msgr2=0x7fca1c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.527+0000 7fca3b29a640 1 --2- 172.21.15.82:0/3731275775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1c003f30 0x7fca1c004800 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c240 tx=0x7fca1c005830 comp rx=0 tx=0).stop 2024-06-02T22:52:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.527+0000 7fca39837640 1 -- 172.21.15.82:0/3731275775 reap_dead start 2024-06-02T22:52:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.527+0000 7fca3b29a640 1 -- 172.21.15.82:0/3731275775 shutdown_connections 2024-06-02T22:52:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.527+0000 7fca3b29a640 1 -- 172.21.15.82:0/3731275775 >> 172.21.15.82:0/3731275775 conn(0x7fca340b7270 msgr2=0x7fca340b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.527+0000 7fca3b29a640 1 -- 172.21.15.82:0/3731275775 shutdown_connections 2024-06-02T22:52:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.527+0000 7fca3b29a640 1 -- 172.21.15.82:0/3731275775 wait complete. 2024-06-02T22:52:30.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.528+0000 7fca3b29a640 1 Processor -- start 2024-06-02T22:52:30.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.528+0000 7fca3b29a640 1 -- start start 2024-06-02T22:52:30.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca3b29a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca1c003f30 0x7fca34156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca3b29a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca3415e750 0x7fca3415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca3b29a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca3415fe50 0x7fca341602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca3b29a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca340b6b00 con 0x7fca3415fe50 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca3b29a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fca340d2b80 con 0x7fca3415e750 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca3b29a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fca340b6c80 con 0x7fca1c003f30 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca39837640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca3415fe50 0x7fca341602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca39837640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca3415fe50 0x7fca341602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34792/0 (socket says 172.21.15.82:34792) 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca39837640 1 -- 172.21.15.82:0/215034934 learned_addr learned my addr 172.21.15.82:0/215034934 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca39036640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca1c003f30 0x7fca34156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca38835640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca3415e750 0x7fca3415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca39837640 1 -- 172.21.15.82:0/215034934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca1c003f30 msgr2=0x7fca34156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca39837640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca1c003f30 0x7fca34156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca39837640 1 -- 172.21.15.82:0/215034934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca3415e750 msgr2=0x7fca3415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca39837640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca3415e750 0x7fca3415ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca39837640 1 -- 172.21.15.82:0/215034934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca340cf6e0 con 0x7fca3415fe50 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca39036640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca1c003f30 0x7fca34156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca39837640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca3415fe50 0x7fca341602d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca340736b0 tx=0x7fca2c011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca31ffb640 1 -- 172.21.15.82:0/215034934 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c004240 con 0x7fca3415fe50 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca31ffb640 1 -- 172.21.15.82:0/215034934 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c01b070 con 0x7fca3415fe50 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.529+0000 7fca31ffb640 1 -- 172.21.15.82:0/215034934 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c00f740 con 0x7fca3415fe50 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.530+0000 7fca3b29a640 1 -- 172.21.15.82:0/215034934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca34160bc0 con 0x7fca3415fe50 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.530+0000 7fca3b29a640 1 -- 172.21.15.82:0/215034934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca340cf980 con 0x7fca3415fe50 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.531+0000 7fca31ffb640 1 -- 172.21.15.82:0/215034934 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca2c012040 con 0x7fca3415fe50 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.531+0000 7fca31ffb640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca2006be30 0x7fca2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.532+0000 7fca31ffb640 1 -- 172.21.15.82:0/215034934 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fca2c08ae50 con 0x7fca3415fe50 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.532+0000 7fca39036640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca2006be30 0x7fca2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.532+0000 7fca39036640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca2006be30 0x7fca2006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fca240074d0 tx=0x7fca2400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.532+0000 7fca3dfa1740 1 Processor -- start 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca3dfa1740 1 -- start start 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f385657d00 0x55f38565a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3856580e0 0x55f38565aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f38562a960 0x55f38562e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f385593740 con 0x55f3856580e0 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f385531a80 con 0x55f385657d00 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x55f38558f700 con 0x55f38562a960 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca38835640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3856580e0 0x55f38565aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca38835640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3856580e0 0x55f38565aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34798/0 (socket says 172.21.15.82:34798) 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca38835640 1 -- 172.21.15.82:0/1467909897 learned_addr learned my addr 172.21.15.82:0/1467909897 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca39837640 1 --2- 172.21.15.82:0/1467909897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f38562a960 0x55f38562e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.533+0000 7fca39036640 1 --2- 172.21.15.82:0/1467909897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f385657d00 0x55f38565a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca38835640 1 -- 172.21.15.82:0/1467909897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f38562a960 msgr2=0x55f38562e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca38835640 1 --2- 172.21.15.82:0/1467909897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f38562a960 0x55f38562e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca38835640 1 -- 172.21.15.82:0/1467909897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f385657d00 msgr2=0x55f38565a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca38835640 1 --2- 172.21.15.82:0/1467909897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f385657d00 0x55f38565a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca38835640 1 -- 172.21.15.82:0/1467909897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f38555cfb0 con 0x55f3856580e0 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca39837640 1 --2- 172.21.15.82:0/1467909897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f38562a960 0x55f38562e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca38835640 1 --2- 172.21.15.82:0/1467909897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3856580e0 0x55f38565aa50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c360 tx=0x7fca28007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb337308b0ed6f1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca1affd640 1 -- 172.21.15.82:0/1467909897 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28038040 con 0x55f3856580e0 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca1affd640 1 -- 172.21.15.82:0/1467909897 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca28043070 con 0x55f3856580e0 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca1affd640 1 -- 172.21.15.82:0/1467909897 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28001430 con 0x55f3856580e0 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca3dfa1740 1 -- 172.21.15.82:0/1467909897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3856580e0 msgr2=0x55f38565aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.534+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/1467909897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3856580e0 0x55f38565aa50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c360 tx=0x7fca28007000 comp rx=0 tx=0).stop 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.535+0000 7fca3dfa1740 1 -- 172.21.15.82:0/1467909897 shutdown_connections 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.535+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/1467909897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f38562a960 0x55f38562e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.535+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/1467909897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3856580e0 0x55f38565aa50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.535+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/1467909897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f385657d00 0x55f38565a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.535+0000 7fca3dfa1740 1 -- 172.21.15.82:0/1467909897 >> 172.21.15.82:0/1467909897 conn(0x55f38562cbd0 msgr2=0x55f385675510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.535+0000 7fca3dfa1740 1 -- 172.21.15.82:0/1467909897 shutdown_connections 2024-06-02T22:52:30.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.535+0000 7fca3dfa1740 1 -- 172.21.15.82:0/1467909897 wait complete. 2024-06-02T22:52:30.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.535+0000 7fca3dfa1740 1 -- start start 2024-06-02T22:52:30.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.535+0000 7fca3dfa1740 1 Processor -- start 2024-06-02T22:52:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f385655f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f3856580e0 0x55f385677b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f385656ae0 0x55f385678040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f38562fd80 con 0x55f385657d00 2024-06-02T22:52:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f38551cc30 con 0x55f385656ae0 2024-06-02T22:52:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x55f385630060 con 0x55f3856580e0 2024-06-02T22:52:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca3dfa1740 10 client.0 _ll_register_callbacks cb 0x55f38554e7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:52:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca39036640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f385655f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca39036640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f385655f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34810/0 (socket says 172.21.15.82:34810) 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca39036640 1 -- 172.21.15.82:0/2501286721 learned_addr learned my addr 172.21.15.82:0/2501286721 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca38835640 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f3856580e0 0x55f385677b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca39837640 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f385656ae0 0x55f385678040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca39036640 1 -- 172.21.15.82:0/2501286721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f3856580e0 msgr2=0x55f385677b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca39036640 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f3856580e0 0x55f385677b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca39036640 1 -- 172.21.15.82:0/2501286721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f385656ae0 msgr2=0x55f385678040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca39036640 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f385656ae0 0x55f385678040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca39036640 1 -- 172.21.15.82:0/2501286721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3852a72d0 con 0x55f385657d00 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.536+0000 7fca39837640 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f385656ae0 0x55f385678040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca39036640 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f385655f00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fca24015f60 tx=0x7fca24004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e0db11f91ad674 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca0ffff640 1 -- 172.21.15.82:0/2501286721 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24028070 con 0x55f385657d00 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca0ffff640 1 -- 172.21.15.82:0/2501286721 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fca24003b90 con 0x55f385657d00 2024-06-02T22:52:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca3dfa1740 1 -- 172.21.15.82:0/2501286721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca28043070 con 0x55f385657d00 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca0ffff640 1 -- 172.21.15.82:0/2501286721 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fca24032050 con 0x55f385657d00 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca3dfa1740 10 client.4680 fetch_fsmap learned FSMap version 8 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca3dfa1740 1 -- 172.21.15.82:0/2501286721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55f3853716b0 con 0x55f385657d00 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca0ffff640 1 -- 172.21.15.82:0/2501286721 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca28043070 con 0x55f385657d00 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca0ffff640 1 -- 172.21.15.82:0/2501286721 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fca24035020 con 0x55f385657d00 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca3dfa1740 10 client.4680 fetch_fsmap finished waiting for FSMap version 8 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca3dfa1740 10 client.4680 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca3dfa1740 20 client.4680 populate_metadata read hostname 'smithi082' 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x55f385670f80 0x55f3856702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca3dfa1740 4 client.4680 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca3dfa1740 1 -- 172.21.15.82:0/2501286721 --> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3855a0e70 con 0x55f385670f80 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.537+0000 7fca38835640 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x55f385670f80 0x55f3856702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca0ffff640 10 client.4680 ms_handle_connect on v2:172.21.15.82:6835/1449064574 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca38835640 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x55f385670f80 0x55f3856702b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75f27e1aaea20609 server_cookie=243be822211b284b in_seq=0 out_seq=0 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca0ffff640 1 -- 172.21.15.82:0/2501286721 <== mds.0 v2:172.21.15.82:6835/1449064574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f3855a0e70 con 0x55f385670f80 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca0ffff640 10 client.4680 handle_command_reply: tid=0 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca3dfa1740 1 client.4680 shutdown 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca3dfa1740 1 -- 172.21.15.82:0/2501286721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 msgr2=0x55f385655f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f385655f00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fca24015f60 tx=0x7fca24004ab0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca3dfa1740 1 -- 172.21.15.82:0/2501286721 shutdown_connections 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x55f385670f80 0x55f3856702b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f385656ae0 0x55f385678040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f3856580e0 0x55f385677b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/2501286721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f385655f00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca0ffff640 0 client.4680 ms_handle_reset on v2:172.21.15.82:6835/1449064574 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.538+0000 7fca3dfa1740 1 -- 172.21.15.82:0/2501286721 >> 172.21.15.82:0/2501286721 conn(0x55f38562a960 msgr2=0x55f38565a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.539+0000 7fca3dfa1740 1 -- 172.21.15.82:0/2501286721 shutdown_connections 2024-06-02T22:52:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.539+0000 7fca3dfa1740 1 -- 172.21.15.82:0/2501286721 wait complete. 2024-06-02T22:52:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.539+0000 7fca3dfa1740 20 client.4680 trim_cache size 0 max 16384 2024-06-02T22:52:30.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.557+0000 7fca3dfa1740 1 Processor -- start 2024-06-02T22:52:30.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.557+0000 7fca3dfa1740 1 -- start start 2024-06-02T22:52:30.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f385656ae0 0x55f3856704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f3856ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f3856580e0 0x55f3856eee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca34201430 con 0x55f385657d00 2024-06-02T22:52:30.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fca342007c0 con 0x55f3856580e0 2024-06-02T22:52:30.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fca34200e10 con 0x55f385656ae0 2024-06-02T22:52:30.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca38835640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f3856ee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca38835640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f3856ee8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34812/0 (socket says 172.21.15.82:34812) 2024-06-02T22:52:30.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca38835640 1 -- 172.21.15.82:0/455594118 learned_addr learned my addr 172.21.15.82:0/455594118 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:30.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca39036640 1 --2- 172.21.15.82:0/455594118 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f385656ae0 0x55f3856704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca38835640 1 -- 172.21.15.82:0/455594118 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f385656ae0 msgr2=0x55f3856704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca38835640 1 --2- 172.21.15.82:0/455594118 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f385656ae0 0x55f3856704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca38835640 1 -- 172.21.15.82:0/455594118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f3856580e0 msgr2=0x55f3856eee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca39837640 1 --2- 172.21.15.82:0/455594118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f3856580e0 0x55f3856eee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca38835640 1 --2- 172.21.15.82:0/455594118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f3856580e0 0x55f3856eee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca38835640 1 -- 172.21.15.82:0/455594118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3856268f0 con 0x55f385657d00 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca38835640 1 --2- 172.21.15.82:0/455594118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f3856ee8d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fca2802adf0 tx=0x7fca2802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738cf8c48a0e3512 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca1a7fc640 1 -- 172.21.15.82:0/455594118 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28038040 con 0x55f385657d00 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca1a7fc640 1 -- 172.21.15.82:0/455594118 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca28043040 con 0x55f385657d00 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.558+0000 7fca1a7fc640 1 -- 172.21.15.82:0/455594118 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28007130 con 0x55f385657d00 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.559+0000 7fca3dfa1740 1 -- 172.21.15.82:0/455594118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 msgr2=0x55f3856ee8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.559+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/455594118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f3856ee8d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fca2802adf0 tx=0x7fca2802e000 comp rx=0 tx=0).stop 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.559+0000 7fca3dfa1740 1 -- 172.21.15.82:0/455594118 shutdown_connections 2024-06-02T22:52:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.559+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/455594118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f3856580e0 0x55f3856eee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.559+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/455594118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385657d00 0x55f3856ee8d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.559+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/455594118 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f385656ae0 0x55f3856704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.559+0000 7fca3dfa1740 1 -- 172.21.15.82:0/455594118 >> 172.21.15.82:0/455594118 conn(0x55f38562a960 msgr2=0x55f385626090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.559+0000 7fca3dfa1740 1 -- 172.21.15.82:0/455594118 shutdown_connections 2024-06-02T22:52:30.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.559+0000 7fca3dfa1740 1 -- 172.21.15.82:0/455594118 wait complete. 2024-06-02T22:52:30.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.560+0000 7fca3dfa1740 1 -- start start 2024-06-02T22:52:30.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.560+0000 7fca3dfa1740 1 Processor -- start 2024-06-02T22:52:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.560+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385656ae0 0x55f3856dce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.560+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f385657d00 0x55f385674b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca3dfa1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f3856580e0 0x55f385671f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f385670e00 con 0x55f385656ae0 2024-06-02T22:52:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f385671950 con 0x55f3856580e0 2024-06-02T22:52:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca3dfa1740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x55f385671390 con 0x55f385657d00 2024-06-02T22:52:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca3dfa1740 10 client.0 _ll_register_callbacks cb 0x7fca24015c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca39036640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385656ae0 0x55f3856dce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca39036640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385656ae0 0x55f3856dce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34820/0 (socket says 172.21.15.82:34820) 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca39036640 1 -- 172.21.15.82:0/3791379743 learned_addr learned my addr 172.21.15.82:0/3791379743 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca38835640 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f385657d00 0x55f385674b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca39837640 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f3856580e0 0x55f385671f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca39036640 1 -- 172.21.15.82:0/3791379743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f385657d00 msgr2=0x55f385674b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca39036640 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f385657d00 0x55f385674b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca39036640 1 -- 172.21.15.82:0/3791379743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f3856580e0 msgr2=0x55f385671f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca39036640 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f3856580e0 0x55f385671f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca39036640 1 -- 172.21.15.82:0/3791379743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3856755b0 con 0x55f385656ae0 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca39837640 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f3856580e0 0x55f385671f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca39036640 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385656ae0 0x55f3856dce20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fca24000f80 tx=0x7fca2401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7364ad59e250ba server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-02T22:52:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca0ffff640 1 -- 172.21.15.82:0/3791379743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24028070 con 0x55f385656ae0 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca0ffff640 1 -- 172.21.15.82:0/3791379743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fca24004350 con 0x55f385656ae0 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca3dfa1740 1 -- 172.21.15.82:0/3791379743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca28043040 con 0x55f385656ae0 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca0ffff640 1 -- 172.21.15.82:0/3791379743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fca24044050 con 0x55f385656ae0 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca3dfa1740 10 client.4686 fetch_fsmap learned FSMap version 8 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca3dfa1740 1 -- 172.21.15.82:0/3791379743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55f385697e80 con 0x55f385656ae0 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.561+0000 7fca0ffff640 1 -- 172.21.15.82:0/3791379743 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca28043040 con 0x55f385656ae0 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca0ffff640 1 -- 172.21.15.82:0/3791379743 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fca24047020 con 0x55f385656ae0 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 10 client.4686 fetch_fsmap finished waiting for FSMap version 8 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 10 client.4686 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 20 client.4686 populate_metadata read hostname 'smithi082' 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x55f385696da0 0x55f385697180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 4 client.4686 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 -- 172.21.15.82:0/3791379743 --> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] -- command(tid 0: {"prefix": "status"}) -- 0x55f38559b1c0 con 0x55f385696da0 2024-06-02T22:52:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca38835640 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x55f385696da0 0x55f385697180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca0ffff640 10 client.4686 ms_handle_connect on v2:172.21.15.82:6835/1449064574 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca38835640 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x55f385696da0 0x55f385697180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3f2d7f9e8ba741a server_cookie=e3253652339164d5 in_seq=0 out_seq=0 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca0ffff640 1 -- 172.21.15.82:0/3791379743 <== mds.0 v2:172.21.15.82:6835/1449064574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55f38559b1c0 con 0x55f385696da0 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca0ffff640 10 client.4686 handle_command_reply: tid=0 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 client.4686 shutdown 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 -- 172.21.15.82:0/3791379743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385656ae0 msgr2=0x55f3856dce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385656ae0 0x55f3856dce20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fca24000f80 tx=0x7fca2401a000 comp rx=0 tx=0).stop 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 -- 172.21.15.82:0/3791379743 shutdown_connections 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.82:6835/1449064574,v1:172.21.15.82:6837/1449064574] conn(0x55f385696da0 0x55f385697180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f3856580e0 0x55f385671f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55f385657d00 0x55f385674b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 --2- 172.21.15.82:0/3791379743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f385656ae0 0x55f3856dce20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca0ffff640 0 client.4686 ms_handle_reset on v2:172.21.15.82:6835/1449064574 2024-06-02T22:52:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 -- 172.21.15.82:0/3791379743 >> 172.21.15.82:0/3791379743 conn(0x55f38562a960 msgr2=0x55f38562b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 -- 172.21.15.82:0/3791379743 shutdown_connections 2024-06-02T22:52:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.562+0000 7fca3dfa1740 1 -- 172.21.15.82:0/3791379743 wait complete. 2024-06-02T22:52:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3dfa1740 20 client.4686 trim_cache size 0 max 16384 2024-06-02T22:52:30.570 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:52:30.570 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "6f85057c-cf41-4021-ae61-b6064b1147d0", 2024-06-02T22:52:30.570 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-06-02T22:52:30.570 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4290, 2024-06-02T22:52:30.570 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-06-02T22:52:30.570 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-06-02T22:52:30.571 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-06-02T22:52:30.571 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 27.01037367, 2024-06-02T22:52:30.571 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 8, 2024-06-02T22:52:30.571 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 24, 2024-06-02T22:52:30.571 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 24, 2024-06-02T22:52:30.571 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 33.132863374000003 2024-06-02T22:52:30.571 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:52:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 -- 172.21.15.82:0/215034934 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca2006be30 msgr2=0x7fca2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca2006be30 0x7fca2006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fca240074d0 tx=0x7fca2400b040 comp rx=0 tx=0).stop 2024-06-02T22:52:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 -- 172.21.15.82:0/215034934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca3415fe50 msgr2=0x7fca341602d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca3415fe50 0x7fca341602d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca340736b0 tx=0x7fca2c011cf0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 -- 172.21.15.82:0/215034934 shutdown_connections 2024-06-02T22:52:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca2006be30 0x7fca2006e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca3415fe50 0x7fca341602d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca3415e750 0x7fca3415ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 --2- 172.21.15.82:0/215034934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca1c003f30 0x7fca34156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 -- 172.21.15.82:0/215034934 >> 172.21.15.82:0/215034934 conn(0x7fca340b7270 msgr2=0x7fca3406ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 -- 172.21.15.82:0/215034934 shutdown_connections 2024-06-02T22:52:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.563+0000 7fca3b29a640 1 -- 172.21.15.82:0/215034934 wait complete. 2024-06-02T22:52:30.574 INFO:teuthology.run_tasks:Running task sequential... 2024-06-02T22:52:30.583 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-02T22:52:30.584 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-02T22:52:30.584 INFO:teuthology.task.print:Enabling mgr modules 2024-06-02T22:52:30.585 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-06-02T22:52:30.594 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-06-02T22:52:30.594 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-06-02T22:52:30.595 INFO:tasks.ceph_fuse:client.0 config is {} 2024-06-02T22:52:30.595 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T22:52:30.595 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T22:52:30.595 INFO:tasks.ceph_fuse:client.2 config is {} 2024-06-02T22:52:30.595 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T22:52:30.595 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-06-02T22:52:30.595 INFO:tasks.ceph_fuse:client.1 config is {} 2024-06-02T22:52:30.595 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T22:52:30.596 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-02T22:52:30.596 INFO:tasks.ceph_fuse:client.3 config is {} 2024-06-02T22:52:30.596 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T22:52:30.596 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-06-02T22:52:30.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:30.596 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2024-06-02T22:52:30.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:30.616 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2024-06-02T22:52:30.687 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2024-06-02T22:52:30.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:52:30.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:30.689 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-02T22:52:30.704 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-06-02T22:52:30.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:30.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:52:30.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:30.770 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-06-02T22:52:30.864 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-06-02T22:52:30.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T22:52:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.964+0000 7f4544f4f640 1 Processor -- start 2024-06-02T22:52:30.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.964+0000 7f4544f4f640 1 -- start start 2024-06-02T22:52:30.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.965+0000 7f4544f4f640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f45400cd230 0x7f45400b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.965+0000 7f4544f4f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45400cec50 0x7f45400cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.965+0000 7f4544f4f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45400b3420 con 0x7f45401553c0 2024-06-02T22:52:30.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.965+0000 7f4544f4f640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f45400cc750 con 0x7f45400cd230 2024-06-02T22:52:30.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.965+0000 7f4544f4f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f45400cca30 con 0x7f45400cec50 2024-06-02T22:52:30.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.966+0000 7f453ed9d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45400cec50 0x7f45400cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.966+0000 7f453dd9b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f45400cd230 0x7f45400b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.966+0000 7f453ed9d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45400cec50 0x7f45400cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:43092/0 (socket says 172.21.15.82:43092) 2024-06-02T22:52:30.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.966+0000 7f453e59c640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f45401553c0 0x7f454015beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:35558/0 (socket says 172.21.15.82:35558) 2024-06-02T22:52:30.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.966+0000 7f453dd9b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f45400cd230 0x7f45400b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45956/0 (socket says 172.21.15.82:45956) 2024-06-02T22:52:30.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.966+0000 7f453ed9d640 1 -- 172.21.15.82:0/609284826 learned_addr learned my addr 172.21.15.82:0/609284826 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:30.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.966+0000 7f453ed9d640 1 -- 172.21.15.82:0/609284826 >> v2:172.21.15.184:3300/0 conn(0x7f45400cd230 msgr2=0x7f45400b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.966+0000 7f453ed9d640 1 --2- 172.21.15.82:0/609284826 >> v2:172.21.15.184:3300/0 conn(0x7f45400cd230 0x7f45400b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.966+0000 7f453ed9d640 1 -- 172.21.15.82:0/609284826 >> v1:172.21.15.184:6789/0 conn(0x7f45401553c0 legacy=0x7f454015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.966+0000 7f453ed9d640 1 -- 172.21.15.82:0/609284826 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45400ccd10 con 0x7f45400cec50 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.966+0000 7f453dd9b640 1 --2- 172.21.15.82:0/609284826 >> v2:172.21.15.184:3300/0 conn(0x7f45400cd230 0x7f45400b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.967+0000 7f453ed9d640 1 --2- 172.21.15.82:0/609284826 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45400cec50 0x7f45400cf0e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f453800bb10 tx=0x7f453802c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b1af8912300b934 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.967+0000 7f453d59a640 1 -- 172.21.15.82:0/609284826 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538036020 con 0x7f45400cec50 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.967+0000 7f453d59a640 1 -- 172.21.15.82:0/609284826 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4538032820 con 0x7f45400cec50 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.967+0000 7f453d59a640 1 -- 172.21.15.82:0/609284826 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538032bf0 con 0x7f45400cec50 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.967+0000 7f4544f4f640 1 -- 172.21.15.82:0/609284826 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45400cec50 msgr2=0x7f45400cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.967+0000 7f4544f4f640 1 --2- 172.21.15.82:0/609284826 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45400cec50 0x7f45400cf0e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f453800bb10 tx=0x7f453802c920 comp rx=0 tx=0).stop 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.968+0000 7f4544f4f640 1 -- 172.21.15.82:0/609284826 shutdown_connections 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.968+0000 7f4544f4f640 1 --2- 172.21.15.82:0/609284826 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45400cec50 0x7f45400cf0e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.968+0000 7f4544f4f640 1 --2- 172.21.15.82:0/609284826 >> v2:172.21.15.184:3300/0 conn(0x7f45400cd230 0x7f45400b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.968+0000 7f4544f4f640 1 -- 172.21.15.82:0/609284826 >> 172.21.15.82:0/609284826 conn(0x7f45400b19f0 msgr2=0x7f45400b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.968+0000 7f4544f4f640 1 -- 172.21.15.82:0/609284826 shutdown_connections 2024-06-02T22:52:30.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.968+0000 7f4544f4f640 1 -- 172.21.15.82:0/609284826 wait complete. 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.969+0000 7f4544f4f640 1 Processor -- start 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.969+0000 7f4544f4f640 1 -- start start 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f4544f4f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45400cd230 0x7f454015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f4544f4f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45400cec50 0x7f45400cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f4544f4f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45401553c0 0x7f4540145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f4544f4f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4540155920 con 0x7f45400cec50 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f4544f4f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f45401557a0 con 0x7f45400cd230 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f4544f4f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4540071030 con 0x7f45401553c0 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f453dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45400cec50 0x7f45400cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f453dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45400cec50 0x7f45400cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55142/0 (socket says 172.21.15.82:55142) 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f453dd9b640 1 -- 172.21.15.82:0/4132177138 learned_addr learned my addr 172.21.15.82:0/4132177138 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f453e59c640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45400cd230 0x7f454015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f453ed9d640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45401553c0 0x7f4540145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f453dd9b640 1 -- 172.21.15.82:0/4132177138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45401553c0 msgr2=0x7f4540145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f453dd9b640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45401553c0 0x7f4540145280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f453dd9b640 1 -- 172.21.15.82:0/4132177138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45400cd230 msgr2=0x7f454015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f453dd9b640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45400cd230 0x7f454015beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f453dd9b640 1 -- 172.21.15.82:0/4132177138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454015d2f0 con 0x7f45400cec50 2024-06-02T22:52:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f453dd9b640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45400cec50 0x7f45400cddb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f453400ec10 tx=0x7f453400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f452effd640 1 -- 172.21.15.82:0/4132177138 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534017070 con 0x7f45400cec50 2024-06-02T22:52:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f452effd640 1 -- 172.21.15.82:0/4132177138 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453400cbd0 con 0x7f45400cec50 2024-06-02T22:52:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f4544f4f640 1 -- 172.21.15.82:0/4132177138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454015c6e0 con 0x7f45400cec50 2024-06-02T22:52:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f452effd640 1 -- 172.21.15.82:0/4132177138 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534013470 con 0x7f45400cec50 2024-06-02T22:52:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.970+0000 7f4544f4f640 1 -- 172.21.15.82:0/4132177138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454015cf80 con 0x7f45400cec50 2024-06-02T22:52:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.971+0000 7f4544f4f640 1 -- 172.21.15.82:0/4132177138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454015cad0 con 0x7f45400cec50 2024-06-02T22:52:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.972+0000 7f452effd640 1 -- 172.21.15.82:0/4132177138 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f453401a070 con 0x7f45400cec50 2024-06-02T22:52:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.972+0000 7f452effd640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f452006be30 0x7f452006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.973+0000 7f453e59c640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f452006be30 0x7f452006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.973+0000 7f452effd640 1 -- 172.21.15.82:0/4132177138 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f453408b000 con 0x7f45400cec50 2024-06-02T22:52:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.973+0000 7f453e59c640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f452006be30 0x7f452006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4530007fd0 tx=0x7f4530001630 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:30.977+0000 7f452effd640 1 -- 172.21.15.82:0/4132177138 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4534059020 con 0x7f45400cec50 2024-06-02T22:52:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.186+0000 7f4544f4f640 1 -- 172.21.15.82:0/4132177138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4540154d30 con 0x7f45400cec50 2024-06-02T22:52:31.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.187+0000 7f452effd640 1 -- 172.21.15.82:0/4132177138 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f453405d320 con 0x7f45400cec50 2024-06-02T22:52:31.187 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T22:52:31.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 -- 172.21.15.82:0/4132177138 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f452006be30 msgr2=0x7f452006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:31.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f452006be30 0x7f452006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4530007fd0 tx=0x7f4530001630 comp rx=0 tx=0).stop 2024-06-02T22:52:31.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 -- 172.21.15.82:0/4132177138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45400cec50 msgr2=0x7f45400cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:31.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45400cec50 0x7f45400cddb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f453400ec10 tx=0x7f453400c520 comp rx=0 tx=0).stop 2024-06-02T22:52:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 -- 172.21.15.82:0/4132177138 shutdown_connections 2024-06-02T22:52:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f452006be30 0x7f452006e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45401553c0 0x7f4540145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45400cec50 0x7f45400cddb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 --2- 172.21.15.82:0/4132177138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45400cd230 0x7f454015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 -- 172.21.15.82:0/4132177138 >> 172.21.15.82:0/4132177138 conn(0x7f45400b19f0 msgr2=0x7f45400b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 -- 172.21.15.82:0/4132177138 shutdown_connections 2024-06-02T22:52:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31.189+0000 7f4544f4f640 1 -- 172.21.15.82:0/4132177138 wait complete. 2024-06-02T22:52:31.200 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T22:52:31.200 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:52:31.200 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-06-02T22:52:31.200 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T22:52:31.200 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T22:52:31.200 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T22:52:31.200 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:52:31.200 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:52:31.200 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:52:31.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:31.201 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-06-02T22:52:31.217 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:52:31.217 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:52:31.217 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:52:31.217 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:31.217 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-02T22:52:31.218 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:31.218 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:31.218 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:31.218 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-06-02T22:52:31.218 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:31.218 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:31.218 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-06-02T22:52:31.218 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:31.218 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:31.218 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:52:31.218 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:31.219 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T22:52:31.219 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-06-02T22:52:31.219 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-06-02T22:52:31.219 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:31.219 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T22:52:31.219 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:31.219 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:31.219 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-06-02T22:52:31.219 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-06-02T22:52:31.219 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-06-02T22:52:31.220 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T22:52:31.220 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:31.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:31.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:31.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:31.355 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:52:31.378 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-06-02T22:52:31.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:31.380 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-06-02T22:52:31.437 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-06-02T22:52:31.437 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:52:31.437 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T22:52:31.437 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T22:52:31.437 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:52:31.438 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:31.438 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:31.438 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T22:52:31.438 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T22:52:31.438 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T22:52:31.438 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:31.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:31.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:31.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:31.564 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-02T22:52:31.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:31.579 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-06-02T22:52:31.635 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:31.635 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:31.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:52:31.636 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-02T22:52:31.636 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:31.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:31.753 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-02T22:52:31.753 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:31.753 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:31.753 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-02T22:52:31.753 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T22:52:31.753 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-02T22:52:31.753 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-02T22:52:31.753 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-02T22:52:31.753 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:31.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:31.879 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:31.880 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:31.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-06-02T22:52:31.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T22:52:31.880 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:31.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:31.956 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-02T22:52:31.956 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:52:31.956 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T22:52:31.971 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:52:31.972 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:52:31.972 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:52:32.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:52:32.092 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:52:32.148 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:52:32.148 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:52:32.149 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:52:32.149 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:52:32.149 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:52:32.149 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:52:32.149 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:52:32.149 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:52:32.149 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:52:32.149 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:52:32.149 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:52:32.149 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:52:32.149 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:52:32.150 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:52:32.151 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:52:32.151 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:52:32.151 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:52:32.151 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:52:32.151 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:52:32.151 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:52:32.151 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:52:32.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:32.151 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:52:32.204 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T22:52:32.204 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-02T22:52:32.247 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:52:32.272 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:52:32.328 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:52:32.328 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:52:32.328 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:52:32.328 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:52:32.328 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:52:32.328 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:52:32.328 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:52:32.329 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:52:32.330 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:52:32.331 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:52:32.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:32.331 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:52:32.332 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2024-06-02T22:52:32.330+0000 7f1f5cc68480 -1 init, newargv = 0x557412872ec0 newargc=15 2024-06-02T22:52:32.332 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[47299]: starting ceph client 2024-06-02T22:52:32.334 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[47299]: starting fuse 2024-06-02T22:52:32.348 INFO:teuthology.orchestra.run.smithi082.stdout:40 2024-06-02T22:52:32.348 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T22:52:32.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:52:32.348 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-06-02T22:52:32.348 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-06-02T22:52:32.348 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-06-02T22:52:32.348 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-06-02T22:52:32.348 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:32.348 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-06-02T22:52:32.349 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-06-02T22:52:32.350 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:52:32.350 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:32.350 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2024-06-02T22:52:32.350 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-06-02T22:52:32.466 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.47299.asok 2024-06-02T22:52:32.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:32.475 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47299.asok 2024-06-02T22:52:32.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:32.475 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47299.asok status 2024-06-02T22:52:32.610 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:52:32.610 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-06-02T22:52:32.610 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:52:32.610 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:52:32.610 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2024-06-02T22:52:32.610 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-06-02T22:52:32.610 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-02T22:52:32.610 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "47299", 2024-06-02T22:52:32.610 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-06-02T22:52:32.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4695, 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 4695 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1575051030 2024-06-02T22:52:32.611 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1575051030 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.4695 192.168.0.1:0/1575051030", 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/1575051030", 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 8, 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 24, 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:52:32.612 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-06-02T22:52:32.613 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-06-02T22:52:32.613 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:52:32.618 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T22:52:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.717+0000 7f1160a53640 1 Processor -- start 2024-06-02T22:52:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.717+0000 7f1160a53640 1 -- start start 2024-06-02T22:52:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.718+0000 7f1160a53640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f115c06bdb0 0x7f115c0d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.718+0000 7f1160a53640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f115c15c570 0x7f115c15c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.718+0000 7f1160a53640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115c15d0f0 con 0x7f115c06ec00 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.718+0000 7f1160a53640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f115c0d1080 con 0x7f115c06bdb0 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.718+0000 7f1160a53640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f115c15d3d0 con 0x7f115c15c570 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.719+0000 7f115a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f115c06bdb0 0x7f115c0d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.719+0000 7f115ad9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f115c06ec00 0x7f115c072190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51938/0 (socket says 172.21.15.82:51938) 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.719+0000 7f115ad9d640 1 -- 172.21.15.82:0/2980117408 learned_addr learned my addr 172.21.15.82:0/2980117408 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.719+0000 7f1159d9b640 1 --2- 172.21.15.82:0/2980117408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f115c15c570 0x7f115c15c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.719+0000 7f115a59c640 1 -- 172.21.15.82:0/2980117408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f115c15c570 msgr2=0x7f115c15c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.719+0000 7f115a59c640 1 --2- 172.21.15.82:0/2980117408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f115c15c570 0x7f115c15c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.719+0000 7f115a59c640 1 -- 172.21.15.82:0/2980117408 >> v1:172.21.15.82:6789/0 conn(0x7f115c06ec00 legacy=0x7f115c072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.719+0000 7f115a59c640 1 -- 172.21.15.82:0/2980117408 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c0d0d10 con 0x7f115c06bdb0 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.719+0000 7f115959a640 1 -- 172.21.15.82:0/2980117408 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 416038136 0 0) 0x7f115c15d0f0 con 0x7f115c06ec00 2024-06-02T22:52:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f115a59c640 1 --2- 172.21.15.82:0/2980117408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f115c06bdb0 0x7f115c0d1510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1154009d90 tx=0x7f115402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b078cfe2d55002d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f115959a640 1 -- 172.21.15.82:0/2980117408 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154031600 con 0x7f115c06bdb0 2024-06-02T22:52:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f115959a640 1 -- 172.21.15.82:0/2980117408 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11540317a0 con 0x7f115c06bdb0 2024-06-02T22:52:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f115959a640 1 -- 172.21.15.82:0/2980117408 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154031b70 con 0x7f115c06bdb0 2024-06-02T22:52:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f1160a53640 1 -- 172.21.15.82:0/2980117408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f115c06bdb0 msgr2=0x7f115c0d1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f1160a53640 1 --2- 172.21.15.82:0/2980117408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f115c06bdb0 0x7f115c0d1510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1154009d90 tx=0x7f115402a5d0 comp rx=0 tx=0).stop 2024-06-02T22:52:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f1160a53640 1 -- 172.21.15.82:0/2980117408 shutdown_connections 2024-06-02T22:52:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f1160a53640 1 --2- 172.21.15.82:0/2980117408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f115c15c570 0x7f115c15c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f1160a53640 1 --2- 172.21.15.82:0/2980117408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f115c06bdb0 0x7f115c0d1510 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f1160a53640 1 -- 172.21.15.82:0/2980117408 >> 172.21.15.82:0/2980117408 conn(0x7f115c0b2a70 msgr2=0x7f115c0b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f1160a53640 1 -- 172.21.15.82:0/2980117408 shutdown_connections 2024-06-02T22:52:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.720+0000 7f1160a53640 1 -- 172.21.15.82:0/2980117408 wait complete. 2024-06-02T22:52:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.722+0000 7f1160a53640 1 Processor -- start 2024-06-02T22:52:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.722+0000 7f1160a53640 1 -- start start 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.722+0000 7f1160a53640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f115c06bdb0 0x7f115c155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.722+0000 7f1160a53640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f115c06ec00 0x7f115c09b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.722+0000 7f1160a53640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f115c15c570 0x7f115c09cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.722+0000 7f1160a53640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f115c0d1bd0 con 0x7f115c06bdb0 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.722+0000 7f1160a53640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f115c0d1a50 con 0x7f115c06ec00 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.722+0000 7f1160a53640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f115c0728a0 con 0x7f115c15c570 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.722+0000 7f115a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f115c06bdb0 0x7f115c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.722+0000 7f115a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f115c06bdb0 0x7f115c155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55158/0 (socket says 172.21.15.82:55158) 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.722+0000 7f115a59c640 1 -- 172.21.15.82:0/1443952506 learned_addr learned my addr 172.21.15.82:0/1443952506 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f115ad9d640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f115c15c570 0x7f115c09cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f1159d9b640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f115c06ec00 0x7f115c09b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f115a59c640 1 -- 172.21.15.82:0/1443952506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f115c15c570 msgr2=0x7f115c09cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f115a59c640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f115c15c570 0x7f115c09cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f115a59c640 1 -- 172.21.15.82:0/1443952506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f115c06ec00 msgr2=0x7f115c09b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f115a59c640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f115c06ec00 0x7f115c09b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f115a59c640 1 -- 172.21.15.82:0/1443952506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c09bdc0 con 0x7f115c06bdb0 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f115ad9d640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f115c15c570 0x7f115c09cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f115a59c640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f115c06bdb0 0x7f115c155150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1154009d90 tx=0x7f1154004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f1152ffd640 1 -- 172.21.15.82:0/1443952506 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154040070 con 0x7f115c06bdb0 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f1152ffd640 1 -- 172.21.15.82:0/1443952506 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1154030be0 con 0x7f115c06bdb0 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f1152ffd640 1 -- 172.21.15.82:0/1443952506 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154009450 con 0x7f115c06bdb0 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f1160a53640 1 -- 172.21.15.82:0/1443952506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115c09c0a0 con 0x7f115c06bdb0 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.723+0000 7f1160a53640 1 -- 172.21.15.82:0/1443952506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115c0ae0d0 con 0x7f115c06bdb0 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.724+0000 7f1160a53640 1 -- 172.21.15.82:0/1443952506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f115c068ad0 con 0x7f115c06bdb0 2024-06-02T22:52:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.724+0000 7f1152ffd640 1 -- 172.21.15.82:0/1443952506 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1154039040 con 0x7f115c06bdb0 2024-06-02T22:52:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.725+0000 7f1152ffd640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f113c06be30 0x7f113c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.725+0000 7f1152ffd640 1 -- 172.21.15.82:0/1443952506 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f11540ac570 con 0x7f115c06bdb0 2024-06-02T22:52:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.725+0000 7f1159d9b640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f113c06be30 0x7f113c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.725+0000 7f1159d9b640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f113c06be30 0x7f113c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1144006fd0 tx=0x7f1144008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:32.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.729+0000 7f1152ffd640 1 -- 172.21.15.82:0/1443952506 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f115407a590 con 0x7f115c06bdb0 2024-06-02T22:52:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.943+0000 7f1160a53640 1 -- 172.21.15.82:0/1443952506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f115c0ae4f0 con 0x7f115c06bdb0 2024-06-02T22:52:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.943+0000 7f1152ffd640 1 -- 172.21.15.82:0/1443952506 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f115407e890 con 0x7f115c06bdb0 2024-06-02T22:52:32.943 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T22:52:32.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 -- 172.21.15.82:0/1443952506 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f113c06be30 msgr2=0x7f113c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f113c06be30 0x7f113c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1144006fd0 tx=0x7f1144008040 comp rx=0 tx=0).stop 2024-06-02T22:52:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 -- 172.21.15.82:0/1443952506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f115c06bdb0 msgr2=0x7f115c155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f115c06bdb0 0x7f115c155150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1154009d90 tx=0x7f1154004a40 comp rx=0 tx=0).stop 2024-06-02T22:52:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 -- 172.21.15.82:0/1443952506 shutdown_connections 2024-06-02T22:52:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f113c06be30 0x7f113c06e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f115c15c570 0x7f115c09cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f115c06ec00 0x7f115c09b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 --2- 172.21.15.82:0/1443952506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f115c06bdb0 0x7f115c155150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 -- 172.21.15.82:0/1443952506 >> 172.21.15.82:0/1443952506 conn(0x7f115c0b2a70 msgr2=0x7f115c06efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:32.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 -- 172.21.15.82:0/1443952506 shutdown_connections 2024-06-02T22:52:32.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:32.945+0000 7f1160a53640 1 -- 172.21.15.82:0/1443952506 wait complete. 2024-06-02T22:52:32.956 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T22:52:32.956 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:52:32.956 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-06-02T22:52:32.956 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-06-02T22:52:32.956 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-06-02T22:52:32.957 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T22:52:32.957 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:52:32.957 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:52:32.957 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-06-02T22:52:32.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:32.957 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-06-02T22:52:32.973 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:52:32.973 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:52:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:52:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-02T22:52:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:32.974 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-06-02T22:52:32.974 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:32.974 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-06-02T22:52:32.974 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:32.975 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:52:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T22:52:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42745sec preferred_lft 42745sec 2024-06-02T22:52:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-06-02T22:52:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:32.975 INFO:teuthology.orchestra.run.smithi082.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:52:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 7e:10:3a:74:07:cf brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T22:52:32.975 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::6847:90ff:fe09:5afd/64 scope link 2024-06-02T22:52:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:32.976 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:52:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 7e:10:3a:74:07:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:52:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::7c10:3aff:fe74:7cf/64 scope link tentative 2024-06-02T22:52:32.976 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:32.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:32.976 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:52:33.036 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-06-02T22:52:33.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:33.038 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-06-02T22:52:33.094 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-06-02T22:52:33.095 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:52:33.095 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T22:52:33.095 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T22:52:33.095 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:52:33.095 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:33.095 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:33.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T22:52:33.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T22:52:33.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T22:52:33.095 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:33.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:33.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:33.220 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-02T22:52:33.236 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T22:52:33.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:33.236 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-06-02T22:52:33.291 INFO:teuthology.orchestra.run.smithi082.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-06-02T22:52:33.292 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:33.292 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:33.292 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:52:33.292 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-06-02T22:52:33.292 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:33.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:33.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:33.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:33.408 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-06-02T22:52:33.432 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:52:33.433 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:52:33.433 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:52:33.433 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:33.433 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-02T22:52:33.433 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:33.433 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:52:33.433 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:a3:5a:ca:8a:92 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T22:52:33.433 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T22:52:33.433 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:33.433 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::a3:5aff:feca:8a92/64 scope link 2024-06-02T22:52:33.433 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:33.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:33.434 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-06-02T22:52:33.499 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:52:33.499 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:52:33.499 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:52:33.499 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:33.499 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-02T22:52:33.499 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:33.499 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:52:33.499 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:a3:5a:ca:8a:92 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T22:52:33.500 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T22:52:33.500 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:33.500 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::a3:5aff:feca:8a92/64 scope link 2024-06-02T22:52:33.500 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:33.501 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-06-02T22:52:33.501 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:33.501 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:33.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-06-02T22:52:33.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-06-02T22:52:33.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-06-02T22:52:33.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-06-02T22:52:33.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-06-02T22:52:33.502 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:33.653 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:33.653 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:52:33.654 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.1 up 2024-06-02T22:52:33.654 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.1 master ceph-brx 2024-06-02T22:52:33.654 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:52:33.688 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:52:33.699 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:52:33.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:33.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:33.731 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-06-02T22:52:33.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:52:33.732 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-06-02T22:52:33.827 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-06-02T22:52:33.827 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:52:33.827 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-06-02T22:52:33.889 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:52:33.962 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:52:34.024 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:52:34.025 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:52:34.025 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:52:34.025 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:52:34.025 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:52:34.025 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:52:34.026 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:52:34.026 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:52:34.026 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:52:34.026 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:52:34.027 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:52:34.027 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:52:34.027 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:52:34.027 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:52:34.027 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:52:34.028 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:52:34.028 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:52:34.028 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:52:34.028 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:52:34.029 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:52:34.029 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:52:34.029 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:52:34.029 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:52:34.029 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:52:34.030 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:52:34.030 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:52:34.030 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:52:34.030 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:52:34.031 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:52:34.031 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:52:34.031 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:52:34.031 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:52:34.031 INFO:teuthology.orchestra.run.smithi082.stdout:/home/ubuntu/cephtest/mnt.0 2024-06-02T22:52:34.031 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:52:34.032 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:52:34.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:34.032 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:52:34.086 INFO:teuthology.orchestra.run.smithi082.stdout:40 2024-06-02T22:52:34.086 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2024-06-02T22:52:34.087 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-06-02T22:52:34.131 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:52:34.161 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:52:34.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi082.stderr:2024-06-02T22:52:34.211+0000 7fee1371c480 -1 init, newargv = 0x560bb9ca88b0 newargc=15 2024-06-02T22:52:34.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi082.stderr:ceph-fuse[47815]: starting ceph client 2024-06-02T22:52:34.215 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi082.stderr:ceph-fuse[47815]: starting fuse 2024-06-02T22:52:34.225 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:52:34.225 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:52:34.225 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:52:34.225 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:52:34.225 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:52:34.226 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:52:34.226 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:52:34.226 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:52:34.226 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:52:34.226 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:52:34.226 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:52:34.226 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:52:34.226 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:52:34.227 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:52:34.227 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:52:34.227 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:52:34.227 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:52:34.227 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:52:34.227 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:52:34.227 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:52:34.227 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:52:34.228 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:52:34.228 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:52:34.228 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:52:34.228 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:52:34.228 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:52:34.228 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:52:34.228 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:52:34.229 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:52:34.229 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:52:34.229 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:52:34.229 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:52:34.229 INFO:teuthology.orchestra.run.smithi082.stdout:/home/ubuntu/cephtest/mnt.0 2024-06-02T22:52:34.229 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:52:34.230 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:52:34.230 INFO:teuthology.orchestra.run.smithi082.stdout:/home/ubuntu/cephtest/mnt.2 2024-06-02T22:52:34.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:34.230 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:52:34.282 INFO:teuthology.orchestra.run.smithi082.stdout:40 2024-06-02T22:52:34.282 INFO:teuthology.orchestra.run.smithi082.stdout:43 2024-06-02T22:52:34.283 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 43] 2024-06-02T22:52:34.283 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:52:34.283 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-06-02T22:52:34.283 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-06-02T22:52:34.283 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-06-02T22:52:34.283 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-06-02T22:52:34.284 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:34.284 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-06-02T22:52:34.284 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-06-02T22:52:34.284 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-06-02T22:52:34.284 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-06-02T22:52:34.284 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:34.284 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-06-02T22:52:34.284 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-06-02T22:52:34.284 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-06-02T22:52:34.285 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-06-02T22:52:34.285 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:34.285 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-06-02T22:52:34.285 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:52:34.285 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:52:34.285 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:52:34.285 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-06-02T22:52:34.285 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-06-02T22:52:34.285 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-06-02T22:52:34.286 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:52:34.286 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:52:34.286 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.2")) 2024-06-02T22:52:34.286 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-06-02T22:52:34.403 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.2.47815.asok 2024-06-02T22:52:34.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:34.413 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.47815.asok 2024-06-02T22:52:34.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:34.414 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.47815.asok status 2024-06-02T22:52:34.548 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:52:34.548 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "2", 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "47815", 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4710, 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-06-02T22:52:34.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 4710 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.2:0", 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1672469341 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.2:0", 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1672469341 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:34.550 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.4710 192.168.0.2:0/1672469341", 2024-06-02T22:52:34.551 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.2:0/1672469341", 2024-06-02T22:52:34.551 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-06-02T22:52:34.551 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 8, 2024-06-02T22:52:34.551 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 24, 2024-06-02T22:52:34.551 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:52:34.551 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-06-02T22:52:34.551 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-06-02T22:52:34.551 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:52:34.557 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T22:52:34.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.660+0000 7f40a5658640 1 Processor -- start 2024-06-02T22:52:34.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.660+0000 7f40a5658640 1 -- start start 2024-06-02T22:52:34.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.661+0000 7f40a5658640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40a0162190 0x7f40a00d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:34.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.661+0000 7f40a5658640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a0161a30 0x7f40a0162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.661+0000 7f40a5658640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a0162ca0 con 0x7f40a006d050 2024-06-02T22:52:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.661+0000 7f40a5658640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f40a006db10 con 0x7f40a0162190 2024-06-02T22:52:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.661+0000 7f40a5658640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f40a00d0570 con 0x7f40a0161a30 2024-06-02T22:52:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.661+0000 7f409effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40a0162190 0x7f40a00d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.661+0000 7f409effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40a0162190 0x7f40a00d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55170/0 (socket says 172.21.15.82:55170) 2024-06-02T22:52:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.661+0000 7f409effd640 1 -- 172.21.15.82:0/3664628525 learned_addr learned my addr 172.21.15.82:0/3664628525 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.662+0000 7f409effd640 1 -- 172.21.15.82:0/3664628525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a0161a30 msgr2=0x7f40a0162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.662+0000 7f409f7fe640 1 --2- 172.21.15.82:0/3664628525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a0161a30 0x7f40a0162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.662+0000 7f409effd640 1 --2- 172.21.15.82:0/3664628525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a0161a30 0x7f40a0162570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.662+0000 7f409effd640 1 -- 172.21.15.82:0/3664628525 >> v1:172.21.15.184:6789/0 conn(0x7f40a006d050 legacy=0x7f40a0161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.662+0000 7f409effd640 1 -- 172.21.15.82:0/3664628525 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a006dd60 con 0x7f40a0162190 2024-06-02T22:52:34.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.662+0000 7f409effd640 1 --2- 172.21.15.82:0/3664628525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0162190 0x7f40a00d1c80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4090009e50 tx=0x7f409002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ee4d911293f816 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:34.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.663+0000 7f409dffb640 1 -- 172.21.15.82:0/3664628525 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4090036070 con 0x7f40a0162190 2024-06-02T22:52:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.663+0000 7f409dffb640 1 -- 172.21.15.82:0/3664628525 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4090031600 con 0x7f40a0162190 2024-06-02T22:52:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.663+0000 7f409dffb640 1 -- 172.21.15.82:0/3664628525 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40900319d0 con 0x7f40a0162190 2024-06-02T22:52:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.663+0000 7f40a5658640 1 -- 172.21.15.82:0/3664628525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0162190 msgr2=0x7f40a00d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.663+0000 7f40a5658640 1 --2- 172.21.15.82:0/3664628525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0162190 0x7f40a00d1c80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4090009e50 tx=0x7f409002a630 comp rx=0 tx=0).stop 2024-06-02T22:52:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.663+0000 7f40a5658640 1 -- 172.21.15.82:0/3664628525 shutdown_connections 2024-06-02T22:52:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.663+0000 7f40a5658640 1 --2- 172.21.15.82:0/3664628525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a0161a30 0x7f40a0162570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.663+0000 7f40a5658640 1 --2- 172.21.15.82:0/3664628525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0162190 0x7f40a00d1c80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.663+0000 7f40a5658640 1 -- 172.21.15.82:0/3664628525 >> 172.21.15.82:0/3664628525 conn(0x7f40a009d3c0 msgr2=0x7f40a00d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.663+0000 7f40a5658640 1 -- 172.21.15.82:0/3664628525 shutdown_connections 2024-06-02T22:52:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.663+0000 7f40a5658640 1 -- 172.21.15.82:0/3664628525 wait complete. 2024-06-02T22:52:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.665+0000 7f40a5658640 1 Processor -- start 2024-06-02T22:52:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.665+0000 7f40a5658640 1 -- start start 2024-06-02T22:52:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.665+0000 7f40a5658640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40a006d050 0x7f40a01e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.665+0000 7f40a5658640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0161a30 0x7f40a00cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.665+0000 7f40a5658640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a0162190 0x7f40a00b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.665+0000 7f40a5658640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f40a00d2d50 con 0x7f40a0161a30 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.665+0000 7f40a5658640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f40a00cf560 con 0x7f40a006d050 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.665+0000 7f40a5658640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f40a01e97f0 con 0x7f40a0162190 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.665+0000 7f409e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0161a30 0x7f40a00cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.665+0000 7f409e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0161a30 0x7f40a00cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55178/0 (socket says 172.21.15.82:55178) 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.665+0000 7f409e7fc640 1 -- 172.21.15.82:0/623780679 learned_addr learned my addr 172.21.15.82:0/623780679 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f409f7fe640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a0162190 0x7f40a00b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f409effd640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40a006d050 0x7f40a01e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f409e7fc640 1 -- 172.21.15.82:0/623780679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a0162190 msgr2=0x7f40a00b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f409e7fc640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a0162190 0x7f40a00b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f409e7fc640 1 -- 172.21.15.82:0/623780679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40a006d050 msgr2=0x7f40a01e92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f409e7fc640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40a006d050 0x7f40a01e92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f409e7fc640 1 -- 172.21.15.82:0/623780679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a00b6cd0 con 0x7f40a0161a30 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f409f7fe640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a0162190 0x7f40a00b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f409effd640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40a006d050 0x7f40a01e92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f409e7fc640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0161a30 0x7f40a00cc5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f409400c400 tx=0x7f409400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f40877fe640 1 -- 172.21.15.82:0/623780679 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4094011790 con 0x7f40a0161a30 2024-06-02T22:52:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f40877fe640 1 -- 172.21.15.82:0/623780679 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4094017070 con 0x7f40a0161a30 2024-06-02T22:52:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f40a5658640 1 -- 172.21.15.82:0/623780679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a00b7010 con 0x7f40a0161a30 2024-06-02T22:52:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f40877fe640 1 -- 172.21.15.82:0/623780679 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4094011bb0 con 0x7f40a0161a30 2024-06-02T22:52:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.666+0000 7f40a5658640 1 -- 172.21.15.82:0/623780679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a00b7850 con 0x7f40a0161a30 2024-06-02T22:52:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.667+0000 7f40a5658640 1 -- 172.21.15.82:0/623780679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a0068ad0 con 0x7f40a0161a30 2024-06-02T22:52:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.668+0000 7f40877fe640 1 -- 172.21.15.82:0/623780679 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f409401c460 con 0x7f40a0161a30 2024-06-02T22:52:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.668+0000 7f40877fe640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f408c06be30 0x7f408c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.668+0000 7f409effd640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f408c06be30 0x7f408c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.668+0000 7f40877fe640 1 -- 172.21.15.82:0/623780679 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f409408af50 con 0x7f40a0161a30 2024-06-02T22:52:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.669+0000 7f409effd640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f408c06be30 0x7f408c06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4090033000 tx=0x7f4090009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:34.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.673+0000 7f40877fe640 1 -- 172.21.15.82:0/623780679 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f40a00b7010 con 0x7f40a0161a30 2024-06-02T22:52:34.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.884+0000 7f40a5658640 1 -- 172.21.15.82:0/623780679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f40a00ce600 con 0x7f40a0161a30 2024-06-02T22:52:34.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.885+0000 7f40877fe640 1 -- 172.21.15.82:0/623780679 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f4094059650 con 0x7f40a0161a30 2024-06-02T22:52:34.884 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T22:52:34.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.886+0000 7f40a5658640 1 -- 172.21.15.82:0/623780679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f408c06be30 msgr2=0x7f408c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:34.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.886+0000 7f40a5658640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f408c06be30 0x7f408c06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4090033000 tx=0x7f4090009000 comp rx=0 tx=0).stop 2024-06-02T22:52:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.886+0000 7f40a5658640 1 -- 172.21.15.82:0/623780679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0161a30 msgr2=0x7f40a00cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.886+0000 7f40a5658640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0161a30 0x7f40a00cc5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f409400c400 tx=0x7f409400c8c0 comp rx=0 tx=0).stop 2024-06-02T22:52:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.886+0000 7f40a5658640 1 -- 172.21.15.82:0/623780679 shutdown_connections 2024-06-02T22:52:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.886+0000 7f40a5658640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f408c06be30 0x7f408c06e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.886+0000 7f40a5658640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40a0162190 0x7f40a00b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.886+0000 7f40a5658640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0161a30 0x7f40a00cc5a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.886+0000 7f40a5658640 1 --2- 172.21.15.82:0/623780679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40a006d050 0x7f40a01e92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.886+0000 7f40a5658640 1 -- 172.21.15.82:0/623780679 >> 172.21.15.82:0/623780679 conn(0x7f40a009d3c0 msgr2=0x7f40a00d46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.887+0000 7f40a5658640 1 -- 172.21.15.82:0/623780679 shutdown_connections 2024-06-02T22:52:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:34.887+0000 7f40a5658640 1 -- 172.21.15.82:0/623780679 wait complete. 2024-06-02T22:52:34.897 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T22:52:34.897 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:52:34.897 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2024-06-02T22:52:34.897 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-06-02T22:52:34.898 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-02T22:52:34.898 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T22:52:34.898 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:52:34.898 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:52:34.898 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-06-02T22:52:34.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:34.898 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2024-06-02T22:52:34.917 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:52:34.917 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:52:34.917 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:52:34.918 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:34.919 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T22:52:34.919 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-06-02T22:52:34.919 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2024-06-02T22:52:34.919 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:34.919 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T22:52:34.919 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:34.919 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-06-02T22:52:34.919 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add name ceph-brx type bridge 2024-06-02T22:52:34.919 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr flush dev ceph-brx 2024-06-02T22:52:34.920 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set ceph-brx up 2024-06-02T22:52:34.920 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T22:52:34.920 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-06-02T22:52:35.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:35.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:35.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:35.249 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:52:35.275 INFO:teuthology.orchestra.run.smithi184.stdout:1 2024-06-02T22:52:35.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:35.276 DEBUG:teuthology.orchestra.run.smithi184:> route 2024-06-02T22:52:35.347 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2024-06-02T22:52:35.347 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:52:35.348 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T22:52:35.348 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T22:52:35.348 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:52:35.348 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:35.348 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-06-02T22:52:35.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T22:52:35.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T22:52:35.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T22:52:35.348 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-06-02T22:52:35.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:35.612 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:35.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:35.618 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2024-06-02T22:52:35.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:35.634 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2024-06-02T22:52:35.689 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:35.689 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-06-02T22:52:35.689 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T22:52:35.690 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-06-02T22:52:35.690 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-06-02T22:52:35.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:35.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:35.806 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-06-02T22:52:35.807 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:35.807 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-06-02T22:52:35.807 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-06-02T22:52:35.807 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T22:52:35.807 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-06-02T22:52:35.807 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-06-02T22:52:35.807 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-06-02T22:52:35.807 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-06-02T22:52:35.856 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:35.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:35.933 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:35.933 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-06-02T22:52:35.933 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2024-06-02T22:52:35.934 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T22:52:35.934 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-06-02T22:52:35.982 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:36.004 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:36.010 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-06-02T22:52:36.010 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:52:36.010 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-06-02T22:52:36.025 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-06-02T22:52:36.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:52:36.026 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-06-02T22:52:36.081 DEBUG:teuthology.orchestra.run.smithi184:> sudo modprobe fuse 2024-06-02T22:52:36.146 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:52:36.202 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2024-06-02T22:52:36.202 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2024-06-02T22:52:36.202 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2024-06-02T22:52:36.202 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2024-06-02T22:52:36.202 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2024-06-02T22:52:36.202 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2024-06-02T22:52:36.202 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2024-06-02T22:52:36.202 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/selinux 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:52:36.203 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T22:52:36.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:36.205 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2024-06-02T22:52:36.257 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T22:52:36.258 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-06-02T22:52:36.300 DEBUG:teuthology.orchestra.run.smithi184:> sudo modprobe fuse 2024-06-02T22:52:36.324 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:52:36.380 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2024-06-02T22:52:36.380 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2024-06-02T22:52:36.380 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2024-06-02T22:52:36.380 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2024-06-02T22:52:36.380 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2024-06-02T22:52:36.380 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2024-06-02T22:52:36.381 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2024-06-02T22:52:36.381 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2024-06-02T22:52:36.381 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2024-06-02T22:52:36.381 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2024-06-02T22:52:36.381 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2024-06-02T22:52:36.381 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/selinux 2024-06-02T22:52:36.381 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:52:36.381 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2024-06-02T22:52:36.381 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2024-06-02T22:52:36.381 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2024-06-02T22:52:36.381 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2024-06-02T22:52:36.382 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2024-06-02T22:52:36.382 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2024-06-02T22:52:36.382 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:52:36.382 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:52:36.382 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:52:36.382 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:52:36.382 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2024-06-02T22:52:36.382 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2024-06-02T22:52:36.382 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2024-06-02T22:52:36.382 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2024-06-02T22:52:36.382 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2024-06-02T22:52:36.383 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2024-06-02T22:52:36.383 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2024-06-02T22:52:36.383 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T22:52:36.383 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T22:52:36.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:36.383 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2024-06-02T22:52:36.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2024-06-02T22:52:36.412+0000 7fb066722480 -1 init, newargv = 0x5617030552b0 newargc=15 2024-06-02T22:52:36.413 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[43661]: starting ceph client 2024-06-02T22:52:36.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[43661]: starting fuse 2024-06-02T22:52:36.427 INFO:teuthology.orchestra.run.smithi184.stdout:40 2024-06-02T22:52:36.428 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T22:52:36.428 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:52:36.428 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2024-06-02T22:52:36.428 DEBUG:teuthology.orchestra.run.smithi184:> import re 2024-06-02T22:52:36.428 DEBUG:teuthology.orchestra.run.smithi184:> import os 2024-06-02T22:52:36.428 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2024-06-02T22:52:36.428 DEBUG:teuthology.orchestra.run.smithi184:> 2024-06-02T22:52:36.428 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2024-06-02T22:52:36.428 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-06-02T22:52:36.428 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2024-06-02T22:52:36.428 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> return f 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> 2024-06-02T22:52:36.429 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2024-06-02T22:52:36.430 DEBUG:teuthology.orchestra.run.smithi184:> ' 2024-06-02T22:52:36.546 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.43661.asok 2024-06-02T22:52:36.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:36.557 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43661.asok 2024-06-02T22:52:36.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:36.557 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43661.asok status 2024-06-02T22:52:36.693 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-06-02T22:52:36.693 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2024-06-02T22:52:36.693 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:52:36.693 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:52:36.693 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "43661", 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 4541, 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 4541 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-02T22:52:36.694 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 715451971 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 715451971 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.4541 192.168.0.1:0/715451971", 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/715451971", 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2024-06-02T22:52:36.695 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 8, 2024-06-02T22:52:36.696 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 24, 2024-06-02T22:52:36.696 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:52:36.696 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2024-06-02T22:52:36.696 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2024-06-02T22:52:36.696 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-06-02T22:52:36.702 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T22:52:36.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.814+0000 7f0d60af5640 1 Processor -- start 2024-06-02T22:52:36.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.814+0000 7f0d60af5640 1 -- start start 2024-06-02T22:52:36.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.815+0000 7f0d60af5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d5c0af3b0 0x7f0d5c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:36.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.815+0000 7f0d60af5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c15ac50 con 0x7f0d5c0aef70 2024-06-02T22:52:36.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.815+0000 7f0d60af5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c06cdb0 con 0x7f0d5c15a870 2024-06-02T22:52:36.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.815+0000 7f0d60af5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0d5c06d090 con 0x7f0d5c0af3b0 2024-06-02T22:52:36.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.815+0000 7f0d53fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0d5c0aef70 0x7f0d5c0b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51944/0 (socket says 172.21.15.82:51944) 2024-06-02T22:52:36.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.815+0000 7f0d5ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d5c0af3b0 0x7f0d5c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:36.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.815+0000 7f0d53fff640 1 -- 172.21.15.82:0/1253330868 learned_addr learned my addr 172.21.15.82:0/1253330868 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:36.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.815+0000 7f0d5ad9d640 1 -- 172.21.15.82:0/1253330868 >> v1:172.21.15.184:6789/0 conn(0x7f0d5c15a870 legacy=0x7f0d5c06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:36.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.815+0000 7f0d5ad9d640 1 -- 172.21.15.82:0/1253330868 >> v1:172.21.15.82:6789/0 conn(0x7f0d5c0aef70 legacy=0x7f0d5c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:36.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.816+0000 7f0d5ad9d640 1 -- 172.21.15.82:0/1253330868 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c06d370 con 0x7f0d5c0af3b0 2024-06-02T22:52:36.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.815+0000 7f0d59d9b640 1 -- 172.21.15.82:0/1253330868 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2773999460 0 0) 0x7f0d5c15ac50 con 0x7f0d5c0aef70 2024-06-02T22:52:36.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.816+0000 7f0d5ad9d640 1 --2- 172.21.15.82:0/1253330868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5c0af3b0 0x7f0d5c0cdb40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4975bace7b7b38 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:36.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.816+0000 7f0d59d9b640 1 -- 172.21.15.82:0/1253330868 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54031600 con 0x7f0d5c0af3b0 2024-06-02T22:52:36.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.816+0000 7f0d59d9b640 1 -- 172.21.15.82:0/1253330868 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d540317a0 con 0x7f0d5c0af3b0 2024-06-02T22:52:36.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.816+0000 7f0d59d9b640 1 -- 172.21.15.82:0/1253330868 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54031b70 con 0x7f0d5c0af3b0 2024-06-02T22:52:36.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.817+0000 7f0d60af5640 1 -- 172.21.15.82:0/1253330868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5c0af3b0 msgr2=0x7f0d5c0cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:36.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.817+0000 7f0d60af5640 1 --2- 172.21.15.82:0/1253330868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5c0af3b0 0x7f0d5c0cdb40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5402a610 comp rx=0 tx=0).stop 2024-06-02T22:52:36.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.817+0000 7f0d60af5640 1 -- 172.21.15.82:0/1253330868 shutdown_connections 2024-06-02T22:52:36.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.817+0000 7f0d60af5640 1 --2- 172.21.15.82:0/1253330868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5c0af3b0 0x7f0d5c0cdb40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:36.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.817+0000 7f0d60af5640 1 -- 172.21.15.82:0/1253330868 >> 172.21.15.82:0/1253330868 conn(0x7f0d5c0b19f0 msgr2=0x7f0d5c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:36.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.817+0000 7f0d60af5640 1 -- 172.21.15.82:0/1253330868 shutdown_connections 2024-06-02T22:52:36.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.817+0000 7f0d60af5640 1 -- 172.21.15.82:0/1253330868 wait complete. 2024-06-02T22:52:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.818+0000 7f0d60af5640 1 Processor -- start 2024-06-02T22:52:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.818+0000 7f0d60af5640 1 -- start start 2024-06-02T22:52:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d60af5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5c0aef70 0x7f0d5c0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d60af5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d5c0af3b0 0x7f0d5c156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d60af5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5c15a870 0x7f0d5c1e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d60af5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c0b2e40 con 0x7f0d5c15a870 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d60af5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c06d930 con 0x7f0d5c0aef70 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d60af5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c0b2fc0 con 0x7f0d5c0af3b0 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d5ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5c15a870 0x7f0d5c1e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d5ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5c15a870 0x7f0d5c1e6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55194/0 (socket says 172.21.15.82:55194) 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d5ad9d640 1 -- 172.21.15.82:0/2287724422 learned_addr learned my addr 172.21.15.82:0/2287724422 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d53fff640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d5c0af3b0 0x7f0d5c156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d5a59c640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5c0aef70 0x7f0d5c0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d5ad9d640 1 -- 172.21.15.82:0/2287724422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d5c0af3b0 msgr2=0x7f0d5c156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d5ad9d640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d5c0af3b0 0x7f0d5c156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d5ad9d640 1 -- 172.21.15.82:0/2287724422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5c0aef70 msgr2=0x7f0d5c0ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.819+0000 7f0d5ad9d640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5c0aef70 0x7f0d5c0ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.820+0000 7f0d5ad9d640 1 -- 172.21.15.82:0/2287724422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c157310 con 0x7f0d5c15a870 2024-06-02T22:52:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.820+0000 7f0d5a59c640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5c0aef70 0x7f0d5c0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.820+0000 7f0d5ad9d640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5c15a870 0x7f0d5c1e6a00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d5402ac00 tx=0x7f0d54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.820+0000 7f0d52ffd640 1 -- 172.21.15.82:0/2287724422 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54040070 con 0x7f0d5c15a870 2024-06-02T22:52:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.820+0000 7f0d52ffd640 1 -- 172.21.15.82:0/2287724422 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d54030b60 con 0x7f0d5c15a870 2024-06-02T22:52:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.820+0000 7f0d52ffd640 1 -- 172.21.15.82:0/2287724422 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54045460 con 0x7f0d5c15a870 2024-06-02T22:52:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.820+0000 7f0d60af5640 1 -- 172.21.15.82:0/2287724422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c1575f0 con 0x7f0d5c15a870 2024-06-02T22:52:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.820+0000 7f0d60af5640 1 -- 172.21.15.82:0/2287724422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c157bb0 con 0x7f0d5c15a870 2024-06-02T22:52:36.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.821+0000 7f0d60af5640 1 -- 172.21.15.82:0/2287724422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5c0b4140 con 0x7f0d5c15a870 2024-06-02T22:52:36.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.821+0000 7f0d52ffd640 1 -- 172.21.15.82:0/2287724422 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d54039040 con 0x7f0d5c15a870 2024-06-02T22:52:36.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.822+0000 7f0d52ffd640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0d3c06be30 0x7f0d3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:36.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.822+0000 7f0d52ffd640 1 -- 172.21.15.82:0/2287724422 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0d540ac9d0 con 0x7f0d5c15a870 2024-06-02T22:52:36.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.822+0000 7f0d5a59c640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0d3c06be30 0x7f0d3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:36.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.822+0000 7f0d5a59c640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0d3c06be30 0x7f0d3c06e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c006fd0 tx=0x7f0d4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:36.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:36.826+0000 7f0d52ffd640 1 -- 172.21.15.82:0/2287724422 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0d5c0b4140 con 0x7f0d5c15a870 2024-06-02T22:52:37.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.039+0000 7f0d60af5640 1 -- 172.21.15.82:0/2287724422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0d5c068430 con 0x7f0d5c15a870 2024-06-02T22:52:37.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.040+0000 7f0d52ffd640 1 -- 172.21.15.82:0/2287724422 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f0d5407b070 con 0x7f0d5c15a870 2024-06-02T22:52:37.039 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T22:52:37.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.041+0000 7f0d60af5640 1 -- 172.21.15.82:0/2287724422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0d3c06be30 msgr2=0x7f0d3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:37.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.041+0000 7f0d60af5640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0d3c06be30 0x7f0d3c06e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c006fd0 tx=0x7f0d4c008040 comp rx=0 tx=0).stop 2024-06-02T22:52:37.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.041+0000 7f0d60af5640 1 -- 172.21.15.82:0/2287724422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5c15a870 msgr2=0x7f0d5c1e6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:37.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.041+0000 7f0d60af5640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5c15a870 0x7f0d5c1e6a00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d5402ac00 tx=0x7f0d54004a40 comp rx=0 tx=0).stop 2024-06-02T22:52:37.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.041+0000 7f0d60af5640 1 -- 172.21.15.82:0/2287724422 shutdown_connections 2024-06-02T22:52:37.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.041+0000 7f0d60af5640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0d3c06be30 0x7f0d3c06e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:37.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.041+0000 7f0d60af5640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5c15a870 0x7f0d5c1e6a00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:37.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.041+0000 7f0d60af5640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d5c0af3b0 0x7f0d5c156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:37.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.041+0000 7f0d60af5640 1 --2- 172.21.15.82:0/2287724422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d5c0aef70 0x7f0d5c0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:37.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.041+0000 7f0d60af5640 1 -- 172.21.15.82:0/2287724422 >> 172.21.15.82:0/2287724422 conn(0x7f0d5c0b19f0 msgr2=0x7f0d5c159ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:37.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.042+0000 7f0d60af5640 1 -- 172.21.15.82:0/2287724422 shutdown_connections 2024-06-02T22:52:37.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:37.042+0000 7f0d60af5640 1 -- 172.21.15.82:0/2287724422 wait complete. 2024-06-02T22:52:37.052 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T22:52:37.052 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:52:37.052 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2024-06-02T22:52:37.053 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-06-02T22:52:37.053 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-06-02T22:52:37.053 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T22:52:37.053 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:52:37.053 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:52:37.053 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-06-02T22:52:37.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:37.053 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2024-06-02T22:52:37.069 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:52:37.069 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:52:37.069 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:52:37.069 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.069 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42745sec preferred_lft 42745sec 2024-06-02T22:52:37.070 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2024-06-02T22:52:37.071 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.071 INFO:teuthology.orchestra.run.smithi184.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:52:37.071 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether e6:73:0b:09:61:13 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:52:37.071 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T22:52:37.071 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.071 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::8c0a:d0ff:fe40:7a28/64 scope link 2024-06-02T22:52:37.071 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.071 INFO:teuthology.orchestra.run.smithi184.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:52:37.071 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether e6:73:0b:09:61:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T22:52:37.071 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::e473:bff:fe09:6113/64 scope link tentative 2024-06-02T22:52:37.071 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:37.073 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:52:37.132 INFO:teuthology.orchestra.run.smithi184.stdout:1 2024-06-02T22:52:37.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:37.134 DEBUG:teuthology.orchestra.run.smithi184:> route 2024-06-02T22:52:37.190 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2024-06-02T22:52:37.191 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:52:37.191 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T22:52:37.191 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T22:52:37.191 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:52:37.191 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:37.191 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-06-02T22:52:37.191 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T22:52:37.191 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T22:52:37.191 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T22:52:37.191 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-06-02T22:52:37.278 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:37.310 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:37.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:37.316 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2024-06-02T22:52:37.331 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-06-02T22:52:37.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:37.332 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2024-06-02T22:52:37.387 INFO:teuthology.orchestra.run.smithi184.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-06-02T22:52:37.387 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:37.387 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-06-02T22:52:37.387 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T22:52:37.387 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-06-02T22:52:37.387 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-06-02T22:52:37.475 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:37.498 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:37.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:37.504 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-06-02T22:52:37.529 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:52:37.529 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:52:37.529 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:52:37.529 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.529 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2024-06-02T22:52:37.529 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.529 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:52:37.529 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 22:fb:09:00:22:bc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T22:52:37.529 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T22:52:37.529 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.529 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::20fb:9ff:fe00:22bc/64 scope link 2024-06-02T22:52:37.530 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:37.531 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-06-02T22:52:37.595 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:52:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:52:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:52:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2024-06-02T22:52:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.595 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:52:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 22:fb:09:00:22:bc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T22:52:37.595 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T22:52:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::20fb:9ff:fe00:22bc/64 scope link 2024-06-02T22:52:37.596 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:52:37.597 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-06-02T22:52:37.597 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:37.597 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-06-02T22:52:37.597 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-06-02T22:52:37.597 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-06-02T22:52:37.598 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-06-02T22:52:37.598 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-06-02T22:52:37.598 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-06-02T22:52:37.598 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-06-02T22:52:37.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:37.743 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:37.749 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:52:37.749 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-06-02T22:52:37.749 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.1 up 2024-06-02T22:52:37.749 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.1 master ceph-brx 2024-06-02T22:52:37.749 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-06-02T22:52:37.798 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:52:37.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:37.826 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-06-02T22:52:37.827 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:52:37.827 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-06-02T22:52:37.842 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-06-02T22:52:37.843 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:52:37.843 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-06-02T22:52:37.898 DEBUG:teuthology.orchestra.run.smithi184:> sudo modprobe fuse 2024-06-02T22:52:37.963 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:52:38.020 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2024-06-02T22:52:38.020 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2024-06-02T22:52:38.020 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2024-06-02T22:52:38.020 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2024-06-02T22:52:38.020 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2024-06-02T22:52:38.020 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2024-06-02T22:52:38.020 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2024-06-02T22:52:38.020 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2024-06-02T22:52:38.020 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2024-06-02T22:52:38.020 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/selinux 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:52:38.021 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T22:52:38.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:38.023 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2024-06-02T22:52:38.076 INFO:teuthology.orchestra.run.smithi184.stdout:40 2024-06-02T22:52:38.076 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2024-06-02T22:52:38.076 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-06-02T22:52:38.119 DEBUG:teuthology.orchestra.run.smithi184:> sudo modprobe fuse 2024-06-02T22:52:38.143 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2024-06-02T22:52:38.200 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/selinux 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2024-06-02T22:52:38.201 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2024-06-02T22:52:38.202 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2024-06-02T22:52:38.202 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2024-06-02T22:52:38.202 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2024-06-02T22:52:38.202 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2024-06-02T22:52:38.202 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T22:52:38.202 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T22:52:38.202 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2024-06-02T22:52:38.202 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T22:52:38.202 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T22:52:38.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:38.203 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2024-06-02T22:52:38.204 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi184.stderr:2024-06-02T22:52:38.201+0000 7fdb78646480 -1 init, newargv = 0x55bd6c70d620 newargc=15 2024-06-02T22:52:38.204 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi184.stderr:ceph-fuse[44099]: starting ceph client 2024-06-02T22:52:38.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi184.stderr:ceph-fuse[44099]: starting fuse 2024-06-02T22:52:38.220 INFO:teuthology.orchestra.run.smithi184.stdout:40 2024-06-02T22:52:38.220 INFO:teuthology.orchestra.run.smithi184.stdout:43 2024-06-02T22:52:38.220 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 43] 2024-06-02T22:52:38.220 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> import re 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> import os 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2024-06-02T22:52:38.221 DEBUG:teuthology.orchestra.run.smithi184:> 2024-06-02T22:52:38.222 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2024-06-02T22:52:38.222 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:52:38.222 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:52:38.222 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:52:38.222 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2024-06-02T22:52:38.222 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2024-06-02T22:52:38.222 DEBUG:teuthology.orchestra.run.smithi184:> return f 2024-06-02T22:52:38.222 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:52:38.222 DEBUG:teuthology.orchestra.run.smithi184:> 2024-06-02T22:52:38.222 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.3")) 2024-06-02T22:52:38.222 DEBUG:teuthology.orchestra.run.smithi184:> ' 2024-06-02T22:52:38.338 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.3.44099.asok 2024-06-02T22:52:38.341 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-02T22:52:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:52:38.348 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44099.asok 2024-06-02T22:52:38.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:38.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44099.asok status 2024-06-02T22:52:38.482 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-06-02T22:52:38.482 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2024-06-02T22:52:38.482 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:52:38.482 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:52:38.482 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "3", 2024-06-02T22:52:38.482 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2024-06-02T22:52:38.482 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "44099", 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 4547, 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 4547 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2024-06-02T22:52:38.483 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.2:0", 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 4248411018 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.2:0", 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 4248411018 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.4547 192.168.0.2:0/4248411018", 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.2:0/4248411018", 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 8, 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 24, 2024-06-02T22:52:38.484 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:52:38.485 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2024-06-02T22:52:38.485 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2024-06-02T22:52:38.485 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-06-02T22:52:38.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:38.490 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-06-02T22:52:38.490 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-02T22:52:38.510 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-06-02T22:52:38.510 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-02T22:52:38.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:38.510 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:52:38.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:38.581 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-06-02T22:52:38.581 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.2 2024-06-02T22:52:38.640 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-06-02T22:52:38.641 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-06-02T22:52:38.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:38.641 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-06-02T22:52:38.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:38.709 DEBUG:teuthology.orchestra.run.smithi184:> stat --file-system '--printf=%T 2024-06-02T22:52:38.709 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2024-06-02T22:52:38.725 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2024-06-02T22:52:38.725 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-06-02T22:52:38.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:38.725 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-06-02T22:52:38.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:38.791 DEBUG:teuthology.orchestra.run.smithi184:> stat --file-system '--printf=%T 2024-06-02T22:52:38.791 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.3 2024-06-02T22:52:38.847 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2024-06-02T22:52:38.848 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-06-02T22:52:38.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:38.848 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-06-02T22:52:38.914 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-06-02T22:52:38.960 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2024-06-02T22:52:38.961 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-06-02T22:52:38.961 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.071+0000 7fa2c1370640 1 Processor -- start 2024-06-02T22:52:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.071+0000 7fa2c1370640 1 -- start start 2024-06-02T22:52:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.072+0000 7fa2c1370640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa2bc072370 0x7fa2bc166c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.072+0000 7fa2c1370640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2bc072820 con 0x7fa2bc0b46d0 2024-06-02T22:52:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.072+0000 7fa2c1370640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2bc072b00 con 0x7fa2bc0cc6d0 2024-06-02T22:52:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.072+0000 7fa2c1370640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fa2bc072de0 con 0x7fa2bc072370 2024-06-02T22:52:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.072+0000 7fa2b27fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa2bc0b46d0 0x7fa2bc071c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51958/0 (socket says 172.21.15.82:51958) 2024-06-02T22:52:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.072+0000 7fa2b27fc640 1 -- 172.21.15.82:0/2920968498 learned_addr learned my addr 172.21.15.82:0/2920968498 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.072+0000 7fa2bb7fe640 1 --2- 172.21.15.82:0/2920968498 >> v2:172.21.15.184:3300/0 conn(0x7fa2bc072370 0x7fa2bc166c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.073+0000 7fa2ba7fc640 1 -- 172.21.15.82:0/2920968498 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2187929898 0 0) 0x7fa2bc072820 con 0x7fa2bc0b46d0 2024-06-02T22:52:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.073+0000 7fa2ba7fc640 1 -- 172.21.15.82:0/2920968498 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a8003520 con 0x7fa2bc0b46d0 2024-06-02T22:52:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.073+0000 7fa2ba7fc640 1 -- 172.21.15.82:0/2920968498 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2886522445 0 0) 0x7fa2bc072b00 con 0x7fa2bc0cc6d0 2024-06-02T22:52:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.073+0000 7fa2ba7fc640 1 -- 172.21.15.82:0/2920968498 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2bc072820 con 0x7fa2bc0cc6d0 2024-06-02T22:52:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.073+0000 7fa2bb7fe640 1 -- 172.21.15.82:0/2920968498 >> v1:172.21.15.184:6789/0 conn(0x7fa2bc0cc6d0 legacy=0x7fa2bc0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.073+0000 7fa2bb7fe640 1 -- 172.21.15.82:0/2920968498 >> v1:172.21.15.82:6789/0 conn(0x7fa2bc0b46d0 legacy=0x7fa2bc071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.073+0000 7fa2bb7fe640 1 -- 172.21.15.82:0/2920968498 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc0b31a0 con 0x7fa2bc072370 2024-06-02T22:52:39.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.073+0000 7fa2bb7fe640 1 --2- 172.21.15.82:0/2920968498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2bc072370 0x7fa2bc166c40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009d90 tx=0x7fa2b402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a33a044ddefef10 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.074+0000 7fa2ba7fc640 1 -- 172.21.15.82:0/2920968498 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4007740 con 0x7fa2bc072370 2024-06-02T22:52:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.074+0000 7fa2ba7fc640 1 -- 172.21.15.82:0/2920968498 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b40078e0 con 0x7fa2bc072370 2024-06-02T22:52:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.074+0000 7fa2ba7fc640 1 -- 172.21.15.82:0/2920968498 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4007cb0 con 0x7fa2bc072370 2024-06-02T22:52:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.074+0000 7fa2c1370640 1 -- 172.21.15.82:0/2920968498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2bc072370 msgr2=0x7fa2bc166c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.074+0000 7fa2c1370640 1 --2- 172.21.15.82:0/2920968498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2bc072370 0x7fa2bc166c40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009d90 tx=0x7fa2b402a6f0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.074+0000 7fa2c1370640 1 -- 172.21.15.82:0/2920968498 shutdown_connections 2024-06-02T22:52:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.074+0000 7fa2c1370640 1 --2- 172.21.15.82:0/2920968498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2bc072370 0x7fa2bc166c40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.074+0000 7fa2c1370640 1 -- 172.21.15.82:0/2920968498 >> 172.21.15.82:0/2920968498 conn(0x7fa2bc0b19f0 msgr2=0x7fa2bc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.074+0000 7fa2c1370640 1 -- 172.21.15.82:0/2920968498 shutdown_connections 2024-06-02T22:52:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.074+0000 7fa2c1370640 1 -- 172.21.15.82:0/2920968498 wait complete. 2024-06-02T22:52:39.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.075+0000 7fa2c1370640 1 Processor -- start 2024-06-02T22:52:39.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.076+0000 7fa2c1370640 1 -- start start 2024-06-02T22:52:39.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.076+0000 7fa2c1370640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2bc072370 0x7fa2bc0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.076+0000 7fa2c1370640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2bc0b46d0 0x7fa2bc157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.076+0000 7fa2c1370640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2bc0cc6d0 0x7fa2bc15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.076+0000 7fa2c1370640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc167180 con 0x7fa2bc072370 2024-06-02T22:52:39.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.076+0000 7fa2c1370640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc159f60 con 0x7fa2bc0b46d0 2024-06-02T22:52:39.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.076+0000 7fa2c1370640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa2bc167300 con 0x7fa2bc0cc6d0 2024-06-02T22:52:39.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2baffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2bc072370 0x7fa2bc0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2baffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2bc072370 0x7fa2bc0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55210/0 (socket says 172.21.15.82:55210) 2024-06-02T22:52:39.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2baffd640 1 -- 172.21.15.82:0/3835440817 learned_addr learned my addr 172.21.15.82:0/3835440817 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:39.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2b27fc640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2bc0b46d0 0x7fa2bc157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2bb7fe640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2bc0cc6d0 0x7fa2bc15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2baffd640 1 -- 172.21.15.82:0/3835440817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2bc0cc6d0 msgr2=0x7fa2bc15a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2baffd640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2bc0cc6d0 0x7fa2bc15a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2baffd640 1 -- 172.21.15.82:0/3835440817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2bc0b46d0 msgr2=0x7fa2bc157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2baffd640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2bc0b46d0 0x7fa2bc157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2baffd640 1 -- 172.21.15.82:0/3835440817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc06e580 con 0x7fa2bc072370 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2baffd640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2bc072370 0x7fa2bc0caa90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00c530 tx=0x7fa2ac00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2b3fff640 1 -- 172.21.15.82:0/3835440817 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0052d0 con 0x7fa2bc072370 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2b3fff640 1 -- 172.21.15.82:0/3835440817 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ac005490 con 0x7fa2bc072370 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2c1370640 1 -- 172.21.15.82:0/3835440817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2bc06e860 con 0x7fa2bc072370 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2b3fff640 1 -- 172.21.15.82:0/3835440817 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac012870 con 0x7fa2bc072370 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.077+0000 7fa2c1370640 1 -- 172.21.15.82:0/3835440817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2bc15c240 con 0x7fa2bc072370 2024-06-02T22:52:39.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.078+0000 7fa2c1370640 1 -- 172.21.15.82:0/3835440817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2bc068430 con 0x7fa2bc072370 2024-06-02T22:52:39.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.079+0000 7fa2b3fff640 1 -- 172.21.15.82:0/3835440817 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2ac012a10 con 0x7fa2bc072370 2024-06-02T22:52:39.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.079+0000 7fa2b3fff640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa29c06be30 0x7fa29c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.079+0000 7fa2b3fff640 1 -- 172.21.15.82:0/3835440817 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa2ac08aeb0 con 0x7fa2bc072370 2024-06-02T22:52:39.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.079+0000 7fa2b27fc640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa29c06be30 0x7fa29c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.080+0000 7fa2b27fc640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa29c06be30 0x7fa29c06e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc153f20 tx=0x7fa2a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:39.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.084+0000 7fa2b3fff640 1 -- 172.21.15.82:0/3835440817 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa2ac059530 con 0x7fa2bc072370 2024-06-02T22:52:39.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.260+0000 7fa2c1370640 1 -- 172.21.15.82:0/3835440817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2bc0ae110 con 0x7fa2bc072370 2024-06-02T22:52:39.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.261+0000 7fa2b3fff640 1 -- 172.21.15.82:0/3835440817 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7fa2ac058e30 con 0x7fa2bc072370 2024-06-02T22:52:39.466 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:39.466 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:07.942945+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:39.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 -- 172.21.15.82:0/3835440817 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa29c06be30 msgr2=0x7fa29c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa29c06be30 0x7fa29c06e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc153f20 tx=0x7fa2a4009040 comp rx=0 tx=0).stop 2024-06-02T22:52:39.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 -- 172.21.15.82:0/3835440817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2bc072370 msgr2=0x7fa2bc0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2bc072370 0x7fa2bc0caa90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00c530 tx=0x7fa2ac00c9f0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 -- 172.21.15.82:0/3835440817 shutdown_connections 2024-06-02T22:52:39.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa29c06be30 0x7fa29c06e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2bc0cc6d0 0x7fa2bc15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2bc0b46d0 0x7fa2bc157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 --2- 172.21.15.82:0/3835440817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2bc072370 0x7fa2bc0caa90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 -- 172.21.15.82:0/3835440817 >> 172.21.15.82:0/3835440817 conn(0x7fa2bc0b19f0 msgr2=0x7fa2bc0ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:39.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 -- 172.21.15.82:0/3835440817 shutdown_connections 2024-06-02T22:52:39.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.263+0000 7fa2c1370640 1 -- 172.21.15.82:0/3835440817 wait complete. 2024-06-02T22:52:39.471 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T22:51:51.853867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T22:52:00.634690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T22:52:01.883112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T22:52:05.594970+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T22:52:39.471 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T22:52:39.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.576+0000 7f21fbd9e640 1 Processor -- start 2024-06-02T22:52:39.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.577+0000 7f21fbd9e640 1 -- start start 2024-06-02T22:52:39.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.577+0000 7f21fbd9e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21f40d0020 0x7f21f40d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21fbd9e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f21f406e1f0 0x7f21f406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21fbd9e640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f4155700 con 0x7f21f4155320 2024-06-02T22:52:39.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21fbd9e640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f21f40d09c0 con 0x7f21f406e1f0 2024-06-02T22:52:39.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21fbd9e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f21f415b6b0 con 0x7f21f40d0020 2024-06-02T22:52:39.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21fa33b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f21f406e1f0 0x7f21f406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21f9339640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21f40d0020 0x7f21f40d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21fa33b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f21f406e1f0 0x7f21f406e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47498/0 (socket says 172.21.15.82:47498) 2024-06-02T22:52:39.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21f9339640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21f40d0020 0x7f21f40d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:49480/0 (socket says 172.21.15.82:49480) 2024-06-02T22:52:39.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21fa33b640 1 -- 172.21.15.82:0/4078794283 learned_addr learned my addr 172.21.15.82:0/4078794283 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:39.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21fa33b640 1 -- 172.21.15.82:0/4078794283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21f40d0020 msgr2=0x7f21f40d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:39.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21fa33b640 1 --2- 172.21.15.82:0/4078794283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21f40d0020 0x7f21f40d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21fa33b640 1 -- 172.21.15.82:0/4078794283 >> v1:172.21.15.184:6789/0 conn(0x7f21f4155320 legacy=0x7f21f40b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.578+0000 7f21fa33b640 1 -- 172.21.15.82:0/4078794283 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f415b990 con 0x7f21f406e1f0 2024-06-02T22:52:39.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.579+0000 7f21fa33b640 1 --2- 172.21.15.82:0/4078794283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21f406e1f0 0x7f21f406e680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00d150 tx=0x7f21ec02c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa2d7b7f775aad1b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.579+0000 7f21f8b38640 1 -- 172.21.15.82:0/4078794283 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec009600 con 0x7f21f406e1f0 2024-06-02T22:52:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.579+0000 7f21f8b38640 1 -- 172.21.15.82:0/4078794283 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec037070 con 0x7f21f406e1f0 2024-06-02T22:52:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.579+0000 7f21f8b38640 1 -- 172.21.15.82:0/4078794283 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0099c0 con 0x7f21f406e1f0 2024-06-02T22:52:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.580+0000 7f21fbd9e640 1 -- 172.21.15.82:0/4078794283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21f406e1f0 msgr2=0x7f21f406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.580+0000 7f21fbd9e640 1 --2- 172.21.15.82:0/4078794283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21f406e1f0 0x7f21f406e680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00d150 tx=0x7f21ec02c930 comp rx=0 tx=0).stop 2024-06-02T22:52:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.580+0000 7f21fbd9e640 1 -- 172.21.15.82:0/4078794283 shutdown_connections 2024-06-02T22:52:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.580+0000 7f21fbd9e640 1 --2- 172.21.15.82:0/4078794283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21f406e1f0 0x7f21f406e680 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.580+0000 7f21fbd9e640 1 --2- 172.21.15.82:0/4078794283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21f40d0020 0x7f21f40d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.580+0000 7f21fbd9e640 1 -- 172.21.15.82:0/4078794283 >> 172.21.15.82:0/4078794283 conn(0x7f21f40b1d10 msgr2=0x7f21f40b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.580+0000 7f21fbd9e640 1 -- 172.21.15.82:0/4078794283 shutdown_connections 2024-06-02T22:52:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.580+0000 7f21fbd9e640 1 -- 172.21.15.82:0/4078794283 wait complete. 2024-06-02T22:52:39.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.581+0000 7f21fbd9e640 1 Processor -- start 2024-06-02T22:52:39.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.581+0000 7f21fbd9e640 1 -- start start 2024-06-02T22:52:39.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21fbd9e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21f406e1f0 0x7f21f40b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21fbd9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f40d0020 0x7f21f415ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21fbd9e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21f4155320 0x7f21f415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21fbd9e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21f406ebc0 con 0x7f21f40d0020 2024-06-02T22:52:39.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21fbd9e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f21f415bf50 con 0x7f21f4155320 2024-06-02T22:52:39.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21fbd9e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f21f40b1200 con 0x7f21f406e1f0 2024-06-02T22:52:39.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21f9339640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f40d0020 0x7f21f415ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21f9339640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f40d0020 0x7f21f415ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55212/0 (socket says 172.21.15.82:55212) 2024-06-02T22:52:39.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21f9339640 1 -- 172.21.15.82:0/2805066063 learned_addr learned my addr 172.21.15.82:0/2805066063 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:39.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21f9b3a640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21f406e1f0 0x7f21f40b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21fa33b640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21f4155320 0x7f21f415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21f9339640 1 -- 172.21.15.82:0/2805066063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21f406e1f0 msgr2=0x7f21f40b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21f9339640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21f406e1f0 0x7f21f40b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21f9339640 1 -- 172.21.15.82:0/2805066063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21f4155320 msgr2=0x7f21f415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21f9339640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21f4155320 0x7f21f415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21f9339640 1 -- 172.21.15.82:0/2805066063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f4156d10 con 0x7f21f40d0020 2024-06-02T22:52:39.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21fa33b640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21f4155320 0x7f21f415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.582+0000 7f21f9339640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f40d0020 0x7f21f415ebc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f21f000e9e0 tx=0x7f21f000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.583+0000 7f21ea7fc640 1 -- 172.21.15.82:0/2805066063 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0017070 con 0x7f21f40d0020 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.583+0000 7f21ea7fc640 1 -- 172.21.15.82:0/2805066063 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f000c9d0 con 0x7f21f40d0020 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.583+0000 7f21fbd9e640 1 -- 172.21.15.82:0/2805066063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f4156ff0 con 0x7f21f40d0020 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.583+0000 7f21ea7fc640 1 -- 172.21.15.82:0/2805066063 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f000cdc0 con 0x7f21f40d0020 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.583+0000 7f21fbd9e640 1 -- 172.21.15.82:0/2805066063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f41518c0 con 0x7f21f40d0020 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.584+0000 7f21fbd9e640 1 -- 172.21.15.82:0/2805066063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f40683c0 con 0x7f21f40d0020 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.584+0000 7f21ea7fc640 1 -- 172.21.15.82:0/2805066063 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21f001a070 con 0x7f21f40d0020 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.585+0000 7f21ea7fc640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f21d806be60 0x7f21d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.585+0000 7f21ea7fc640 1 -- 172.21.15.82:0/2805066063 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f21f008b470 con 0x7f21f40d0020 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.585+0000 7f21f9b3a640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f21d806be60 0x7f21d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.585+0000 7f21f9b3a640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f21d806be60 0x7f21d806e320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f21f40d08d0 tx=0x7f21e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:39.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.589+0000 7f21ea7fc640 1 -- 172.21.15.82:0/2805066063 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f21f0059490 con 0x7f21f40d0020 2024-06-02T22:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.768+0000 7f21fbd9e640 1 -- 172.21.15.82:0/2805066063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f21f40ad830 con 0x7f21f40d0020 2024-06-02T22:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.768+0000 7f21ea7fc640 1 -- 172.21.15.82:0/2805066063 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f21f005d790 con 0x7f21f40d0020 2024-06-02T22:52:39.770 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-06-02T22:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 -- 172.21.15.82:0/2805066063 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f21d806be60 msgr2=0x7f21d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f21d806be60 0x7f21d806e320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f21f40d08d0 tx=0x7f21e4009040 comp rx=0 tx=0).stop 2024-06-02T22:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 -- 172.21.15.82:0/2805066063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f40d0020 msgr2=0x7f21f415ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f40d0020 0x7f21f415ebc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f21f000e9e0 tx=0x7f21f000eea0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 -- 172.21.15.82:0/2805066063 shutdown_connections 2024-06-02T22:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f21d806be60 0x7f21d806e320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21f4155320 0x7f21f415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f40d0020 0x7f21f415ebc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 --2- 172.21.15.82:0/2805066063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21f406e1f0 0x7f21f40b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 -- 172.21.15.82:0/2805066063 >> 172.21.15.82:0/2805066063 conn(0x7f21f40b1d10 msgr2=0x7f21f40b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 -- 172.21.15.82:0/2805066063 shutdown_connections 2024-06-02T22:52:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.770+0000 7f21fbd9e640 1 -- 172.21.15.82:0/2805066063 wait complete. 2024-06-02T22:52:39.783 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T22:52:39.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.888+0000 7fe19ff61640 1 Processor -- start 2024-06-02T22:52:39.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.888+0000 7fe19ff61640 1 -- start start 2024-06-02T22:52:39.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ff61640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1980b3bf0 0x7fe19806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ff61640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe198155000 con 0x7fe198154c20 2024-06-02T22:52:39.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ff61640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19806dd30 con 0x7fe19806d500 2024-06-02T22:52:39.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ff61640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe19806e010 con 0x7fe1980b3bf0 2024-06-02T22:52:39.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19dcfd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe198154c20 0x7fe1980b34e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51972/0 (socket says 172.21.15.82:51972) 2024-06-02T22:52:39.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19dcfd640 1 -- 172.21.15.82:0/4080858247 learned_addr learned my addr 172.21.15.82:0/4080858247 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2165017273 0 0) 0x7fe198155000 con 0x7fe198154c20 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe184004630 con 0x7fe198154c20 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19d4fc640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1980b3bf0 0x7fe19806cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2537465536 0 0) 0x7fe184004630 con 0x7fe198154c20 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1980b3bf0 msgr2=0x7fe19806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1980b3bf0 0x7fe19806cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 >> v1:172.21.15.184:6789/0 conn(0x7fe19806d500 legacy=0x7fe198071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19806e2f0 con 0x7fe198154c20 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fe194001670 con 0x7fe198154c20 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 >> v1:172.21.15.82:6789/0 conn(0x7fe198154c20 legacy=0x7fe1980b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe184004af0 0x7fe184004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 0x7fe184005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1980b3bf0 0x7fe1840062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe19806e010 con 0x7fe184005910 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe18400cb80 con 0x7fe184004af0 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.889+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe1840034c0 con 0x7fe1980b3bf0 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.890+0000 7fe19d4fc640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 0x7fe184005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.890+0000 7fe19dcfd640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe184004af0 0x7fe184004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.890+0000 7fe19e4fe640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1980b3bf0 0x7fe1840062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.890+0000 7fe19d4fc640 1 -- 172.21.15.82:0/4080858247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1980b3bf0 msgr2=0x7fe1840062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.890+0000 7fe19d4fc640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe1980b3bf0 0x7fe1840062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.890+0000 7fe19d4fc640 1 -- 172.21.15.82:0/4080858247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe184004af0 msgr2=0x7fe184004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.890+0000 7fe19d4fc640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe184004af0 0x7fe184004f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.890+0000 7fe19d4fc640 1 -- 172.21.15.82:0/4080858247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe184004630 con 0x7fe184005910 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.891+0000 7fe19d4fc640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 0x7fe184005d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe188009a90 tx=0x7fe184006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da02ed5a04511a21 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:39.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.891+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188036070 con 0x7fe184005910 2024-06-02T22:52:39.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.891+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe188031400 con 0x7fe184005910 2024-06-02T22:52:39.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.891+0000 7fe19ccfb640 1 -- 172.21.15.82:0/4080858247 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188009690 con 0x7fe184005910 2024-06-02T22:52:39.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.891+0000 7fe19ff61640 1 -- 172.21.15.82:0/4080858247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 msgr2=0x7fe184005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.891+0000 7fe19ff61640 1 --2- 172.21.15.82:0/4080858247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 0x7fe184005d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe188009a90 tx=0x7fe184006940 comp rx=0 tx=0).stop 2024-06-02T22:52:39.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.891+0000 7fe19e4fe640 1 -- 172.21.15.82:0/4080858247 reap_dead start 2024-06-02T22:52:39.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.891+0000 7fe19ff61640 1 -- 172.21.15.82:0/4080858247 shutdown_connections 2024-06-02T22:52:39.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.891+0000 7fe19ff61640 1 -- 172.21.15.82:0/4080858247 >> 172.21.15.82:0/4080858247 conn(0x7fe1980b1d10 msgr2=0x7fe1980b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:39.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.891+0000 7fe19ff61640 1 -- 172.21.15.82:0/4080858247 shutdown_connections 2024-06-02T22:52:39.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.891+0000 7fe19ff61640 1 -- 172.21.15.82:0/4080858247 wait complete. 2024-06-02T22:52:39.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.892+0000 7fe19ff61640 1 Processor -- start 2024-06-02T22:52:39.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.892+0000 7fe19ff61640 1 -- start start 2024-06-02T22:52:39.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19ff61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 0x7fe19815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19ff61640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe198140ec0 0x7fe198141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19ff61640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe19809c460 0x7fe19809c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19ff61640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe19806cfc0 con 0x7fe184005910 2024-06-02T22:52:39.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19ff61640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe19806d9b0 con 0x7fe19809c460 2024-06-02T22:52:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19ff61640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe19806d140 con 0x7fe198140ec0 2024-06-02T22:52:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19dcfd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 0x7fe19815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19dcfd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 0x7fe19815aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55236/0 (socket says 172.21.15.82:55236) 2024-06-02T22:52:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19dcfd640 1 -- 172.21.15.82:0/3294824465 learned_addr learned my addr 172.21.15.82:0/3294824465 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19e4fe640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe19809c460 0x7fe19809c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19d4fc640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe198140ec0 0x7fe198141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19dcfd640 1 -- 172.21.15.82:0/3294824465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe198140ec0 msgr2=0x7fe198141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19dcfd640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe198140ec0 0x7fe198141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19dcfd640 1 -- 172.21.15.82:0/3294824465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe19809c460 msgr2=0x7fe19809c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19dcfd640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe19809c460 0x7fe19809c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19dcfd640 1 -- 172.21.15.82:0/3294824465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe198141880 con 0x7fe184005910 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.893+0000 7fe19d4fc640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe198140ec0 0x7fe198141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.894+0000 7fe19dcfd640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 0x7fe19815aef0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe194007340 tx=0x7fe194007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.894+0000 7fe18e7fc640 1 -- 172.21.15.82:0/3294824465 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19400f940 con 0x7fe184005910 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.894+0000 7fe18e7fc640 1 -- 172.21.15.82:0/3294824465 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe194018070 con 0x7fe184005910 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.894+0000 7fe19ff61640 1 -- 172.21.15.82:0/3294824465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1981550a0 con 0x7fe184005910 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.894+0000 7fe18e7fc640 1 -- 172.21.15.82:0/3294824465 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19400fd40 con 0x7fe184005910 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.894+0000 7fe19ff61640 1 -- 172.21.15.82:0/3294824465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19809d500 con 0x7fe184005910 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.895+0000 7fe19ff61640 1 -- 172.21.15.82:0/3294824465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1980683c0 con 0x7fe184005910 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.895+0000 7fe18e7fc640 1 -- 172.21.15.82:0/3294824465 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe19401d460 con 0x7fe184005910 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.896+0000 7fe18e7fc640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe17c06be60 0x7fe17c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.896+0000 7fe18e7fc640 1 -- 172.21.15.82:0/3294824465 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe19408b200 con 0x7fe184005910 2024-06-02T22:52:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.896+0000 7fe19d4fc640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe17c06be60 0x7fe17c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.896+0000 7fe19d4fc640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe17c06be60 0x7fe17c06e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe188033000 tx=0x7fe188008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:39.900+0000 7fe18e7fc640 1 -- 172.21.15.82:0/3294824465 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe194059870 con 0x7fe184005910 2024-06-02T22:52:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.073+0000 7fe19ff61640 1 -- 172.21.15.82:0/3294824465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe198071580 con 0x7fe184005910 2024-06-02T22:52:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.073+0000 7fe18e7fc640 1 -- 172.21.15.82:0/3294824465 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fe194059170 con 0x7fe184005910 2024-06-02T22:52:40.074 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-06-02T22:52:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 -- 172.21.15.82:0/3294824465 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe17c06be60 msgr2=0x7fe17c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe17c06be60 0x7fe17c06e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe188033000 tx=0x7fe188008030 comp rx=0 tx=0).stop 2024-06-02T22:52:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 -- 172.21.15.82:0/3294824465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 msgr2=0x7fe19815aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 0x7fe19815aef0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe194007340 tx=0x7fe194007800 comp rx=0 tx=0).stop 2024-06-02T22:52:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 -- 172.21.15.82:0/3294824465 shutdown_connections 2024-06-02T22:52:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe17c06be60 0x7fe17c06e320 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe19809c460 0x7fe19809c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe198140ec0 0x7fe198141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 --2- 172.21.15.82:0/3294824465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe184005910 0x7fe19815aef0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 -- 172.21.15.82:0/3294824465 >> 172.21.15.82:0/3294824465 conn(0x7fe1980b1d10 msgr2=0x7fe198153770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 -- 172.21.15.82:0/3294824465 shutdown_connections 2024-06-02T22:52:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.075+0000 7fe19ff61640 1 -- 172.21.15.82:0/3294824465 wait complete. 2024-06-02T22:52:40.087 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T22:52:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.191+0000 7f48405e9640 1 Processor -- start 2024-06-02T22:52:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.192+0000 7f48405e9640 1 -- start start 2024-06-02T22:52:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.192+0000 7f48405e9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48380b3800 0x7f48380cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.192+0000 7f48405e9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48380cf190 0x7f48380d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.192+0000 7f48405e9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48380b3c80 con 0x7f48380d08f0 2024-06-02T22:52:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.192+0000 7f48405e9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f48380d1c80 con 0x7f48380cf190 2024-06-02T22:52:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.192+0000 7f48405e9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f48380cf620 con 0x7f48380b3800 2024-06-02T22:52:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.193+0000 7f483eb86640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48380cf190 0x7f48380d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.193+0000 7f483e385640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f48380d08f0 0x7f48380d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51974/0 (socket says 172.21.15.82:51974) 2024-06-02T22:52:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.193+0000 7f483e385640 1 -- 172.21.15.82:0/3485826508 learned_addr learned my addr 172.21.15.82:0/3485826508 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.193+0000 7f483eb86640 1 -- 172.21.15.82:0/3485826508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48380b3800 msgr2=0x7f48380cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.193+0000 7f483eb86640 1 --2- 172.21.15.82:0/3485826508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48380b3800 0x7f48380cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.193+0000 7f483eb86640 1 -- 172.21.15.82:0/3485826508 >> v1:172.21.15.82:6789/0 conn(0x7f48380d08f0 legacy=0x7f48380d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.193+0000 7f483d383640 1 -- 172.21.15.82:0/3485826508 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 726045179 0 0) 0x7f4834001110 con 0x7f48380d08f0 2024-06-02T22:52:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.193+0000 7f483eb86640 1 -- 172.21.15.82:0/3485826508 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48380cf8a0 con 0x7f48380cf190 2024-06-02T22:52:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f483eb86640 1 --2- 172.21.15.82:0/3485826508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48380cf190 0x7f48380d23f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4830009d90 tx=0x7f483002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4809e1bae15f418c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f483d383640 1 -- 172.21.15.82:0/3485826508 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830007740 con 0x7f48380cf190 2024-06-02T22:52:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f483d383640 1 -- 172.21.15.82:0/3485826508 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48300078e0 con 0x7f48380cf190 2024-06-02T22:52:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f483d383640 1 -- 172.21.15.82:0/3485826508 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830007cb0 con 0x7f48380cf190 2024-06-02T22:52:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f48405e9640 1 -- 172.21.15.82:0/3485826508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48380cf190 msgr2=0x7f48380d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f48405e9640 1 --2- 172.21.15.82:0/3485826508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48380cf190 0x7f48380d23f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4830009d90 tx=0x7f483002a660 comp rx=0 tx=0).stop 2024-06-02T22:52:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f48405e9640 1 -- 172.21.15.82:0/3485826508 shutdown_connections 2024-06-02T22:52:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f48405e9640 1 --2- 172.21.15.82:0/3485826508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48380cf190 0x7f48380d23f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f48405e9640 1 --2- 172.21.15.82:0/3485826508 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48380b3800 0x7f48380cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f48405e9640 1 -- 172.21.15.82:0/3485826508 >> 172.21.15.82:0/3485826508 conn(0x7f483809d3c0 msgr2=0x7f48380d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f48405e9640 1 -- 172.21.15.82:0/3485826508 shutdown_connections 2024-06-02T22:52:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.194+0000 7f48405e9640 1 -- 172.21.15.82:0/3485826508 wait complete. 2024-06-02T22:52:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.196+0000 7f48405e9640 1 Processor -- start 2024-06-02T22:52:40.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.196+0000 7f48405e9640 1 -- start start 2024-06-02T22:52:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.196+0000 7f48405e9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48380b3800 0x7f4838157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.196+0000 7f48405e9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48380cf190 0x7f483815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.196+0000 7f48405e9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48380d08f0 0x7f48380b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.196+0000 7f48405e9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f48380d1ed0 con 0x7f48380cf190 2024-06-02T22:52:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.196+0000 7f48405e9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f48380cfe60 con 0x7f48380d08f0 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.196+0000 7f48405e9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f48380b50c0 con 0x7f48380b3800 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.196+0000 7f483db84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48380cf190 0x7f483815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.196+0000 7f483db84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48380cf190 0x7f483815b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55254/0 (socket says 172.21.15.82:55254) 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.196+0000 7f483db84640 1 -- 172.21.15.82:0/3063410346 learned_addr learned my addr 172.21.15.82:0/3063410346 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f483e385640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48380b3800 0x7f4838157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f483eb86640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48380d08f0 0x7f48380b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f483db84640 1 -- 172.21.15.82:0/3063410346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48380b3800 msgr2=0x7f4838157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f483db84640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48380b3800 0x7f4838157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f483db84640 1 -- 172.21.15.82:0/3063410346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48380d08f0 msgr2=0x7f48380b85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f483db84640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48380d08f0 0x7f48380b85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f483db84640 1 -- 172.21.15.82:0/3063410346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48381f4730 con 0x7f48380cf190 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f483e385640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48380b3800 0x7f4838157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:40.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f483db84640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48380cf190 0x7f483815b1f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f482800b410 tx=0x7f482800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f482effd640 1 -- 172.21.15.82:0/3063410346 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828015020 con 0x7f48380cf190 2024-06-02T22:52:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f482effd640 1 -- 172.21.15.82:0/3063410346 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4828011850 con 0x7f48380cf190 2024-06-02T22:52:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f48405e9640 1 -- 172.21.15.82:0/3063410346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48381f4a10 con 0x7f48380cf190 2024-06-02T22:52:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f482effd640 1 -- 172.21.15.82:0/3063410346 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828011c40 con 0x7f48380cf190 2024-06-02T22:52:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.197+0000 7f48405e9640 1 -- 172.21.15.82:0/3063410346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48381f4fd0 con 0x7f48380cf190 2024-06-02T22:52:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.198+0000 7f48405e9640 1 -- 172.21.15.82:0/3063410346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48380683c0 con 0x7f48380cf190 2024-06-02T22:52:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.199+0000 7f482effd640 1 -- 172.21.15.82:0/3063410346 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4828018020 con 0x7f48380cf190 2024-06-02T22:52:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.199+0000 7f482effd640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f481c06be30 0x7f481c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.199+0000 7f482effd640 1 -- 172.21.15.82:0/3063410346 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f482808b170 con 0x7f48380cf190 2024-06-02T22:52:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.199+0000 7f483e385640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f481c06be30 0x7f481c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.199+0000 7f483e385640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f481c06be30 0x7f481c06e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4834000f60 tx=0x7f4834007a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:40.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.203+0000 7f482effd640 1 -- 172.21.15.82:0/3063410346 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f482801f020 con 0x7f48380cf190 2024-06-02T22:52:40.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.376+0000 7f48405e9640 1 -- 172.21.15.82:0/3063410346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f483808e170 con 0x7f48380cf190 2024-06-02T22:52:40.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.376+0000 7f482effd640 1 -- 172.21.15.82:0/3063410346 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f48280172c0 con 0x7f48380cf190 2024-06-02T22:52:40.378 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-06-02T22:52:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 -- 172.21.15.82:0/3063410346 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f481c06be30 msgr2=0x7f481c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f481c06be30 0x7f481c06e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4834000f60 tx=0x7f4834007a10 comp rx=0 tx=0).stop 2024-06-02T22:52:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 -- 172.21.15.82:0/3063410346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48380cf190 msgr2=0x7f483815b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48380cf190 0x7f483815b1f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f482800b410 tx=0x7f482800b8d0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 -- 172.21.15.82:0/3063410346 shutdown_connections 2024-06-02T22:52:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f481c06be30 0x7f481c06e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48380d08f0 0x7f48380b85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48380cf190 0x7f483815b1f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 --2- 172.21.15.82:0/3063410346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48380b3800 0x7f4838157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 -- 172.21.15.82:0/3063410346 >> 172.21.15.82:0/3063410346 conn(0x7f483809d3c0 msgr2=0x7f483806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 -- 172.21.15.82:0/3063410346 shutdown_connections 2024-06-02T22:52:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.378+0000 7f48405e9640 1 -- 172.21.15.82:0/3063410346 wait complete. 2024-06-02T22:52:40.391 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T22:52:40.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.492+0000 7f2529f6a640 1 Processor -- start 2024-06-02T22:52:40.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.493+0000 7f2529f6a640 1 -- start start 2024-06-02T22:52:40.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.493+0000 7f2529f6a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252406ca30 0x7f25240af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.493+0000 7f2529f6a640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f252406d780 0x7f252406dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.493+0000 7f2529f6a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25240b0030 con 0x7f252415bef0 2024-06-02T22:52:40.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.493+0000 7f2529f6a640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f252406e120 con 0x7f252406d780 2024-06-02T22:52:40.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.493+0000 7f2529f6a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f25240cf200 con 0x7f252406ca30 2024-06-02T22:52:40.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f2522ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f252415bef0 0x7f25240cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51978/0 (socket says 172.21.15.82:51978) 2024-06-02T22:52:40.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f2522ffd640 1 -- 172.21.15.82:0/3937347752 learned_addr learned my addr 172.21.15.82:0/3937347752 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:40.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045272121 0 0) 0x7f25240b0030 con 0x7f252415bef0 2024-06-02T22:52:40.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f250c003520 con 0x7f252415bef0 2024-06-02T22:52:40.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25237fe640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252406ca30 0x7f25240af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f2523fff640 1 --2- 172.21.15.82:0/3937347752 >> v2:172.21.15.184:3300/0 conn(0x7f252406d780 0x7f252406dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3831832027 0 0) 0x7f250c003520 con 0x7f252415bef0 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252406ca30 msgr2=0x7f25240af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252406ca30 0x7f25240af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 >> v2:172.21.15.184:3300/0 conn(0x7f252406d780 msgr2=0x7f252406dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 --2- 172.21.15.82:0/3937347752 >> v2:172.21.15.184:3300/0 conn(0x7f252406d780 0x7f252406dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25240ce910 con 0x7f252415bef0 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f2518001670 con 0x7f252415bef0 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 >> v1:172.21.15.82:6789/0 conn(0x7f252415bef0 legacy=0x7f25240cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f250c0039b0 0x7f250c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f250c004800 0x7f250c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252406ca30 0x7f250c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f25240cf200 con 0x7f250c0039b0 2024-06-02T22:52:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f250c00b9c0 con 0x7f250c004800 2024-06-02T22:52:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f250c00bb40 con 0x7f252406ca30 2024-06-02T22:52:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f25237fe640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f250c0039b0 0x7f250c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f2523fff640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252406ca30 0x7f250c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.494+0000 7f2522ffd640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f250c004800 0x7f250c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.495+0000 7f25237fe640 1 -- 172.21.15.82:0/3937347752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252406ca30 msgr2=0x7f250c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.495+0000 7f25237fe640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252406ca30 0x7f250c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.495+0000 7f25237fe640 1 -- 172.21.15.82:0/3937347752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f250c004800 msgr2=0x7f250c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.495+0000 7f25237fe640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f250c004800 0x7f250c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.495+0000 7f25237fe640 1 -- 172.21.15.82:0/3937347752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c003520 con 0x7f250c0039b0 2024-06-02T22:52:40.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.495+0000 7f25237fe640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f250c0039b0 0x7f250c003dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2514009af0 tx=0x7f250c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cb4a9a01f20a0c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.495+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2514036070 con 0x7f250c0039b0 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.496+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2514031400 con 0x7f250c0039b0 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.496+0000 7f25227fc640 1 -- 172.21.15.82:0/3937347752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2514009690 con 0x7f250c0039b0 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.496+0000 7f2529f6a640 1 -- 172.21.15.82:0/3937347752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f250c0039b0 msgr2=0x7f250c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.496+0000 7f2529f6a640 1 --2- 172.21.15.82:0/3937347752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f250c0039b0 0x7f250c003dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2514009af0 tx=0x7f250c005830 comp rx=0 tx=0).stop 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.496+0000 7f2523fff640 1 -- 172.21.15.82:0/3937347752 reap_dead start 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.496+0000 7f2529f6a640 1 -- 172.21.15.82:0/3937347752 shutdown_connections 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.496+0000 7f2529f6a640 1 -- 172.21.15.82:0/3937347752 >> 172.21.15.82:0/3937347752 conn(0x7f25240b22b0 msgr2=0x7f25240b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.496+0000 7f2529f6a640 1 -- 172.21.15.82:0/3937347752 shutdown_connections 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.496+0000 7f2529f6a640 1 -- 172.21.15.82:0/3937347752 wait complete. 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.497+0000 7f2529f6a640 1 Processor -- start 2024-06-02T22:52:40.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.497+0000 7f2529f6a640 1 -- start start 2024-06-02T22:52:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.498+0000 7f2529f6a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f252415df10 0x7f25241599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.498+0000 7f2529f6a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252415e2f0 0x7f2524159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.498+0000 7f2529f6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25240adf00 0x7f25240ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.498+0000 7f2529f6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f252415c330 con 0x7f25240adf00 2024-06-02T22:52:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.498+0000 7f2529f6a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f25240cee90 con 0x7f252415df10 2024-06-02T22:52:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.498+0000 7f2529f6a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f25240af970 con 0x7f252415e2f0 2024-06-02T22:52:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.498+0000 7f2523fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25240adf00 0x7f25240ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.498+0000 7f2523fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25240adf00 0x7f25240ae390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55274/0 (socket says 172.21.15.82:55274) 2024-06-02T22:52:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.498+0000 7f2523fff640 1 -- 172.21.15.82:0/403290044 learned_addr learned my addr 172.21.15.82:0/403290044 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.498+0000 7f25237fe640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f252415df10 0x7f25241599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.498+0000 7f2522ffd640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252415e2f0 0x7f2524159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.499+0000 7f2523fff640 1 -- 172.21.15.82:0/403290044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252415e2f0 msgr2=0x7f2524159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.499+0000 7f2523fff640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252415e2f0 0x7f2524159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.499+0000 7f2523fff640 1 -- 172.21.15.82:0/403290044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f252415df10 msgr2=0x7f25241599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.499+0000 7f2523fff640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f252415df10 0x7f25241599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.499+0000 7f2523fff640 1 -- 172.21.15.82:0/403290044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252415a740 con 0x7f25240adf00 2024-06-02T22:52:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.499+0000 7f2523fff640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25240adf00 0x7f25240ae390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f252415e9c0 tx=0x7f251c0070e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.499+0000 7f250bfff640 1 -- 172.21.15.82:0/403290044 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c00fcd0 con 0x7f25240adf00 2024-06-02T22:52:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.499+0000 7f250bfff640 1 -- 172.21.15.82:0/403290044 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f251c01d070 con 0x7f25240adf00 2024-06-02T22:52:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.499+0000 7f2529f6a640 1 -- 172.21.15.82:0/403290044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f252415aa20 con 0x7f25240adf00 2024-06-02T22:52:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.499+0000 7f250bfff640 1 -- 172.21.15.82:0/403290044 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c015670 con 0x7f25240adf00 2024-06-02T22:52:40.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.499+0000 7f2529f6a640 1 -- 172.21.15.82:0/403290044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f252415a460 con 0x7f25240adf00 2024-06-02T22:52:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.500+0000 7f2529f6a640 1 -- 172.21.15.82:0/403290044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25240683c0 con 0x7f25240adf00 2024-06-02T22:52:40.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.500+0000 7f250bfff640 1 -- 172.21.15.82:0/403290044 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f251c015810 con 0x7f25240adf00 2024-06-02T22:52:40.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.501+0000 7f250bfff640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f251006be30 0x7f251006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.501+0000 7f250bfff640 1 -- 172.21.15.82:0/403290044 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f251c08b880 con 0x7f25240adf00 2024-06-02T22:52:40.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.501+0000 7f25237fe640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f251006be30 0x7f251006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.501+0000 7f25237fe640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f251006be30 0x7f251006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2514033000 tx=0x7f2514008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:40.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.505+0000 7f250bfff640 1 -- 172.21.15.82:0/403290044 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f251c010040 con 0x7f25240adf00 2024-06-02T22:52:40.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.678+0000 7f2529f6a640 1 -- 172.21.15.82:0/403290044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f252415af40 con 0x7f25240adf00 2024-06-02T22:52:40.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.678+0000 7f250bfff640 1 -- 172.21.15.82:0/403290044 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f251c059ef0 con 0x7f25240adf00 2024-06-02T22:52:40.679 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-06-02T22:52:40.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.680+0000 7f2529f6a640 1 -- 172.21.15.82:0/403290044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f251006be30 msgr2=0x7f251006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.680+0000 7f2529f6a640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f251006be30 0x7f251006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2514033000 tx=0x7f2514008030 comp rx=0 tx=0).stop 2024-06-02T22:52:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.680+0000 7f2529f6a640 1 -- 172.21.15.82:0/403290044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25240adf00 msgr2=0x7f25240ae390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.680+0000 7f2529f6a640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25240adf00 0x7f25240ae390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f252415e9c0 tx=0x7f251c0070e0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.681+0000 7f2529f6a640 1 -- 172.21.15.82:0/403290044 shutdown_connections 2024-06-02T22:52:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.681+0000 7f2529f6a640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f251006be30 0x7f251006e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.681+0000 7f2529f6a640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25240adf00 0x7f25240ae390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.681+0000 7f2529f6a640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f252415e2f0 0x7f2524159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.681+0000 7f2529f6a640 1 --2- 172.21.15.82:0/403290044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f252415df10 0x7f25241599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.681+0000 7f2529f6a640 1 -- 172.21.15.82:0/403290044 >> 172.21.15.82:0/403290044 conn(0x7f25240b22b0 msgr2=0x7f25240b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.681+0000 7f2529f6a640 1 -- 172.21.15.82:0/403290044 shutdown_connections 2024-06-02T22:52:40.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.681+0000 7f2529f6a640 1 -- 172.21.15.82:0/403290044 wait complete. 2024-06-02T22:52:40.693 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.792+0000 7f3ccc9ce640 1 Processor -- start 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.792+0000 7f3ccc9ce640 1 -- start start 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3ccc9ce640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc80aef70 0x7f3cc80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3ccc9ce640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3cc80af3b0 0x7f3cc80b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3ccc9ce640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cc815ac50 con 0x7f3cc815a870 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3ccc9ce640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f3cc80b4fe0 con 0x7f3cc80af3b0 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3ccc9ce640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc806cdb0 con 0x7f3cc80aef70 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc659c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3cc815a870 0x7f3cc806de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51984/0 (socket says 172.21.15.82:51984) 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc659c640 1 -- 172.21.15.82:0/1269985228 learned_addr learned my addr 172.21.15.82:0/1269985228 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1682577541 0 0) 0x7f3cc815ac50 con 0x7f3cc815a870 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cb4005730 con 0x7f3cc815a870 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc6d9d640 1 --2- 172.21.15.82:0/1269985228 >> v2:172.21.15.184:3300/0 conn(0x7f3cc80af3b0 0x7f3cc80b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cbffff640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc80aef70 0x7f3cc80b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3280623221 0 0) 0x7f3cb4005730 con 0x7f3cc815a870 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc80aef70 msgr2=0x7f3cc80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc80aef70 0x7f3cc80b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 >> v2:172.21.15.184:3300/0 conn(0x7f3cc80af3b0 msgr2=0x7f3cc80b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 --2- 172.21.15.82:0/1269985228 >> v2:172.21.15.184:3300/0 conn(0x7f3cc80af3b0 0x7f3cc80b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc806d090 con 0x7f3cc815a870 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f3cb8001670 con 0x7f3cc815a870 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 >> v1:172.21.15.82:6789/0 conn(0x7f3cc815a870 legacy=0x7f3cc806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc80aef70 0x7f3cb4005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.793+0000 7f3cc5d9b640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb40061f0 0x7f3cb4006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cc5d9b640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cb4006f50 0x7f3cb40073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc80b4fe0 con 0x7f3cb4006f50 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc806cdb0 con 0x7f3cb40061f0 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb400dd90 con 0x7f3cc80aef70 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cc6d9d640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cb4006f50 0x7f3cb40073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cc659c640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc80aef70 0x7f3cb4005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cbffff640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb40061f0 0x7f3cb4006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cc6d9d640 1 -- 172.21.15.82:0/1269985228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc80aef70 msgr2=0x7f3cb4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cc6d9d640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc80aef70 0x7f3cb4005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cc6d9d640 1 -- 172.21.15.82:0/1269985228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb40061f0 msgr2=0x7f3cb4006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cc6d9d640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb40061f0 0x7f3cb4006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.794+0000 7f3cc6d9d640 1 -- 172.21.15.82:0/1269985228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb4005730 con 0x7f3cb4006f50 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.795+0000 7f3cc6d9d640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cb4006f50 0x7f3cb40073d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007360 tx=0x7f3cb4007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d6d84a34cbc0dd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.795+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0009be0 con 0x7f3cb4006f50 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.795+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc002e620 con 0x7f3cb4006f50 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.795+0000 7f3cc5d9b640 1 -- 172.21.15.82:0/1269985228 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc002e9f0 con 0x7f3cb4006f50 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.795+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/1269985228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cb4006f50 msgr2=0x7f3cb40073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.795+0000 7f3ccc9ce640 1 --2- 172.21.15.82:0/1269985228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cb4006f50 0x7f3cb40073d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007360 tx=0x7f3cb4007a40 comp rx=0 tx=0).stop 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.795+0000 7f3cc6d9d640 1 -- 172.21.15.82:0/1269985228 reap_dead start 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.795+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/1269985228 shutdown_connections 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.795+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/1269985228 >> 172.21.15.82:0/1269985228 conn(0x7f3cc80b19f0 msgr2=0x7f3cc80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.795+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/1269985228 shutdown_connections 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.795+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/1269985228 wait complete. 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.797+0000 7f3ccc9ce640 1 Processor -- start 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.797+0000 7f3ccc9ce640 1 -- start start 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.797+0000 7f3ccc9ce640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb4006f50 0x7f3cc81e39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.797+0000 7f3ccc9ce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cc815cc30 0x7f3cc815d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.797+0000 7f3ccc9ce640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc81472a0 0x7f3cc8147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.797+0000 7f3ccc9ce640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc806d930 con 0x7f3cc815cc30 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.797+0000 7f3ccc9ce640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc806d650 con 0x7f3cb4006f50 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.797+0000 7f3ccc9ce640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc80b2e40 con 0x7f3cc81472a0 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.797+0000 7f3cbffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cc815cc30 0x7f3cc815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.797+0000 7f3cbffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cc815cc30 0x7f3cc815d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55298/0 (socket says 172.21.15.82:55298) 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.797+0000 7f3cbffff640 1 -- 172.21.15.82:0/2747104967 learned_addr learned my addr 172.21.15.82:0/2747104967 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.798+0000 7f3cbffff640 1 -- 172.21.15.82:0/2747104967 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc81472a0 msgr2=0x7f3cc8147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.798+0000 7f3cbffff640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc81472a0 0x7f3cc8147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.798+0000 7f3cbffff640 1 -- 172.21.15.82:0/2747104967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb4006f50 msgr2=0x7f3cc81e39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.798+0000 7f3cbffff640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb4006f50 0x7f3cc81e39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.798+0000 7f3cbffff640 1 -- 172.21.15.82:0/2747104967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc81f3490 con 0x7f3cc815cc30 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.798+0000 7f3cbffff640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cc815cc30 0x7f3cc815d090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000b770 tx=0x7f3cb000bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.798+0000 7f3cbeffd640 1 -- 172.21.15.82:0/2747104967 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0018070 con 0x7f3cc815cc30 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.798+0000 7f3cbeffd640 1 -- 172.21.15.82:0/2747104967 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb0010830 con 0x7f3cc815cc30 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.798+0000 7f3cbeffd640 1 -- 172.21.15.82:0/2747104967 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0010c00 con 0x7f3cc815cc30 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.798+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/2747104967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc81f3770 con 0x7f3cc815cc30 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.798+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/2747104967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc81f3d30 con 0x7f3cc815cc30 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.799+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/2747104967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc8068430 con 0x7f3cc815cc30 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.799+0000 7f3cbeffd640 1 -- 172.21.15.82:0/2747104967 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3cb001b070 con 0x7f3cc815cc30 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.800+0000 7f3cbeffd640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ca806be60 0x7f3ca806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.800+0000 7f3cc659c640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ca806be60 0x7f3ca806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.800+0000 7f3cbeffd640 1 -- 172.21.15.82:0/2747104967 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3cb008b810 con 0x7f3cc815cc30 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.800+0000 7f3cc659c640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ca806be60 0x7f3ca806e320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8000f60 tx=0x7f3cb8000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:40.804+0000 7f3cbeffd640 1 -- 172.21.15.82:0/2747104967 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3cb0059e80 con 0x7f3cc815cc30 2024-06-02T22:52:41.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.046+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/2747104967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) -- 0x7f3cc80b2650 con 0x7f3cc815cc30 2024-06-02T22:52:41.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.688+0000 7f3cbeffd640 1 -- 172.21.15.82:0/2747104967 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v54) ==== 150+0+0 (secure 0 0 0) 0x7f3cb0089e20 con 0x7f3cc815cc30 2024-06-02T22:52:41.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.690+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/2747104967 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ca806be60 msgr2=0x7f3ca806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.690+0000 7f3ccc9ce640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ca806be60 0x7f3ca806e320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8000f60 tx=0x7f3cb8000ed0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.690+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/2747104967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cc815cc30 msgr2=0x7f3cc815d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.690+0000 7f3ccc9ce640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cc815cc30 0x7f3cc815d090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000b770 tx=0x7f3cb000bc30 comp rx=0 tx=0).stop 2024-06-02T22:52:41.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.690+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/2747104967 shutdown_connections 2024-06-02T22:52:41.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.690+0000 7f3ccc9ce640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ca806be60 0x7f3ca806e320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.690+0000 7f3ccc9ce640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cc81472a0 0x7f3cc8147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.690+0000 7f3ccc9ce640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cc815cc30 0x7f3cc815d090 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.690+0000 7f3ccc9ce640 1 --2- 172.21.15.82:0/2747104967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb4006f50 0x7f3cc81e39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.690+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/2747104967 >> 172.21.15.82:0/2747104967 conn(0x7f3cc80b19f0 msgr2=0x7f3cc8158640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:41.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.691+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/2747104967 shutdown_connections 2024-06-02T22:52:41.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.691+0000 7f3ccc9ce640 1 -- 172.21.15.82:0/2747104967 wait complete. 2024-06-02T22:52:41.703 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-02T22:52:41.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.807+0000 7f5b3b99e640 1 Processor -- start 2024-06-02T22:52:41.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.807+0000 7f5b3b99e640 1 -- start start 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.808+0000 7f5b3b99e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5b340b3800 0x7f5b340cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.808+0000 7f5b3b99e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5b340cf190 0x7f5b340d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.808+0000 7f5b3b99e640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b340cf600 con 0x7f5b340d08f0 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.808+0000 7f5b3b99e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5b340d1c80 con 0x7f5b340cf190 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.808+0000 7f5b3b99e640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f5b340b3cb0 con 0x7f5b340b3800 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.808+0000 7f5b39f3b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5b340cf190 0x7f5b340d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.808+0000 7f5b39f3b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5b340cf190 0x7f5b340d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37620/0 (socket says 172.21.15.82:37620) 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.809+0000 7f5b39f3b640 1 -- 172.21.15.82:0/356608568 learned_addr learned my addr 172.21.15.82:0/356608568 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.809+0000 7f5b38f39640 1 --2- 172.21.15.82:0/356608568 >> v2:172.21.15.184:3300/0 conn(0x7f5b340b3800 0x7f5b340cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.809+0000 7f5b39f3b640 1 -- 172.21.15.82:0/356608568 >> v2:172.21.15.184:3300/0 conn(0x7f5b340b3800 msgr2=0x7f5b340cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.809+0000 7f5b39f3b640 1 --2- 172.21.15.82:0/356608568 >> v2:172.21.15.184:3300/0 conn(0x7f5b340b3800 0x7f5b340cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.809+0000 7f5b39f3b640 1 -- 172.21.15.82:0/356608568 >> v1:172.21.15.184:6789/0 conn(0x7f5b340d08f0 legacy=0x7f5b340d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.809+0000 7f5b39f3b640 1 -- 172.21.15.82:0/356608568 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b340cf8a0 con 0x7f5b340cf190 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.809+0000 7f5b39f3b640 1 --2- 172.21.15.82:0/356608568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b340cf190 0x7f5b340d23f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009e50 tx=0x7f5b2c02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50951662958e393a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.810+0000 7f5b33fff640 1 -- 172.21.15.82:0/356608568 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c036070 con 0x7f5b340cf190 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.810+0000 7f5b33fff640 1 -- 172.21.15.82:0/356608568 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2c031600 con 0x7f5b340cf190 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.810+0000 7f5b33fff640 1 -- 172.21.15.82:0/356608568 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0319d0 con 0x7f5b340cf190 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.810+0000 7f5b3b99e640 1 -- 172.21.15.82:0/356608568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b340cf190 msgr2=0x7f5b340d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.810+0000 7f5b3b99e640 1 --2- 172.21.15.82:0/356608568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b340cf190 0x7f5b340d23f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009e50 tx=0x7f5b2c02a760 comp rx=0 tx=0).stop 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.810+0000 7f5b3b99e640 1 -- 172.21.15.82:0/356608568 shutdown_connections 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.810+0000 7f5b3b99e640 1 --2- 172.21.15.82:0/356608568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b340cf190 0x7f5b340d23f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.810+0000 7f5b3b99e640 1 --2- 172.21.15.82:0/356608568 >> v2:172.21.15.184:3300/0 conn(0x7f5b340b3800 0x7f5b340cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.810+0000 7f5b3b99e640 1 -- 172.21.15.82:0/356608568 >> 172.21.15.82:0/356608568 conn(0x7f5b3409d3c0 msgr2=0x7f5b340d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.810+0000 7f5b3b99e640 1 -- 172.21.15.82:0/356608568 shutdown_connections 2024-06-02T22:52:41.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.810+0000 7f5b3b99e640 1 -- 172.21.15.82:0/356608568 wait complete. 2024-06-02T22:52:41.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.811+0000 7f5b3b99e640 1 Processor -- start 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.811+0000 7f5b3b99e640 1 -- start start 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.812+0000 7f5b3b99e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b340b3800 0x7f5b341577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.812+0000 7f5b3b99e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b340cf190 0x7f5b340c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.812+0000 7f5b3b99e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b340d08f0 0x7f5b340c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.812+0000 7f5b3b99e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b340d1ed0 con 0x7f5b340cf190 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.812+0000 7f5b3b99e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5b340cfe60 con 0x7f5b340d08f0 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.812+0000 7f5b3b99e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5b340b50c0 con 0x7f5b340b3800 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.812+0000 7f5b38f39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b340cf190 0x7f5b340c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.812+0000 7f5b38f39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b340cf190 0x7f5b340c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37634/0 (socket says 172.21.15.82:37634) 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.812+0000 7f5b38f39640 1 -- 172.21.15.82:0/784038107 learned_addr learned my addr 172.21.15.82:0/784038107 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b38f39640 1 -- 172.21.15.82:0/784038107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b340b3800 msgr2=0x7f5b341577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b39f3b640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b340d08f0 0x7f5b340c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b3973a640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b340b3800 0x7f5b341577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b38f39640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b340b3800 0x7f5b341577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b38f39640 1 -- 172.21.15.82:0/784038107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b340d08f0 msgr2=0x7f5b340c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b38f39640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b340d08f0 0x7f5b340c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b38f39640 1 -- 172.21.15.82:0/784038107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b340c8a60 con 0x7f5b340cf190 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b39f3b640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b340d08f0 0x7f5b340c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b3973a640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b340b3800 0x7f5b341577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b38f39640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b340cf190 0x7f5b340c9b00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800d800 tx=0x7f5b2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b31ffb640 1 -- 172.21.15.82:0/784038107 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2800b6c0 con 0x7f5b340cf190 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b31ffb640 1 -- 172.21.15.82:0/784038107 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b28019070 con 0x7f5b340cf190 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b31ffb640 1 -- 172.21.15.82:0/784038107 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2800ba80 con 0x7f5b340cf190 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b3b99e640 1 -- 172.21.15.82:0/784038107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b340c8d40 con 0x7f5b340cf190 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.813+0000 7f5b3b99e640 1 -- 172.21.15.82:0/784038107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b340c9300 con 0x7f5b340cf190 2024-06-02T22:52:41.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.814+0000 7f5b3b99e640 1 -- 172.21.15.82:0/784038107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b340683c0 con 0x7f5b340cf190 2024-06-02T22:52:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.814+0000 7f5b31ffb640 1 -- 172.21.15.82:0/784038107 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b2800bc20 con 0x7f5b340cf190 2024-06-02T22:52:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.815+0000 7f5b31ffb640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b2006be30 0x7f5b2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.815+0000 7f5b31ffb640 1 -- 172.21.15.82:0/784038107 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5b2808b5e0 con 0x7f5b340cf190 2024-06-02T22:52:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.815+0000 7f5b3973a640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b2006be30 0x7f5b2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.815+0000 7f5b3973a640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b2006be30 0x7f5b2006e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b240015e0 tx=0x7f5b24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.820+0000 7f5b31ffb640 1 -- 172.21.15.82:0/784038107 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5b28059ce0 con 0x7f5b340cf190 2024-06-02T22:52:41.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.992+0000 7f5b3b99e640 1 -- 172.21.15.82:0/784038107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5b340d1730 con 0x7f5b340cf190 2024-06-02T22:52:41.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:41.998+0000 7f5b31ffb640 1 -- 172.21.15.82:0/784038107 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f5b280595e0 con 0x7f5b340cf190 2024-06-02T22:52:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 -- 172.21.15.82:0/784038107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b2006be30 msgr2=0x7f5b2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b2006be30 0x7f5b2006e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b240015e0 tx=0x7f5b24009040 comp rx=0 tx=0).stop 2024-06-02T22:52:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 -- 172.21.15.82:0/784038107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b340cf190 msgr2=0x7f5b340c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b340cf190 0x7f5b340c9b00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800d800 tx=0x7f5b2800dcc0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 -- 172.21.15.82:0/784038107 shutdown_connections 2024-06-02T22:52:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b2006be30 0x7f5b2006e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b340d08f0 0x7f5b340c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b340cf190 0x7f5b340c9b00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 --2- 172.21.15.82:0/784038107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b340b3800 0x7f5b341577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 -- 172.21.15.82:0/784038107 >> 172.21.15.82:0/784038107 conn(0x7f5b3409d3c0 msgr2=0x7f5b340cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:42.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 -- 172.21.15.82:0/784038107 shutdown_connections 2024-06-02T22:52:42.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.000+0000 7f5b3b99e640 1 -- 172.21.15.82:0/784038107 wait complete. 2024-06-02T22:52:42.012 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-02T22:52:42.012 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T22:52:42.051 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T22:52:42.100 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-02T22:52:42.101 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:52:42.101 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:42.116 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:52:42.117 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:42.173 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:52:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.313+0000 7fef283a9640 1 Processor -- start 2024-06-02T22:52:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.313+0000 7fef283a9640 1 -- start start 2024-06-02T22:52:42.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef283a9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fef200cc6d0 0x7fef200ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef283a9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef20071c60 0x7fef200720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef283a9640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef200ccff0 con 0x7fef200b36c0 2024-06-02T22:52:42.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef283a9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fef20072820 con 0x7fef200cc6d0 2024-06-02T22:52:42.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef283a9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fef20072b00 con 0x7fef20071c60 2024-06-02T22:52:42.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef26145640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fef200cc6d0 0x7fef200ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef26145640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fef200cc6d0 0x7fef200ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37636/0 (socket says 172.21.15.82:37636) 2024-06-02T22:52:42.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef26145640 1 -- 172.21.15.82:0/3801600708 learned_addr learned my addr 172.21.15.82:0/3801600708 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:42.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef25944640 1 --2- 172.21.15.82:0/3801600708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef20071c60 0x7fef200720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef26145640 1 -- 172.21.15.82:0/3801600708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef20071c60 msgr2=0x7fef200720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:42.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef26145640 1 --2- 172.21.15.82:0/3801600708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef20071c60 0x7fef200720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef26145640 1 -- 172.21.15.82:0/3801600708 >> v1:172.21.15.184:6789/0 conn(0x7fef200b36c0 legacy=0x7fef200b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.314+0000 7fef26145640 1 -- 172.21.15.82:0/3801600708 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef20072de0 con 0x7fef200cc6d0 2024-06-02T22:52:42.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.315+0000 7fef26145640 1 --2- 172.21.15.82:0/3801600708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef200cc6d0 0x7fef200ccab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009870 tx=0x7fef1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ba23cc8a2149a8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.315+0000 7fef25143640 1 -- 172.21.15.82:0/3801600708 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c037070 con 0x7fef200cc6d0 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.315+0000 7fef25143640 1 -- 172.21.15.82:0/3801600708 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c032440 con 0x7fef200cc6d0 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.315+0000 7fef25143640 1 -- 172.21.15.82:0/3801600708 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c032810 con 0x7fef200cc6d0 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.316+0000 7fef283a9640 1 -- 172.21.15.82:0/3801600708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef200cc6d0 msgr2=0x7fef200ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.316+0000 7fef283a9640 1 --2- 172.21.15.82:0/3801600708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef200cc6d0 0x7fef200ccab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009870 tx=0x7fef1c02a270 comp rx=0 tx=0).stop 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.316+0000 7fef283a9640 1 -- 172.21.15.82:0/3801600708 shutdown_connections 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.316+0000 7fef283a9640 1 --2- 172.21.15.82:0/3801600708 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef20071c60 0x7fef200720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.316+0000 7fef283a9640 1 --2- 172.21.15.82:0/3801600708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef200cc6d0 0x7fef200ccab0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.316+0000 7fef283a9640 1 -- 172.21.15.82:0/3801600708 >> 172.21.15.82:0/3801600708 conn(0x7fef200b19f0 msgr2=0x7fef200b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.316+0000 7fef283a9640 1 -- 172.21.15.82:0/3801600708 shutdown_connections 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.316+0000 7fef283a9640 1 -- 172.21.15.82:0/3801600708 wait complete. 2024-06-02T22:52:42.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.317+0000 7fef283a9640 1 Processor -- start 2024-06-02T22:52:42.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.317+0000 7fef283a9640 1 -- start start 2024-06-02T22:52:42.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef283a9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef20071c60 0x7fef2014fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef283a9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef200b36c0 0x7fef20150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef283a9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef200cc6d0 0x7fef200ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef283a9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef20159f60 con 0x7fef200b36c0 2024-06-02T22:52:42.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef283a9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fef2015c890 con 0x7fef200cc6d0 2024-06-02T22:52:42.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef283a9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fef200b4240 con 0x7fef20071c60 2024-06-02T22:52:42.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef25944640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef200b36c0 0x7fef20150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef25944640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef200b36c0 0x7fef20150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37638/0 (socket says 172.21.15.82:37638) 2024-06-02T22:52:42.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef25944640 1 -- 172.21.15.82:0/3871451623 learned_addr learned my addr 172.21.15.82:0/3871451623 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:42.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef26145640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef20071c60 0x7fef2014fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef26946640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef200cc6d0 0x7fef200ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef25944640 1 -- 172.21.15.82:0/3871451623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef20071c60 msgr2=0x7fef2014fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef25944640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef20071c60 0x7fef2014fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef25944640 1 -- 172.21.15.82:0/3871451623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef200cc6d0 msgr2=0x7fef200ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef25944640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef200cc6d0 0x7fef200ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef25944640 1 -- 172.21.15.82:0/3871451623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2006e720 con 0x7fef200b36c0 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef25944640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef200b36c0 0x7fef20150790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fef1000d830 tx=0x7fef1000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef16ffd640 1 -- 172.21.15.82:0/3871451623 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1000b6c0 con 0x7fef200b36c0 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef16ffd640 1 -- 172.21.15.82:0/3871451623 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef10019070 con 0x7fef200b36c0 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.318+0000 7fef283a9640 1 -- 172.21.15.82:0/3871451623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2006dba0 con 0x7fef200b36c0 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.319+0000 7fef16ffd640 1 -- 172.21.15.82:0/3871451623 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1000ba80 con 0x7fef200b36c0 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.319+0000 7fef283a9640 1 -- 172.21.15.82:0/3871451623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef2006e160 con 0x7fef200b36c0 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.320+0000 7fef283a9640 1 -- 172.21.15.82:0/3871451623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef20067d20 con 0x7fef200b36c0 2024-06-02T22:52:42.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.320+0000 7fef16ffd640 1 -- 172.21.15.82:0/3871451623 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef1001e460 con 0x7fef200b36c0 2024-06-02T22:52:42.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.320+0000 7fef16ffd640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef0406be30 0x7fef0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.320+0000 7fef16ffd640 1 -- 172.21.15.82:0/3871451623 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fef1008b880 con 0x7fef200b36c0 2024-06-02T22:52:42.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.320+0000 7fef26145640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef0406be30 0x7fef0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.321+0000 7fef26145640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef0406be30 0x7fef0406e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fef1c034000 tx=0x7fef1c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:42.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.325+0000 7fef16ffd640 1 -- 172.21.15.82:0/3871451623 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fef20067d20 con 0x7fef200b36c0 2024-06-02T22:52:42.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.511+0000 7fef283a9640 1 -- 172.21.15.82:0/3871451623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fef200ccab0 con 0x7fef200b36c0 2024-06-02T22:52:42.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.511+0000 7fef16ffd640 1 -- 172.21.15.82:0/3871451623 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fef200ccab0 con 0x7fef200b36c0 2024-06-02T22:52:42.511 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:52:42.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 -- 172.21.15.82:0/3871451623 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef0406be30 msgr2=0x7fef0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef0406be30 0x7fef0406e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fef1c034000 tx=0x7fef1c02e000 comp rx=0 tx=0).stop 2024-06-02T22:52:42.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 -- 172.21.15.82:0/3871451623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef200b36c0 msgr2=0x7fef20150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef200b36c0 0x7fef20150790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fef1000d830 tx=0x7fef1000dcf0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 -- 172.21.15.82:0/3871451623 shutdown_connections 2024-06-02T22:52:42.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef0406be30 0x7fef0406e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef200cc6d0 0x7fef200ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef200b36c0 0x7fef20150790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 --2- 172.21.15.82:0/3871451623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef20071c60 0x7fef2014fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 -- 172.21.15.82:0/3871451623 >> 172.21.15.82:0/3871451623 conn(0x7fef200b19f0 msgr2=0x7fef2015c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:42.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 -- 172.21.15.82:0/3871451623 shutdown_connections 2024-06-02T22:52:42.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.513+0000 7fef283a9640 1 -- 172.21.15.82:0/3871451623 wait complete. 2024-06-02T22:52:42.524 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:52:42.524 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:42.540 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:52:42.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.681+0000 7f156d5e7640 1 Processor -- start 2024-06-02T22:52:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.681+0000 7f156d5e7640 1 -- start start 2024-06-02T22:52:42.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.681+0000 7f156d5e7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15681618e0 0x7f15680cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.681+0000 7f156d5e7640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f15680d2c20 0x7f15680b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.681+0000 7f156d5e7640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15680d03e0 con 0x7f1568161cc0 2024-06-02T22:52:42.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.681+0000 7f156d5e7640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f15680b4130 con 0x7f15680d2c20 2024-06-02T22:52:42.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.681+0000 7f156d5e7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f15680d0100 con 0x7f15681618e0 2024-06-02T22:52:42.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f15667fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1568161cc0 0x7f15680d2510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53542/0 (socket says 172.21.15.82:53542) 2024-06-02T22:52:42.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f15667fc640 1 -- 172.21.15.82:0/1412379984 learned_addr learned my addr 172.21.15.82:0/1412379984 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:42.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 408833150 0 0) 0x7f15680d03e0 con 0x7f1568161cc0 2024-06-02T22:52:42.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1566ffd640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15681618e0 0x7f15680cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f15677fe640 1 --2- 172.21.15.82:0/1412379984 >> v2:172.21.15.184:3300/0 conn(0x7f15680d2c20 0x7f15680b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1554003520 con 0x7f1568161cc0 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3323042016 0 0) 0x7f1554003520 con 0x7f1568161cc0 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15681618e0 msgr2=0x7f15680cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15681618e0 0x7f15680cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 >> v2:172.21.15.184:3300/0 conn(0x7f15680d2c20 msgr2=0x7f15680b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 --2- 172.21.15.82:0/1412379984 >> v2:172.21.15.184:3300/0 conn(0x7f15680d2c20 0x7f15680b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15680b3ae0 con 0x7f1568161cc0 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f1550001670 con 0x7f1568161cc0 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 >> v1:172.21.15.82:6789/0 conn(0x7f1568161cc0 legacy=0x7f15680d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 0x7f1554003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15681618e0 0x7f1554004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1554004d40 0x7f15540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15680b4130 con 0x7f15540039b0 2024-06-02T22:52:42.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15680d0100 con 0x7f1554004d40 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f155400b9c0 con 0x7f15681618e0 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f1566ffd640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 0x7f1554003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f15667fc640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15681618e0 0x7f1554004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.682+0000 7f15677fe640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1554004d40 0x7f15540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.683+0000 7f1566ffd640 1 -- 172.21.15.82:0/1412379984 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15681618e0 msgr2=0x7f1554004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.683+0000 7f1566ffd640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15681618e0 0x7f1554004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.683+0000 7f1566ffd640 1 -- 172.21.15.82:0/1412379984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1554004d40 msgr2=0x7f15540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.683+0000 7f1566ffd640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1554004d40 0x7f15540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.683+0000 7f1566ffd640 1 -- 172.21.15.82:0/1412379984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1554003520 con 0x7f15540039b0 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.683+0000 7f1566ffd640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 0x7f1554003dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1560009fc0 tx=0x7f1554005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf27dd8a27e6bace server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.683+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560034020 con 0x7f15540039b0 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.683+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15600305f0 con 0x7f15540039b0 2024-06-02T22:52:42.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.683+0000 7f1565ffb640 1 -- 172.21.15.82:0/1412379984 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560009c10 con 0x7f15540039b0 2024-06-02T22:52:42.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.684+0000 7f156d5e7640 1 -- 172.21.15.82:0/1412379984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 msgr2=0x7f1554003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.684+0000 7f156d5e7640 1 --2- 172.21.15.82:0/1412379984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 0x7f1554003dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1560009fc0 tx=0x7f1554005830 comp rx=0 tx=0).stop 2024-06-02T22:52:42.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.684+0000 7f15677fe640 1 -- 172.21.15.82:0/1412379984 reap_dead start 2024-06-02T22:52:42.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.684+0000 7f156d5e7640 1 -- 172.21.15.82:0/1412379984 shutdown_connections 2024-06-02T22:52:42.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.684+0000 7f156d5e7640 1 -- 172.21.15.82:0/1412379984 >> 172.21.15.82:0/1412379984 conn(0x7f156809d410 msgr2=0x7f15680d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:42.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.684+0000 7f156d5e7640 1 -- 172.21.15.82:0/1412379984 shutdown_connections 2024-06-02T22:52:42.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.684+0000 7f156d5e7640 1 -- 172.21.15.82:0/1412379984 wait complete. 2024-06-02T22:52:42.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.685+0000 7f156d5e7640 1 Processor -- start 2024-06-02T22:52:42.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.685+0000 7f156d5e7640 1 -- start start 2024-06-02T22:52:42.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f156d5e7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 0x7f156815ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f156d5e7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1568160520 0x7f15680b9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f156d5e7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15680b95b0 0x7f15680b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f156d5e7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15680d4e50 con 0x7f15540039b0 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f156d5e7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15680d4cd0 con 0x7f15680b95b0 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f156d5e7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f15680d4fd0 con 0x7f1568160520 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f1566ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 0x7f156815ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f1566ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 0x7f156815ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37664/0 (socket says 172.21.15.82:37664) 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f1566ffd640 1 -- 172.21.15.82:0/3399248902 learned_addr learned my addr 172.21.15.82:0/3399248902 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f1566ffd640 1 -- 172.21.15.82:0/3399248902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1568160520 msgr2=0x7f15680b9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f1566ffd640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1568160520 0x7f15680b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f1566ffd640 1 -- 172.21.15.82:0/3399248902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15680b95b0 msgr2=0x7f15680b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f1566ffd640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15680b95b0 0x7f15680b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.686+0000 7f1566ffd640 1 -- 172.21.15.82:0/3399248902 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1568160a30 con 0x7f15540039b0 2024-06-02T22:52:42.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.687+0000 7f1566ffd640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 0x7f156815ffe0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f156000e230 tx=0x7f1560009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:42.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.687+0000 7f155f7fe640 1 -- 172.21.15.82:0/3399248902 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560040070 con 0x7f15540039b0 2024-06-02T22:52:42.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.687+0000 7f155f7fe640 1 -- 172.21.15.82:0/3399248902 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1560003990 con 0x7f15540039b0 2024-06-02T22:52:42.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.687+0000 7f156d5e7640 1 -- 172.21.15.82:0/3399248902 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1568160d10 con 0x7f15540039b0 2024-06-02T22:52:42.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.687+0000 7f155f7fe640 1 -- 172.21.15.82:0/3399248902 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560034040 con 0x7f15540039b0 2024-06-02T22:52:42.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.687+0000 7f156d5e7640 1 -- 172.21.15.82:0/3399248902 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15680cc960 con 0x7f15540039b0 2024-06-02T22:52:42.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.688+0000 7f156d5e7640 1 -- 172.21.15.82:0/3399248902 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1568068430 con 0x7f15540039b0 2024-06-02T22:52:42.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.688+0000 7f155f7fe640 1 -- 172.21.15.82:0/3399248902 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1560037020 con 0x7f15540039b0 2024-06-02T22:52:42.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.689+0000 7f155f7fe640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f154806be30 0x7f154806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.689+0000 7f155f7fe640 1 -- 172.21.15.82:0/3399248902 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f15600abc30 con 0x7f15540039b0 2024-06-02T22:52:42.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.689+0000 7f15667fc640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f154806be30 0x7f154806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.689+0000 7f15667fc640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f154806be30 0x7f154806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1550001d30 tx=0x7f1550001cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:42.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.693+0000 7f155f7fe640 1 -- 172.21.15.82:0/3399248902 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f156007a2a0 con 0x7f15540039b0 2024-06-02T22:52:42.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.879+0000 7f156d5e7640 1 -- 172.21.15.82:0/3399248902 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f156815bbf0 con 0x7f15540039b0 2024-06-02T22:52:42.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.879+0000 7f155f7fe640 1 -- 172.21.15.82:0/3399248902 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f1560079ba0 con 0x7f15540039b0 2024-06-02T22:52:42.879 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:52:42.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 -- 172.21.15.82:0/3399248902 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f154806be30 msgr2=0x7f154806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f154806be30 0x7f154806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1550001d30 tx=0x7f1550001cc0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 -- 172.21.15.82:0/3399248902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 msgr2=0x7f156815ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 0x7f156815ffe0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f156000e230 tx=0x7f1560009750 comp rx=0 tx=0).stop 2024-06-02T22:52:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 -- 172.21.15.82:0/3399248902 shutdown_connections 2024-06-02T22:52:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f154806be30 0x7f154806e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15680b95b0 0x7f15680b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1568160520 0x7f15680b9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 --2- 172.21.15.82:0/3399248902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15540039b0 0x7f156815ffe0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 -- 172.21.15.82:0/3399248902 >> 172.21.15.82:0/3399248902 conn(0x7f156809d410 msgr2=0x7f156806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 -- 172.21.15.82:0/3399248902 shutdown_connections 2024-06-02T22:52:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:42.881+0000 7f156d5e7640 1 -- 172.21.15.82:0/3399248902 wait complete. 2024-06-02T22:52:42.893 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-06-02T22:52:42.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:42.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-02T22:52:42.917 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:52:42.918 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:52:42.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:42.918 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T22:52:42.973 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:52:42.974 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:42.997 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:52:42.997 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:43.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:52:43.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.156+0000 7fe42d838640 1 Processor -- start 2024-06-02T22:52:43.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.156+0000 7fe42d838640 1 -- start start 2024-06-02T22:52:43.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.157+0000 7fe42d838640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe4280d1fc0 0x7fe4280cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.157+0000 7fe42d838640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42815f5e0 con 0x7fe4280d2680 2024-06-02T22:52:43.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.157+0000 7fe42d838640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4280d0ad0 con 0x7fe42815f1a0 2024-06-02T22:52:43.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.157+0000 7fe42d838640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fe4280d13e0 con 0x7fe4280d1fc0 2024-06-02T22:52:43.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.157+0000 7fe426ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe4280d2680 0x7fe4280d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53552/0 (socket says 172.21.15.82:53552) 2024-06-02T22:52:43.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.157+0000 7fe426ffd640 1 -- 172.21.15.82:0/2567828764 learned_addr learned my addr 172.21.15.82:0/2567828764 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:43.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3254548787 0 0) 0x7fe42815f5e0 con 0x7fe4280d2680 2024-06-02T22:52:43.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe410003520 con 0x7fe4280d2680 2024-06-02T22:52:43.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe4277fe640 1 --2- 172.21.15.82:0/2567828764 >> v2:172.21.15.184:3300/0 conn(0x7fe4280d1fc0 0x7fe4280cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2525249747 0 0) 0x7fe410003520 con 0x7fe4280d2680 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 >> v2:172.21.15.184:3300/0 conn(0x7fe4280d1fc0 msgr2=0x7fe4280cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 --2- 172.21.15.82:0/2567828764 >> v2:172.21.15.184:3300/0 conn(0x7fe4280d1fc0 0x7fe4280cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 >> v1:172.21.15.184:6789/0 conn(0x7fe42815f1a0 legacy=0x7fe4280cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42815f890 con 0x7fe4280d2680 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fe4180019f0 con 0x7fe4280d2680 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe4277fe640 1 --2- 172.21.15.82:0/2567828764 >> v2:172.21.15.184:3300/0 conn(0x7fe4280d1fc0 0x7fe4280cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 >> v1:172.21.15.82:6789/0 conn(0x7fe4280d2680 legacy=0x7fe4280d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100039b0 0x7fe410003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe410004800 0x7fe410004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 0x7fe41000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4280d13e0 con 0x7fe4100051c0 2024-06-02T22:52:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe41000c110 con 0x7fe4100039b0 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe41000c310 con 0x7fe410004800 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe4277fe640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 0x7fe41000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe426ffd640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100039b0 0x7fe410003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe4267fc640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe410004800 0x7fe410004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe4277fe640 1 -- 172.21.15.82:0/2567828764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe410004800 msgr2=0x7fe410004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe4277fe640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe410004800 0x7fe410004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe4277fe640 1 -- 172.21.15.82:0/2567828764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100039b0 msgr2=0x7fe410003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe4277fe640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100039b0 0x7fe410003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe4277fe640 1 -- 172.21.15.82:0/2567828764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe410003520 con 0x7fe4100051c0 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.158+0000 7fe426ffd640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4100039b0 0x7fe410003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.159+0000 7fe4277fe640 1 -- 172.21.15.82:0/2567828764 reap_dead start 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.159+0000 7fe4277fe640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 0x7fe41000b9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4200098a0 tx=0x7fe410005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910959e9b5ba644 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.159+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41800a480 con 0x7fe4100051c0 2024-06-02T22:52:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.159+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe42002ad60 con 0x7fe4100051c0 2024-06-02T22:52:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.159+0000 7fe425ffb640 1 -- 172.21.15.82:0/2567828764 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42000f040 con 0x7fe4100051c0 2024-06-02T22:52:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.160+0000 7fe42d838640 1 -- 172.21.15.82:0/2567828764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 msgr2=0x7fe41000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.160+0000 7fe42d838640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 0x7fe41000b9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4200098a0 tx=0x7fe410005830 comp rx=0 tx=0).stop 2024-06-02T22:52:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.160+0000 7fe42d838640 1 -- 172.21.15.82:0/2567828764 shutdown_connections 2024-06-02T22:52:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.160+0000 7fe42d838640 1 --2- 172.21.15.82:0/2567828764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 0x7fe41000b9c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.160+0000 7fe42d838640 1 -- 172.21.15.82:0/2567828764 >> 172.21.15.82:0/2567828764 conn(0x7fe42809d3f0 msgr2=0x7fe4280d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.160+0000 7fe42d838640 1 -- 172.21.15.82:0/2567828764 shutdown_connections 2024-06-02T22:52:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.160+0000 7fe42d838640 1 -- 172.21.15.82:0/2567828764 wait complete. 2024-06-02T22:52:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.161+0000 7fe42d838640 1 Processor -- start 2024-06-02T22:52:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.161+0000 7fe42d838640 1 -- start start 2024-06-02T22:52:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe42d838640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 0x7fe4280b90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe42d838640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4281f4b60 0x7fe4281f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe42d838640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4280cd5d0 0x7fe42815a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe42d838640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4280d2410 con 0x7fe4100051c0 2024-06-02T22:52:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe42d838640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe4280d1070 con 0x7fe4280cd5d0 2024-06-02T22:52:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe42d838640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe4280d4f00 con 0x7fe4281f4b60 2024-06-02T22:52:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe426ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 0x7fe4280b90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe426ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 0x7fe4280b90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37676/0 (socket says 172.21.15.82:37676) 2024-06-02T22:52:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe426ffd640 1 -- 172.21.15.82:0/2689155038 learned_addr learned my addr 172.21.15.82:0/2689155038 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe4267fc640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4281f4b60 0x7fe4281f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe4277fe640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4280cd5d0 0x7fe42815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe426ffd640 1 -- 172.21.15.82:0/2689155038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4281f4b60 msgr2=0x7fe4281f7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe426ffd640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4281f4b60 0x7fe4281f7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe426ffd640 1 -- 172.21.15.82:0/2689155038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4280cd5d0 msgr2=0x7fe42815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe426ffd640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4280cd5d0 0x7fe42815a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe426ffd640 1 -- 172.21.15.82:0/2689155038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4281f8460 con 0x7fe4100051c0 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.162+0000 7fe426ffd640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 0x7fe4280b90f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe418007970 tx=0x7fe41800a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.163+0000 7fe40ffff640 1 -- 172.21.15.82:0/2689155038 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418017020 con 0x7fe4100051c0 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.163+0000 7fe40ffff640 1 -- 172.21.15.82:0/2689155038 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41800ade0 con 0x7fe4100051c0 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.163+0000 7fe42d838640 1 -- 172.21.15.82:0/2689155038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4281f40c0 con 0x7fe4100051c0 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.163+0000 7fe40ffff640 1 -- 172.21.15.82:0/2689155038 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418013610 con 0x7fe4100051c0 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.163+0000 7fe42d838640 1 -- 172.21.15.82:0/2689155038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4280b96f0 con 0x7fe4100051c0 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.164+0000 7fe42d838640 1 -- 172.21.15.82:0/2689155038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4281f3ef0 con 0x7fe4100051c0 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.164+0000 7fe40ffff640 1 -- 172.21.15.82:0/2689155038 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe41801a020 con 0x7fe4100051c0 2024-06-02T22:52:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.164+0000 7fe40ffff640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe41406be30 0x7fe41406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.164+0000 7fe40ffff640 1 -- 172.21.15.82:0/2689155038 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe41808bbd0 con 0x7fe4100051c0 2024-06-02T22:52:43.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.165+0000 7fe4267fc640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe41406be30 0x7fe41406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.165+0000 7fe4267fc640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe41406be30 0x7fe41406e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe41c000c00 tx=0x7fe41c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:43.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.169+0000 7fe40ffff640 1 -- 172.21.15.82:0/2689155038 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe418021020 con 0x7fe4100051c0 2024-06-02T22:52:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.352+0000 7fe42d838640 1 -- 172.21.15.82:0/2689155038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe428068430 con 0x7fe4100051c0 2024-06-02T22:52:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.353+0000 7fe40ffff640 1 -- 172.21.15.82:0/2689155038 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fe4281f8460 con 0x7fe4100051c0 2024-06-02T22:52:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:52:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 -- 172.21.15.82:0/2689155038 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe41406be30 msgr2=0x7fe41406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe41406be30 0x7fe41406e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe41c000c00 tx=0x7fe41c009040 comp rx=0 tx=0).stop 2024-06-02T22:52:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 -- 172.21.15.82:0/2689155038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 msgr2=0x7fe4280b90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 0x7fe4280b90f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe418007970 tx=0x7fe41800a730 comp rx=0 tx=0).stop 2024-06-02T22:52:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 -- 172.21.15.82:0/2689155038 shutdown_connections 2024-06-02T22:52:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe41406be30 0x7fe41406e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4280cd5d0 0x7fe42815a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4281f4b60 0x7fe4281f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 --2- 172.21.15.82:0/2689155038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4100051c0 0x7fe4280b90f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 -- 172.21.15.82:0/2689155038 >> 172.21.15.82:0/2689155038 conn(0x7fe42809d3f0 msgr2=0x7fe4280c7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 -- 172.21.15.82:0/2689155038 shutdown_connections 2024-06-02T22:52:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.355+0000 7fe42d838640 1 -- 172.21.15.82:0/2689155038 wait complete. 2024-06-02T22:52:43.366 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:52:43.366 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:43.386 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:52:43.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.487+0000 7f86f7038640 1 Processor -- start 2024-06-02T22:52:43.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.487+0000 7f86f7038640 1 -- start start 2024-06-02T22:52:43.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.487+0000 7f86f7038640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f86f00d2680 0x7f86f015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.487+0000 7f86f7038640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f86f00d1fc0 0x7f86f00d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.487+0000 7f86f7038640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f0161fa0 0x7f86f0162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.487+0000 7f86f7038640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f86f00d13e0 con 0x7f86f00d2680 2024-06-02T22:52:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.487+0000 7f86f7038640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f86f00d2fa0 con 0x7f86f00d1fc0 2024-06-02T22:52:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.487+0000 7f86f7038640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f86f00d0ad0 con 0x7f86f0161fa0 2024-06-02T22:52:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86f4dd4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f86f00d2680 0x7f86f015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86f4dd4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f86f00d2680 0x7f86f015f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37682/0 (socket says 172.21.15.82:37682) 2024-06-02T22:52:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86f4dd4640 1 -- 172.21.15.82:0/3338368343 learned_addr learned my addr 172.21.15.82:0/3338368343 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86f4dd4640 1 -- 172.21.15.82:0/3338368343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f0161fa0 msgr2=0x7f86f0162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86f55d5640 1 --2- 172.21.15.82:0/3338368343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f0161fa0 0x7f86f0162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86effff640 1 --2- 172.21.15.82:0/3338368343 >> v2:172.21.15.184:3300/0 conn(0x7f86f00d1fc0 0x7f86f00d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86f4dd4640 1 --2- 172.21.15.82:0/3338368343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f0161fa0 0x7f86f0162410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86f4dd4640 1 -- 172.21.15.82:0/3338368343 >> v2:172.21.15.184:3300/0 conn(0x7f86f00d1fc0 msgr2=0x7f86f00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86f4dd4640 1 --2- 172.21.15.82:0/3338368343 >> v2:172.21.15.184:3300/0 conn(0x7f86f00d1fc0 0x7f86f00d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86f4dd4640 1 -- 172.21.15.82:0/3338368343 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f015f890 con 0x7f86f00d2680 2024-06-02T22:52:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86effff640 1 --2- 172.21.15.82:0/3338368343 >> v2:172.21.15.184:3300/0 conn(0x7f86f00d1fc0 0x7f86f00d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.488+0000 7f86f55d5640 1 --2- 172.21.15.82:0/3338368343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f0161fa0 0x7f86f0162410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86f4dd4640 1 --2- 172.21.15.82:0/3338368343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f00d2680 0x7f86f015f1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86f00c7960 tx=0x7f86e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677fa6be3d3b1f54 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86ef7fe640 1 -- 172.21.15.82:0/3338368343 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4037070 con 0x7f86f00d2680 2024-06-02T22:52:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86ef7fe640 1 -- 172.21.15.82:0/3338368343 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e4032440 con 0x7f86f00d2680 2024-06-02T22:52:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86ef7fe640 1 -- 172.21.15.82:0/3338368343 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4032810 con 0x7f86f00d2680 2024-06-02T22:52:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86f7038640 1 -- 172.21.15.82:0/3338368343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f00d2680 msgr2=0x7f86f015f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86f7038640 1 --2- 172.21.15.82:0/3338368343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f00d2680 0x7f86f015f1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86f00c7960 tx=0x7f86e402a1e0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86f7038640 1 -- 172.21.15.82:0/3338368343 shutdown_connections 2024-06-02T22:52:43.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86f7038640 1 --2- 172.21.15.82:0/3338368343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f0161fa0 0x7f86f0162410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86f7038640 1 --2- 172.21.15.82:0/3338368343 >> v2:172.21.15.184:3300/0 conn(0x7f86f00d1fc0 0x7f86f00d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86f7038640 1 --2- 172.21.15.82:0/3338368343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f00d2680 0x7f86f015f1a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86f7038640 1 -- 172.21.15.82:0/3338368343 >> 172.21.15.82:0/3338368343 conn(0x7f86f009d3f0 msgr2=0x7f86f00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:43.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86f7038640 1 -- 172.21.15.82:0/3338368343 shutdown_connections 2024-06-02T22:52:43.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.489+0000 7f86f7038640 1 -- 172.21.15.82:0/3338368343 wait complete. 2024-06-02T22:52:43.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.490+0000 7f86f7038640 1 Processor -- start 2024-06-02T22:52:43.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.490+0000 7f86f7038640 1 -- start start 2024-06-02T22:52:43.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.491+0000 7f86f7038640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f00d1fc0 0x7f86f015c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.491+0000 7f86f7038640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86f00d2680 0x7f86f015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.491+0000 7f86f7038640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f0161fa0 0x7f86f015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.491+0000 7f86f7038640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86f00d2400 con 0x7f86f0161fa0 2024-06-02T22:52:43.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.491+0000 7f86f7038640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f86f00d1070 con 0x7f86f00d2680 2024-06-02T22:52:43.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.491+0000 7f86f7038640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f86f00d4f00 con 0x7f86f00d1fc0 2024-06-02T22:52:43.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.491+0000 7f86f55d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f0161fa0 0x7f86f015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.491+0000 7f86f55d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f0161fa0 0x7f86f015ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37686/0 (socket says 172.21.15.82:37686) 2024-06-02T22:52:43.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.491+0000 7f86f55d5640 1 -- 172.21.15.82:0/2472608882 learned_addr learned my addr 172.21.15.82:0/2472608882 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:43.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86f4dd4640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f00d1fc0 0x7f86f015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86effff640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86f00d2680 0x7f86f015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86f55d5640 1 -- 172.21.15.82:0/2472608882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f00d1fc0 msgr2=0x7f86f015c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86f55d5640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f00d1fc0 0x7f86f015c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86f55d5640 1 -- 172.21.15.82:0/2472608882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86f00d2680 msgr2=0x7f86f015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86f55d5640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86f00d2680 0x7f86f015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86f55d5640 1 -- 172.21.15.82:0/2472608882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f015b570 con 0x7f86f0161fa0 2024-06-02T22:52:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86f4dd4640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f00d1fc0 0x7f86f015c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86effff640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86f00d2680 0x7f86f015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86f55d5640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f0161fa0 0x7f86f015ae00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f86e800cd50 tx=0x7f86e800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86ed7fa640 1 -- 172.21.15.82:0/2472608882 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e800f680 con 0x7f86f0161fa0 2024-06-02T22:52:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86ed7fa640 1 -- 172.21.15.82:0/2472608882 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e800f840 con 0x7f86f0161fa0 2024-06-02T22:52:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86f7038640 1 -- 172.21.15.82:0/2472608882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f015b850 con 0x7f86f0161fa0 2024-06-02T22:52:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86ed7fa640 1 -- 172.21.15.82:0/2472608882 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e800fc30 con 0x7f86f0161fa0 2024-06-02T22:52:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.492+0000 7f86f7038640 1 -- 172.21.15.82:0/2472608882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f015be10 con 0x7f86f0161fa0 2024-06-02T22:52:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.493+0000 7f86f7038640 1 -- 172.21.15.82:0/2472608882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f0068430 con 0x7f86f0161fa0 2024-06-02T22:52:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.493+0000 7f86ed7fa640 1 -- 172.21.15.82:0/2472608882 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86e80213f0 con 0x7f86f0161fa0 2024-06-02T22:52:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.494+0000 7f86ed7fa640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f86d406be30 0x7f86d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.494+0000 7f86ed7fa640 1 -- 172.21.15.82:0/2472608882 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f86e808bed0 con 0x7f86f0161fa0 2024-06-02T22:52:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.494+0000 7f86f4dd4640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f86d406be30 0x7f86d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.494+0000 7f86f4dd4640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f86d406be30 0x7f86d406e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86e4034000 tx=0x7f86e402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.498+0000 7f86ed7fa640 1 -- 172.21.15.82:0/2472608882 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f86e8014030 con 0x7f86f0161fa0 2024-06-02T22:52:43.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.689+0000 7f86f7038640 1 -- 172.21.15.82:0/2472608882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f86f00d04e0 con 0x7f86f0161fa0 2024-06-02T22:52:43.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.689+0000 7f86ed7fa640 1 -- 172.21.15.82:0/2472608882 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f86e805a5d0 con 0x7f86f0161fa0 2024-06-02T22:52:43.689 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:52:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 -- 172.21.15.82:0/2472608882 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f86d406be30 msgr2=0x7f86d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f86d406be30 0x7f86d406e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f86e4034000 tx=0x7f86e402e000 comp rx=0 tx=0).stop 2024-06-02T22:52:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 -- 172.21.15.82:0/2472608882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f0161fa0 msgr2=0x7f86f015ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f0161fa0 0x7f86f015ae00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f86e800cd50 tx=0x7f86e800a650 comp rx=0 tx=0).stop 2024-06-02T22:52:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 -- 172.21.15.82:0/2472608882 shutdown_connections 2024-06-02T22:52:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f86d406be30 0x7f86d406e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f0161fa0 0x7f86f015ae00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86f00d2680 0x7f86f015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 --2- 172.21.15.82:0/2472608882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86f00d1fc0 0x7f86f015c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 -- 172.21.15.82:0/2472608882 >> 172.21.15.82:0/2472608882 conn(0x7f86f009d3f0 msgr2=0x7f86f00c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 -- 172.21.15.82:0/2472608882 shutdown_connections 2024-06-02T22:52:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:43.691+0000 7f86f7038640 1 -- 172.21.15.82:0/2472608882 wait complete. 2024-06-02T22:52:43.702 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2024-06-02T22:52:43.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:43.702 DEBUG:teuthology.orchestra.run.smithi184:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-06-02T22:52:43.732 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:52:43.732 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:52:43.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:43.732 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-02T22:52:43.807 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:52:43.808 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:43.825 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:52:43.825 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:43.882 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.023+0000 7f2b5d0ee640 1 Processor -- start 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.023+0000 7f2b5d0ee640 1 -- start start 2024-06-02T22:52:44.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.024+0000 7f2b5d0ee640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2b580d2680 0x7f2b5815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.024+0000 7f2b5d0ee640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b580cef70 0x7f2b580cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.024+0000 7f2b5d0ee640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b580d0ad0 con 0x7f2b580d1fc0 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.024+0000 7f2b5d0ee640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2b580d13e0 con 0x7f2b580cef70 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.024+0000 7f2b5d0ee640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f2b5815f890 con 0x7f2b580d2680 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.024+0000 7f2b5759e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b580cef70 0x7f2b580cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.024+0000 7f2b5759e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b580cef70 0x7f2b580cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37694/0 (socket says 172.21.15.82:37694) 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.024+0000 7f2b5759e640 1 -- 172.21.15.82:0/1354545778 learned_addr learned my addr 172.21.15.82:0/1354545778 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.025+0000 7f2b5759e640 1 -- 172.21.15.82:0/1354545778 >> v2:172.21.15.184:3300/0 conn(0x7f2b580d2680 msgr2=0x7f2b5815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.025+0000 7f2b56d9d640 1 --2- 172.21.15.82:0/1354545778 >> v2:172.21.15.184:3300/0 conn(0x7f2b580d2680 0x7f2b5815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.025+0000 7f2b5759e640 1 --2- 172.21.15.82:0/1354545778 >> v2:172.21.15.184:3300/0 conn(0x7f2b580d2680 0x7f2b5815f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.025+0000 7f2b5759e640 1 -- 172.21.15.82:0/1354545778 >> v1:172.21.15.184:6789/0 conn(0x7f2b580d1fc0 legacy=0x7f2b580d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.025+0000 7f2b5759e640 1 -- 172.21.15.82:0/1354545778 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b580d0d90 con 0x7f2b580cef70 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.025+0000 7f2b5759e640 1 --2- 172.21.15.82:0/1354545778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b580cef70 0x7f2b580cf3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2b580d1560 tx=0x7f2b5002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1845622205461e60 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.026+0000 7f2b55d9b640 1 -- 172.21.15.82:0/1354545778 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50036070 con 0x7f2b580cef70 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.026+0000 7f2b55d9b640 1 -- 172.21.15.82:0/1354545778 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b50031600 con 0x7f2b580cef70 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.026+0000 7f2b55d9b640 1 -- 172.21.15.82:0/1354545778 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b500319d0 con 0x7f2b580cef70 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.026+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1354545778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b580cef70 msgr2=0x7f2b580cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.026+0000 7f2b5d0ee640 1 --2- 172.21.15.82:0/1354545778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b580cef70 0x7f2b580cf3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2b580d1560 tx=0x7f2b5002a6d0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.026+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1354545778 shutdown_connections 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.026+0000 7f2b5d0ee640 1 --2- 172.21.15.82:0/1354545778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b580cef70 0x7f2b580cf3c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.026+0000 7f2b5d0ee640 1 --2- 172.21.15.82:0/1354545778 >> v2:172.21.15.184:3300/0 conn(0x7f2b580d2680 0x7f2b5815f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.026+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1354545778 >> 172.21.15.82:0/1354545778 conn(0x7f2b5809d3f0 msgr2=0x7f2b580d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.026+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1354545778 shutdown_connections 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.026+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1354545778 wait complete. 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.028+0000 7f2b5d0ee640 1 Processor -- start 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.028+0000 7f2b5d0ee640 1 -- start start 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.028+0000 7f2b5d0ee640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b580cef70 0x7f2b580a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.028+0000 7f2b5d0ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b580d1fc0 0x7f2b5809de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.028+0000 7f2b5d0ee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b580d2680 0x7f2b5809f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.028+0000 7f2b5d0ee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2b580d4f00 con 0x7f2b580d1fc0 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.028+0000 7f2b5d0ee640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2b580d2400 con 0x7f2b580cef70 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.028+0000 7f2b5d0ee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2b580d1870 con 0x7f2b580d2680 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b580d1fc0 0x7f2b5809de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b580d1fc0 0x7f2b5809de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37696/0 (socket says 172.21.15.82:37696) 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5659c640 1 -- 172.21.15.82:0/1362870735 learned_addr learned my addr 172.21.15.82:0/1362870735 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b56d9d640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b580cef70 0x7f2b580a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5759e640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b580d2680 0x7f2b5809f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5659c640 1 -- 172.21.15.82:0/1362870735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b580d2680 msgr2=0x7f2b5809f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5659c640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b580d2680 0x7f2b5809f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5659c640 1 -- 172.21.15.82:0/1362870735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b580cef70 msgr2=0x7f2b580a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5659c640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b580cef70 0x7f2b580a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5659c640 1 -- 172.21.15.82:0/1362870735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5809e3a0 con 0x7f2b580d1fc0 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5759e640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b580d2680 0x7f2b5809f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5659c640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b580d1fc0 0x7f2b5809de60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00c430 tx=0x7f2b4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b3f7fe640 1 -- 172.21.15.82:0/1362870735 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c011790 con 0x7f2b580d1fc0 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b3f7fe640 1 -- 172.21.15.82:0/1362870735 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4c017070 con 0x7f2b580d1fc0 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1362870735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5809e640 con 0x7f2b580d1fc0 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b3f7fe640 1 -- 172.21.15.82:0/1362870735 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c011bb0 con 0x7f2b580d1fc0 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.029+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1362870735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5809ec00 con 0x7f2b580d1fc0 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.030+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1362870735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b58068430 con 0x7f2b580d1fc0 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.031+0000 7f2b3f7fe640 1 -- 172.21.15.82:0/1362870735 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b4c01c460 con 0x7f2b580d1fc0 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.031+0000 7f2b3f7fe640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2b4406be30 0x7f2b4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.031+0000 7f2b56d9d640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2b4406be30 0x7f2b4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.031+0000 7f2b3f7fe640 1 -- 172.21.15.82:0/1362870735 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2b4c08b060 con 0x7f2b580d1fc0 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.032+0000 7f2b56d9d640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2b4406be30 0x7f2b4406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800a970 tx=0x7f2b48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:44.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.036+0000 7f2b3f7fe640 1 -- 172.21.15.82:0/1362870735 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2b4c0596e0 con 0x7f2b580d1fc0 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.223+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1362870735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2b580d04e0 con 0x7f2b580d1fc0 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.224+0000 7f2b3f7fe640 1 -- 172.21.15.82:0/1362870735 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f2b4c058fe0 con 0x7f2b580d1fc0 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1362870735 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2b4406be30 msgr2=0x7f2b4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2b4406be30 0x7f2b4406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800a970 tx=0x7f2b48008040 comp rx=0 tx=0).stop 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1362870735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b580d1fc0 msgr2=0x7f2b5809de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b580d1fc0 0x7f2b5809de60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00c430 tx=0x7f2b4c00c8f0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1362870735 shutdown_connections 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2b4406be30 0x7f2b4406e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b580d2680 0x7f2b5809f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b580d1fc0 0x7f2b5809de60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 --2- 172.21.15.82:0/1362870735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b580cef70 0x7f2b580a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1362870735 >> 172.21.15.82:0/1362870735 conn(0x7f2b5809d3f0 msgr2=0x7f2b580c84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:44.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1362870735 shutdown_connections 2024-06-02T22:52:44.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.226+0000 7f2b5d0ee640 1 -- 172.21.15.82:0/1362870735 wait complete. 2024-06-02T22:52:44.237 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:52:44.237 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:44.253 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:52:44.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.393+0000 7fa99e4ca640 1 Processor -- start 2024-06-02T22:52:44.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.393+0000 7fa99e4ca640 1 -- start start 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.393+0000 7fa99e4ca640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa9980d2680 0x7fa99815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.393+0000 7fa99e4ca640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9980d1fc0 0x7fa9980d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.393+0000 7fa99e4ca640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9980d2fa0 con 0x7fa998161fa0 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.393+0000 7fa99e4ca640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa9980cff80 con 0x7fa9980d2680 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.393+0000 7fa99e4ca640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa9980d13e0 con 0x7fa9980d1fc0 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.394+0000 7fa997fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa9980d2680 0x7fa99815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.394+0000 7fa997fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa9980d2680 0x7fa99815f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37712/0 (socket says 172.21.15.82:37712) 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.394+0000 7fa99ca67640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa998161fa0 0x7fa998162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53554/0 (socket says 172.21.15.82:53554) 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.394+0000 7fa997fff640 1 -- 172.21.15.82:0/2193173887 learned_addr learned my addr 172.21.15.82:0/2193173887 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.394+0000 7fa9977fe640 1 --2- 172.21.15.82:0/2193173887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9980d1fc0 0x7fa9980d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.394+0000 7fa997fff640 1 -- 172.21.15.82:0/2193173887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9980d1fc0 msgr2=0x7fa9980d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.394+0000 7fa997fff640 1 --2- 172.21.15.82:0/2193173887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9980d1fc0 0x7fa9980d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.394+0000 7fa997fff640 1 -- 172.21.15.82:0/2193173887 >> v1:172.21.15.82:6789/0 conn(0x7fa998161fa0 legacy=0x7fa998162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.394+0000 7fa996ffd640 1 -- 172.21.15.82:0/2193173887 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1265543759 0 0) 0x7fa9980d2fa0 con 0x7fa998161fa0 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.394+0000 7fa997fff640 1 -- 172.21.15.82:0/2193173887 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9980d0ad0 con 0x7fa9980d2680 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa997fff640 1 --2- 172.21.15.82:0/2193173887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9980d2680 0x7fa99815f1a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa988009870 tx=0x7fa98802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5cffb793bf8026 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa996ffd640 1 -- 172.21.15.82:0/2193173887 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988037070 con 0x7fa9980d2680 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa996ffd640 1 -- 172.21.15.82:0/2193173887 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa988032440 con 0x7fa9980d2680 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa996ffd640 1 -- 172.21.15.82:0/2193173887 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988032810 con 0x7fa9980d2680 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2193173887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9980d2680 msgr2=0x7fa99815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa99e4ca640 1 --2- 172.21.15.82:0/2193173887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9980d2680 0x7fa99815f1a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa988009870 tx=0x7fa98802a270 comp rx=0 tx=0).stop 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2193173887 shutdown_connections 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa99e4ca640 1 --2- 172.21.15.82:0/2193173887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9980d1fc0 0x7fa9980d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa99e4ca640 1 --2- 172.21.15.82:0/2193173887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9980d2680 0x7fa99815f1a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2193173887 >> 172.21.15.82:0/2193173887 conn(0x7fa99809d3f0 msgr2=0x7fa9980d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2193173887 shutdown_connections 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.395+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2193173887 wait complete. 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.396+0000 7fa99e4ca640 1 Processor -- start 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.397+0000 7fa99e4ca640 1 -- start start 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.397+0000 7fa99e4ca640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9980d1fc0 0x7fa9981515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.397+0000 7fa99e4ca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9980d2680 0x7fa9981f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.397+0000 7fa99e4ca640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa998161fa0 0x7fa9980c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.397+0000 7fa99e4ca640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa9980d1070 con 0x7fa998161fa0 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.397+0000 7fa99e4ca640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa9980d0d90 con 0x7fa9980d2680 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.397+0000 7fa99e4ca640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa9980d2400 con 0x7fa9980d1fc0 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.397+0000 7fa99ca67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa998161fa0 0x7fa9980c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa99ca67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa998161fa0 0x7fa9980c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37728/0 (socket says 172.21.15.82:37728) 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa99ca67640 1 -- 172.21.15.82:0/2062261132 learned_addr learned my addr 172.21.15.82:0/2062261132 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa997fff640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9980d1fc0 0x7fa9981515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa99ca67640 1 -- 172.21.15.82:0/2062261132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9980d1fc0 msgr2=0x7fa9981515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa99ca67640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9980d1fc0 0x7fa9981515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa99ca67640 1 -- 172.21.15.82:0/2062261132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9980d2680 msgr2=0x7fa9981f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa99ca67640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9980d2680 0x7fa9981f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa99ca67640 1 -- 172.21.15.82:0/2062261132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9981f4d20 con 0x7fa998161fa0 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa99ca67640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa998161fa0 0x7fa9980c8f20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c730 tx=0x7fa99000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa994ff9640 1 -- 172.21.15.82:0/2062261132 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990018070 con 0x7fa998161fa0 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa994ff9640 1 -- 172.21.15.82:0/2062261132 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99000ce40 con 0x7fa998161fa0 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2062261132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9980cc890 con 0x7fa998161fa0 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa994ff9640 1 -- 172.21.15.82:0/2062261132 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99000a860 con 0x7fa998161fa0 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.398+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2062261132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9980cce50 con 0x7fa998161fa0 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.399+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2062261132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa998068430 con 0x7fa998161fa0 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.400+0000 7fa994ff9640 1 -- 172.21.15.82:0/2062261132 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa99001b070 con 0x7fa998161fa0 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.400+0000 7fa994ff9640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa98406be30 0x7fa98406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.400+0000 7fa994ff9640 1 -- 172.21.15.82:0/2062261132 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa99008a720 con 0x7fa998161fa0 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.400+0000 7fa997fff640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa98406be30 0x7fa98406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.401+0000 7fa997fff640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa98406be30 0x7fa98406e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa988034000 tx=0x7fa98802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.405+0000 7fa994ff9640 1 -- 172.21.15.82:0/2062261132 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa9981f4d20 con 0x7fa998161fa0 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.590+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2062261132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa9980d04e0 con 0x7fa998161fa0 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.591+0000 7fa994ff9640 1 -- 172.21.15.82:0/2062261132 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fa990058e20 con 0x7fa998161fa0 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.592+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2062261132 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa98406be30 msgr2=0x7fa98406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.592+0000 7fa99e4ca640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa98406be30 0x7fa98406e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa988034000 tx=0x7fa98802e000 comp rx=0 tx=0).stop 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.592+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2062261132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa998161fa0 msgr2=0x7fa9980c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.592+0000 7fa99e4ca640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa998161fa0 0x7fa9980c8f20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c730 tx=0x7fa99000cbf0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.593+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2062261132 shutdown_connections 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.593+0000 7fa99e4ca640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa98406be30 0x7fa98406e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.593+0000 7fa99e4ca640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa998161fa0 0x7fa9980c8f20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.593+0000 7fa99e4ca640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9980d2680 0x7fa9981f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.593+0000 7fa99e4ca640 1 --2- 172.21.15.82:0/2062261132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9980d1fc0 0x7fa9981515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.593+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2062261132 >> 172.21.15.82:0/2062261132 conn(0x7fa99809d3f0 msgr2=0x7fa998160db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.593+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2062261132 shutdown_connections 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.593+0000 7fa99e4ca640 1 -- 172.21.15.82:0/2062261132 wait complete. 2024-06-02T22:52:44.603 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:44.604 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:52:44.628 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:44.628 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-02T22:52:44.684 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:52:44.685 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:44.704 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:52:44.704 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:44.762 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.862+0000 7fc29fd30640 1 Processor -- start 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.863+0000 7fc29fd30640 1 -- start start 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.863+0000 7fc29fd30640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc29815f1a0 0x7fc2980d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.863+0000 7fc29fd30640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2980cef70 0x7fc2980cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.863+0000 7fc29fd30640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29815f5e0 con 0x7fc2980d2680 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.863+0000 7fc29fd30640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc2980d13e0 con 0x7fc29815f1a0 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.863+0000 7fc29fd30640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc2980d0ad0 con 0x7fc2980cef70 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.863+0000 7fc29d2cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc29815f1a0 0x7fc2980d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.864+0000 7fc29d2cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc29815f1a0 0x7fc2980d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37732/0 (socket says 172.21.15.82:37732) 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.864+0000 7fc29d2cb640 1 -- 172.21.15.82:0/3084030827 learned_addr learned my addr 172.21.15.82:0/3084030827 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.864+0000 7fc29e2cd640 1 --2- 172.21.15.82:0/3084030827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2980cef70 0x7fc2980cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.864+0000 7fc29d2cb640 1 -- 172.21.15.82:0/3084030827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2980cef70 msgr2=0x7fc2980cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.864+0000 7fc29d2cb640 1 --2- 172.21.15.82:0/3084030827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2980cef70 0x7fc2980cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.864+0000 7fc29d2cb640 1 -- 172.21.15.82:0/3084030827 >> v1:172.21.15.184:6789/0 conn(0x7fc2980d2680 legacy=0x7fc2980d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.864+0000 7fc29d2cb640 1 -- 172.21.15.82:0/3084030827 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29815f890 con 0x7fc29815f1a0 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.864+0000 7fc29e2cd640 1 --2- 172.21.15.82:0/3084030827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2980cef70 0x7fc2980cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.864+0000 7fc29d2cb640 1 --2- 172.21.15.82:0/3084030827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc29815f1a0 0x7fc2980d1fc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009870 tx=0x7fc28c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b838de61da3f387c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.865+0000 7fc29caca640 1 -- 172.21.15.82:0/3084030827 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c037070 con 0x7fc29815f1a0 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.865+0000 7fc29caca640 1 -- 172.21.15.82:0/3084030827 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28c032440 con 0x7fc29815f1a0 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.865+0000 7fc29caca640 1 -- 172.21.15.82:0/3084030827 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c032810 con 0x7fc29815f1a0 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.865+0000 7fc29fd30640 1 -- 172.21.15.82:0/3084030827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc29815f1a0 msgr2=0x7fc2980d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.865+0000 7fc29fd30640 1 --2- 172.21.15.82:0/3084030827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc29815f1a0 0x7fc2980d1fc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009870 tx=0x7fc28c02a270 comp rx=0 tx=0).stop 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.865+0000 7fc29fd30640 1 -- 172.21.15.82:0/3084030827 shutdown_connections 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.865+0000 7fc29fd30640 1 --2- 172.21.15.82:0/3084030827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2980cef70 0x7fc2980cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.865+0000 7fc29fd30640 1 --2- 172.21.15.82:0/3084030827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc29815f1a0 0x7fc2980d1fc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.865+0000 7fc29fd30640 1 -- 172.21.15.82:0/3084030827 >> 172.21.15.82:0/3084030827 conn(0x7fc29809d3f0 msgr2=0x7fc2980d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.865+0000 7fc29fd30640 1 -- 172.21.15.82:0/3084030827 shutdown_connections 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.865+0000 7fc29fd30640 1 -- 172.21.15.82:0/3084030827 wait complete. 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.866+0000 7fc29fd30640 1 Processor -- start 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.866+0000 7fc29fd30640 1 -- start start 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29fd30640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2980cef70 0x7fc29815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29fd30640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2980d2680 0x7fc2980cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29fd30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc29815f1a0 0x7fc29815d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29fd30640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc2980d4f00 con 0x7fc29815f1a0 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29fd30640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc2980d1070 con 0x7fc2980d2680 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29fd30640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc2980d1870 con 0x7fc2980cef70 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29e2cd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc29815f1a0 0x7fc29815d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29e2cd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc29815f1a0 0x7fc29815d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37746/0 (socket says 172.21.15.82:37746) 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29e2cd640 1 -- 172.21.15.82:0/3591298093 learned_addr learned my addr 172.21.15.82:0/3591298093 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29d2cb640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2980d2680 0x7fc2980cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29dacc640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2980cef70 0x7fc29815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29e2cd640 1 -- 172.21.15.82:0/3591298093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2980cef70 msgr2=0x7fc29815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29e2cd640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2980cef70 0x7fc29815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29e2cd640 1 -- 172.21.15.82:0/3591298093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2980d2680 msgr2=0x7fc2980cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29e2cd640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2980d2680 0x7fc2980cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29e2cd640 1 -- 172.21.15.82:0/3591298093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29815dfe0 con 0x7fc29815f1a0 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.867+0000 7fc29d2cb640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2980d2680 0x7fc2980cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.868+0000 7fc29e2cd640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc29815f1a0 0x7fc29815d5b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc29000e810 tx=0x7fc29000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.868+0000 7fc2967fc640 1 -- 172.21.15.82:0/3591298093 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29000f040 con 0x7fc29815f1a0 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.868+0000 7fc2967fc640 1 -- 172.21.15.82:0/3591298093 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc290004030 con 0x7fc29815f1a0 2024-06-02T22:52:44.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.868+0000 7fc29fd30640 1 -- 172.21.15.82:0/3591298093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29815e2c0 con 0x7fc29815f1a0 2024-06-02T22:52:44.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.868+0000 7fc2967fc640 1 -- 172.21.15.82:0/3591298093 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2900043e0 con 0x7fc29815f1a0 2024-06-02T22:52:44.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.868+0000 7fc29fd30640 1 -- 172.21.15.82:0/3591298093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2980cb470 con 0x7fc29815f1a0 2024-06-02T22:52:44.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.869+0000 7fc29fd30640 1 -- 172.21.15.82:0/3591298093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc298068430 con 0x7fc29815f1a0 2024-06-02T22:52:44.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.869+0000 7fc2967fc640 1 -- 172.21.15.82:0/3591298093 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc29000c6d0 con 0x7fc29815f1a0 2024-06-02T22:52:44.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.870+0000 7fc2967fc640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc28406be30 0x7fc28406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:44.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.870+0000 7fc2967fc640 1 -- 172.21.15.82:0/3591298093 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6764+0+0 (secure 0 0 0) 0x7fc29008af10 con 0x7fc29815f1a0 2024-06-02T22:52:44.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.870+0000 7fc29dacc640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc28406be30 0x7fc28406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:44.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.870+0000 7fc29dacc640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc28406be30 0x7fc28406e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc2980cc7a0 tx=0x7fc288009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:44.874+0000 7fc2967fc640 1 -- 172.21.15.82:0/3591298093 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc290017020 con 0x7fc29815f1a0 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.061+0000 7fc29fd30640 1 -- 172.21.15.82:0/3591298093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc2980d04e0 con 0x7fc29815f1a0 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.061+0000 7fc2967fc640 1 -- 172.21.15.82:0/3591298093 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fc290059530 con 0x7fc29815f1a0 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 -- 172.21.15.82:0/3591298093 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc28406be30 msgr2=0x7fc28406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc28406be30 0x7fc28406e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc2980cc7a0 tx=0x7fc288009040 comp rx=0 tx=0).stop 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 -- 172.21.15.82:0/3591298093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc29815f1a0 msgr2=0x7fc29815d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc29815f1a0 0x7fc29815d5b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc29000e810 tx=0x7fc29000ecd0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 -- 172.21.15.82:0/3591298093 shutdown_connections 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc28406be30 0x7fc28406e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc29815f1a0 0x7fc29815d5b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2980d2680 0x7fc2980cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 --2- 172.21.15.82:0/3591298093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2980cef70 0x7fc29815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 -- 172.21.15.82:0/3591298093 >> 172.21.15.82:0/3591298093 conn(0x7fc29809d3f0 msgr2=0x7fc2980ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 -- 172.21.15.82:0/3591298093 shutdown_connections 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.063+0000 7fc29fd30640 1 -- 172.21.15.82:0/3591298093 wait complete. 2024-06-02T22:52:45.074 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:52:45.074 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:52:45.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.193+0000 7fb81821c640 1 Processor -- start 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.193+0000 7fb81821c640 1 -- start start 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.194+0000 7fb81821c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8100cd230 0x7fb8100b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.194+0000 7fb81821c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb8100cec50 0x7fb8100cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.194+0000 7fb81821c640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8100b3420 con 0x7fb8101553c0 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.194+0000 7fb81821c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb8100cc750 con 0x7fb8100cd230 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.194+0000 7fb81821c640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fb8100cca30 con 0x7fb8100cec50 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.194+0000 7fb8157b7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8100cd230 0x7fb8100b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.194+0000 7fb8157b7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8100cd230 0x7fb8100b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37754/0 (socket says 172.21.15.82:37754) 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.194+0000 7fb8157b7640 1 -- 172.21.15.82:0/3212928322 learned_addr learned my addr 172.21.15.82:0/3212928322 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.195+0000 7fb8157b7640 1 -- 172.21.15.82:0/3212928322 >> v2:172.21.15.184:3300/0 conn(0x7fb8100cec50 msgr2=0x7fb8100cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.195+0000 7fb8157b7640 1 --2- 172.21.15.82:0/3212928322 >> v2:172.21.15.184:3300/0 conn(0x7fb8100cec50 0x7fb8100cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.195+0000 7fb8157b7640 1 -- 172.21.15.82:0/3212928322 >> v1:172.21.15.184:6789/0 conn(0x7fb8101553c0 legacy=0x7fb81015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.195+0000 7fb8157b7640 1 -- 172.21.15.82:0/3212928322 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8100ccd10 con 0x7fb8100cd230 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.195+0000 7fb8157b7640 1 --2- 172.21.15.82:0/3212928322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8100cd230 0x7fb8100b2cf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb8100b41f0 tx=0x7fb80002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e0624bc729a2fc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.195+0000 7fb814fb6640 1 -- 172.21.15.82:0/3212928322 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800037070 con 0x7fb8100cd230 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.196+0000 7fb814fb6640 1 -- 172.21.15.82:0/3212928322 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb800032440 con 0x7fb8100cd230 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.196+0000 7fb814fb6640 1 -- 172.21.15.82:0/3212928322 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800032810 con 0x7fb8100cd230 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.196+0000 7fb81821c640 1 -- 172.21.15.82:0/3212928322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8100cd230 msgr2=0x7fb8100b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.196+0000 7fb81821c640 1 --2- 172.21.15.82:0/3212928322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8100cd230 0x7fb8100b2cf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb8100b41f0 tx=0x7fb80002a230 comp rx=0 tx=0).stop 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.196+0000 7fb81821c640 1 -- 172.21.15.82:0/3212928322 shutdown_connections 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.196+0000 7fb81821c640 1 --2- 172.21.15.82:0/3212928322 >> v2:172.21.15.184:3300/0 conn(0x7fb8100cec50 0x7fb8100cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.196+0000 7fb81821c640 1 --2- 172.21.15.82:0/3212928322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8100cd230 0x7fb8100b2cf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.196+0000 7fb81821c640 1 -- 172.21.15.82:0/3212928322 >> 172.21.15.82:0/3212928322 conn(0x7fb8100b19f0 msgr2=0x7fb8100b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.196+0000 7fb81821c640 1 -- 172.21.15.82:0/3212928322 shutdown_connections 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.196+0000 7fb81821c640 1 -- 172.21.15.82:0/3212928322 wait complete. 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.197+0000 7fb81821c640 1 Processor -- start 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.197+0000 7fb81821c640 1 -- start start 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb81821c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8100cd230 0x7fb81015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb81821c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8100cec50 0x7fb8101516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb81821c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8101553c0 0x7fb81006e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb81821c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb810155920 con 0x7fb8101553c0 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb81821c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb8101557a0 con 0x7fb8100cec50 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb81821c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb810071030 con 0x7fb8100cd230 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb8167b9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8101553c0 0x7fb81006e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb8167b9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8101553c0 0x7fb81006e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37764/0 (socket says 172.21.15.82:37764) 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb8167b9640 1 -- 172.21.15.82:0/3008035185 learned_addr learned my addr 172.21.15.82:0/3008035185 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb815fb8640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8100cd230 0x7fb81015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb8157b7640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8100cec50 0x7fb8101516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb8167b9640 1 -- 172.21.15.82:0/3008035185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8100cd230 msgr2=0x7fb81015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb8167b9640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8100cd230 0x7fb81015beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb8167b9640 1 -- 172.21.15.82:0/3008035185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8100cec50 msgr2=0x7fb8101516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb8167b9640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8100cec50 0x7fb8101516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb8167b9640 1 -- 172.21.15.82:0/3008035185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81015c6e0 con 0x7fb8101553c0 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb815fb8640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8100cd230 0x7fb81015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.198+0000 7fb8157b7640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8100cec50 0x7fb8101516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.199+0000 7fb8167b9640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8101553c0 0x7fb81006e060 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb80800b9a0 tx=0x7fb80800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.199+0000 7fb8067fc640 1 -- 172.21.15.82:0/3008035185 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808019070 con 0x7fb8101553c0 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.199+0000 7fb8067fc640 1 -- 172.21.15.82:0/3008035185 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80800cbc0 con 0x7fb8101553c0 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.199+0000 7fb8067fc640 1 -- 172.21.15.82:0/3008035185 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808014440 con 0x7fb8101553c0 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.199+0000 7fb81821c640 1 -- 172.21.15.82:0/3008035185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81015c9c0 con 0x7fb8101553c0 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.199+0000 7fb81821c640 1 -- 172.21.15.82:0/3008035185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81015cf80 con 0x7fb8101553c0 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.200+0000 7fb81821c640 1 -- 172.21.15.82:0/3008035185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb810068430 con 0x7fb8101553c0 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.200+0000 7fb8067fc640 1 -- 172.21.15.82:0/3008035185 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb80801c070 con 0x7fb8101553c0 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.201+0000 7fb8067fc640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb7f406be30 0x7fb7f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.201+0000 7fb815fb8640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb7f406be30 0x7fb7f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.201+0000 7fb8067fc640 1 -- 172.21.15.82:0/3008035185 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6764+0+0 (secure 0 0 0) 0x7fb80808afd0 con 0x7fb8101553c0 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.201+0000 7fb815fb8640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb7f406be30 0x7fb7f406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00a810 tx=0x7fb80c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.205+0000 7fb8067fc640 1 -- 172.21.15.82:0/3008035185 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb808059560 con 0x7fb8101553c0 2024-06-02T22:52:45.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.391+0000 7fb81821c640 1 -- 172.21.15.82:0/3008035185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb810068ad0 con 0x7fb8101553c0 2024-06-02T22:52:45.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.391+0000 7fb8067fc640 1 -- 172.21.15.82:0/3008035185 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fb808058e60 con 0x7fb8101553c0 2024-06-02T22:52:45.391 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:52:45.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 -- 172.21.15.82:0/3008035185 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb7f406be30 msgr2=0x7fb7f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb7f406be30 0x7fb7f406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00a810 tx=0x7fb80c008040 comp rx=0 tx=0).stop 2024-06-02T22:52:45.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 -- 172.21.15.82:0/3008035185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8101553c0 msgr2=0x7fb81006e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8101553c0 0x7fb81006e060 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb80800b9a0 tx=0x7fb80800be60 comp rx=0 tx=0).stop 2024-06-02T22:52:45.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 -- 172.21.15.82:0/3008035185 shutdown_connections 2024-06-02T22:52:45.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb7f406be30 0x7fb7f406e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8101553c0 0x7fb81006e060 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8100cec50 0x7fb8101516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 --2- 172.21.15.82:0/3008035185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8100cd230 0x7fb81015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 -- 172.21.15.82:0/3008035185 >> 172.21.15.82:0/3008035185 conn(0x7fb8100b19f0 msgr2=0x7fb8100ad430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:45.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 -- 172.21.15.82:0/3008035185 shutdown_connections 2024-06-02T22:52:45.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.393+0000 7fb81821c640 1 -- 172.21.15.82:0/3008035185 wait complete. 2024-06-02T22:52:45.404 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2024-06-02T22:52:45.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:45.404 DEBUG:teuthology.orchestra.run.smithi184:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-06-02T22:52:45.433 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:52:45.433 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:52:45.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:52:45.434 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-02T22:52:45.492 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-02T22:52:45.492 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:52:45.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.591+0000 7f6c04615640 1 Processor -- start 2024-06-02T22:52:45.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.591+0000 7f6c04615640 1 -- start start 2024-06-02T22:52:45.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.592+0000 7f6c04615640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bfc0cc6d0 0x7f6bfc0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.592+0000 7f6c04615640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bfc0ccff0 con 0x7f6bfc0720e0 2024-06-02T22:52:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.592+0000 7f6c04615640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bfc072550 con 0x7f6bfc071c60 2024-06-02T22:52:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.592+0000 7f6c04615640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6bfc072820 con 0x7f6bfc0cc6d0 2024-06-02T22:52:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.592+0000 7f6c02bb2640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6bfc0720e0 0x7f6bfc0b3dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53568/0 (socket says 172.21.15.82:53568) 2024-06-02T22:52:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.592+0000 7f6c02bb2640 1 -- 172.21.15.82:0/1566700921 learned_addr learned my addr 172.21.15.82:0/1566700921 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c023b1640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bfc0cc6d0 0x7f6bfc0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2602269351 0 0) 0x7f6bfc0ccff0 con 0x7f6bfc0720e0 2024-06-02T22:52:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6be8003520 con 0x7f6bfc0720e0 2024-06-02T22:52:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3151509766 0 0) 0x7f6be8003520 con 0x7f6bfc0720e0 2024-06-02T22:52:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bfc0cc6d0 msgr2=0x7f6bfc0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bfc0cc6d0 0x7f6bfc0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 >> v1:172.21.15.184:6789/0 conn(0x7f6bfc071c60 legacy=0x7f6bfc0b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bfc072b00 con 0x7f6bfc0720e0 2024-06-02T22:52:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f6bf40019f0 con 0x7f6bfc0720e0 2024-06-02T22:52:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 >> v1:172.21.15.82:6789/0 conn(0x7f6bfc0720e0 legacy=0x7f6bfc0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be80039e0 0x7f6be8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be8004800 0x7f6be8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bfc0cc6d0 0x7f6be80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc072820 con 0x7f6be8004800 2024-06-02T22:52:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6be800ba70 con 0x7f6be80039e0 2024-06-02T22:52:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6be800bc70 con 0x7f6bfc0cc6d0 2024-06-02T22:52:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c01bb0640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be8004800 0x7f6be8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c023b1640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be80039e0 0x7f6be8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c02bb2640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bfc0cc6d0 0x7f6be80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c01bb0640 1 -- 172.21.15.82:0/1566700921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bfc0cc6d0 msgr2=0x7f6be80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c01bb0640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6bfc0cc6d0 0x7f6be80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c01bb0640 1 -- 172.21.15.82:0/1566700921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be80039e0 msgr2=0x7f6be8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c01bb0640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be80039e0 0x7f6be8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.593+0000 7f6c01bb0640 1 -- 172.21.15.82:0/1566700921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be8003520 con 0x7f6be8004800 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.594+0000 7f6c01bb0640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be8004800 0x7f6be8004c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6bec001720 tx=0x7f6be8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaacd09744b44ce8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.594+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec001370 con 0x7f6be8004800 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.594+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bec0052d0 con 0x7f6be8004800 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.594+0000 7f6c013af640 1 -- 172.21.15.82:0/1566700921 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec02ab90 con 0x7f6be8004800 2024-06-02T22:52:45.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.595+0000 7f6c04615640 1 -- 172.21.15.82:0/1566700921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be8004800 msgr2=0x7f6be8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.595+0000 7f6c04615640 1 --2- 172.21.15.82:0/1566700921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be8004800 0x7f6be8004c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6bec001720 tx=0x7f6be8005830 comp rx=0 tx=0).stop 2024-06-02T22:52:45.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.595+0000 7f6c02bb2640 1 -- 172.21.15.82:0/1566700921 reap_dead start 2024-06-02T22:52:45.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.595+0000 7f6c04615640 1 -- 172.21.15.82:0/1566700921 shutdown_connections 2024-06-02T22:52:45.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.595+0000 7f6c04615640 1 -- 172.21.15.82:0/1566700921 >> 172.21.15.82:0/1566700921 conn(0x7f6bfc0b19f0 msgr2=0x7f6bfc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:45.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.595+0000 7f6c04615640 1 -- 172.21.15.82:0/1566700921 shutdown_connections 2024-06-02T22:52:45.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.595+0000 7f6c04615640 1 -- 172.21.15.82:0/1566700921 wait complete. 2024-06-02T22:52:45.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.596+0000 7f6c04615640 1 Processor -- start 2024-06-02T22:52:45.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.596+0000 7f6c04615640 1 -- start start 2024-06-02T22:52:45.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c04615640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be8004800 0x7f6bfc1486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c04615640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc09bea0 0x7f6bfc09c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c04615640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6bfc1f1d50 0x7f6bfc1f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c04615640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc15c890 con 0x7f6bfc09bea0 2024-06-02T22:52:45.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c04615640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc0b31a0 con 0x7f6bfc1f1d50 2024-06-02T22:52:45.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c04615640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6bfc159f60 con 0x7f6be8004800 2024-06-02T22:52:45.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c01bb0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc09bea0 0x7f6bfc09c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c01bb0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc09bea0 0x7f6bfc09c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37792/0 (socket says 172.21.15.82:37792) 2024-06-02T22:52:45.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c01bb0640 1 -- 172.21.15.82:0/4141732180 learned_addr learned my addr 172.21.15.82:0/4141732180 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:45.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c023b1640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be8004800 0x7f6bfc1486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c02bb2640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6bfc1f1d50 0x7f6bfc1f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c01bb0640 1 -- 172.21.15.82:0/4141732180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be8004800 msgr2=0x7f6bfc1486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c01bb0640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be8004800 0x7f6bfc1486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c01bb0640 1 -- 172.21.15.82:0/4141732180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6bfc1f1d50 msgr2=0x7f6bfc1f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c01bb0640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6bfc1f1d50 0x7f6bfc1f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c01bb0640 1 -- 172.21.15.82:0/4141732180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bfc148c20 con 0x7f6bfc09bea0 2024-06-02T22:52:45.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c01bb0640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc09bea0 0x7f6bfc09c320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6bec008fd0 tx=0x7f6bec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:45.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/4141732180 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec040020 con 0x7f6bfc09bea0 2024-06-02T22:52:45.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/4141732180 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bec007680 con 0x7f6bfc09bea0 2024-06-02T22:52:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c04615640 1 -- 172.21.15.82:0/4141732180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bfc1f2a20 con 0x7f6bfc09bea0 2024-06-02T22:52:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/4141732180 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec007a30 con 0x7f6bfc09bea0 2024-06-02T22:52:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.597+0000 7f6c04615640 1 -- 172.21.15.82:0/4141732180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bfc1f3000 con 0x7f6bfc09bea0 2024-06-02T22:52:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.598+0000 7f6c04615640 1 -- 172.21.15.82:0/4141732180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bfc068430 con 0x7f6bfc09bea0 2024-06-02T22:52:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.599+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/4141732180 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bec043020 con 0x7f6bfc09bea0 2024-06-02T22:52:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.599+0000 7f6bf2ffd640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6be006be30 0x7f6be006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.600+0000 7f6c023b1640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6be006be30 0x7f6be006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.600+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/4141732180 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6764+0+0 (secure 0 0 0) 0x7f6bec0ab070 con 0x7f6bfc09bea0 2024-06-02T22:52:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.600+0000 7f6c023b1640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6be006be30 0x7f6be006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0ad730 tx=0x7f6bf8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.604+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/4141732180 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6bec04a030 con 0x7f6bfc09bea0 2024-06-02T22:52:45.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.820+0000 7f6c04615640 1 -- 172.21.15.82:0/4141732180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bfc1f2740 con 0x7f6bfc09bea0 2024-06-02T22:52:45.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.821+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/4141732180 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f6bfc148c20 con 0x7f6bfc09bea0 2024-06-02T22:52:45.821 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:45.821 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/598338197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":598338197},{"type":"v1","addr":"172.21.15.184:6835","nonce":598338197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2379089503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2379089503},{"type":"v1","addr":"172.21.15.82:6836","nonce":2379089503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:02.905481+0000","modified":"2024-06-02T22:52:21.989508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1449064574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1449064574},{"type":"v1","addr":"172.21.15.82:6837","nonce":1449064574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-06-02T22:52:45.821 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-06-02T22:52:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 -- 172.21.15.82:0/4141732180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6be006be30 msgr2=0x7f6be006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6be006be30 0x7f6be006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0ad730 tx=0x7f6bf8009190 comp rx=0 tx=0).stop 2024-06-02T22:52:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 -- 172.21.15.82:0/4141732180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc09bea0 msgr2=0x7f6bfc09c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc09bea0 0x7f6bfc09c320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6bec008fd0 tx=0x7f6bec001120 comp rx=0 tx=0).stop 2024-06-02T22:52:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 -- 172.21.15.82:0/4141732180 shutdown_connections 2024-06-02T22:52:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6be006be30 0x7f6be006e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6bfc1f1d50 0x7f6bfc1f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc09bea0 0x7f6bfc09c320 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 --2- 172.21.15.82:0/4141732180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be8004800 0x7f6bfc1486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 -- 172.21.15.82:0/4141732180 >> 172.21.15.82:0/4141732180 conn(0x7f6bfc0b19f0 msgr2=0x7f6bfc0b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 -- 172.21.15.82:0/4141732180 shutdown_connections 2024-06-02T22:52:45.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.823+0000 7f6c04615640 1 -- 172.21.15.82:0/4141732180 wait complete. 2024-06-02T22:52:45.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:52:45.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.933+0000 7fe60c71b640 1 Processor -- start 2024-06-02T22:52:45.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.933+0000 7fe60c71b640 1 -- start start 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.934+0000 7fe60c71b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe60415f1a0 0x7fe6040d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.934+0000 7fe60c71b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6040cef70 0x7fe6040cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.934+0000 7fe60c71b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe60415f5e0 con 0x7fe6040d2680 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.934+0000 7fe60c71b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe6040d13e0 con 0x7fe6040cef70 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.934+0000 7fe60c71b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe6040d0ad0 con 0x7fe60415f1a0 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.934+0000 7fe60acb8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6040cef70 0x7fe6040cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.935+0000 7fe60acb8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6040cef70 0x7fe6040cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37804/0 (socket says 172.21.15.82:37804) 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.935+0000 7fe60acb8640 1 -- 172.21.15.82:0/1407492861 learned_addr learned my addr 172.21.15.82:0/1407492861 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.935+0000 7fe609cb6640 1 --2- 172.21.15.82:0/1407492861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe60415f1a0 0x7fe6040d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.935+0000 7fe60acb8640 1 -- 172.21.15.82:0/1407492861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe60415f1a0 msgr2=0x7fe6040d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.935+0000 7fe60acb8640 1 --2- 172.21.15.82:0/1407492861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe60415f1a0 0x7fe6040d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.935+0000 7fe60acb8640 1 -- 172.21.15.82:0/1407492861 >> v1:172.21.15.184:6789/0 conn(0x7fe6040d2680 legacy=0x7fe6040d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:45.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.935+0000 7fe60acb8640 1 -- 172.21.15.82:0/1407492861 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60415f890 con 0x7fe6040cef70 2024-06-02T22:52:45.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.935+0000 7fe609cb6640 1 --2- 172.21.15.82:0/1407492861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe60415f1a0 0x7fe6040d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:45.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe60acb8640 1 --2- 172.21.15.82:0/1407492861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6040cef70 0x7fe6040cf400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009870 tx=0x7fe5fc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7378e0e93c0a3eb0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:45.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe6094b5640 1 -- 172.21.15.82:0/1407492861 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc037070 con 0x7fe6040cef70 2024-06-02T22:52:45.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe6094b5640 1 -- 172.21.15.82:0/1407492861 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5fc032440 con 0x7fe6040cef70 2024-06-02T22:52:45.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe6094b5640 1 -- 172.21.15.82:0/1407492861 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc032810 con 0x7fe6040cef70 2024-06-02T22:52:45.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe60c71b640 1 -- 172.21.15.82:0/1407492861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6040cef70 msgr2=0x7fe6040cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe60c71b640 1 --2- 172.21.15.82:0/1407492861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6040cef70 0x7fe6040cf400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009870 tx=0x7fe5fc02a210 comp rx=0 tx=0).stop 2024-06-02T22:52:45.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe60c71b640 1 -- 172.21.15.82:0/1407492861 shutdown_connections 2024-06-02T22:52:45.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe60c71b640 1 --2- 172.21.15.82:0/1407492861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6040cef70 0x7fe6040cf400 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe60c71b640 1 --2- 172.21.15.82:0/1407492861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe60415f1a0 0x7fe6040d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe60c71b640 1 -- 172.21.15.82:0/1407492861 >> 172.21.15.82:0/1407492861 conn(0x7fe60409d3f0 msgr2=0x7fe6040d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:45.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe60c71b640 1 -- 172.21.15.82:0/1407492861 shutdown_connections 2024-06-02T22:52:45.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.936+0000 7fe60c71b640 1 -- 172.21.15.82:0/1407492861 wait complete. 2024-06-02T22:52:45.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.937+0000 7fe60c71b640 1 Processor -- start 2024-06-02T22:52:45.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.938+0000 7fe60c71b640 1 -- start start 2024-06-02T22:52:45.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.938+0000 7fe60c71b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6040cef70 0x7fe6040b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.938+0000 7fe60c71b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6040d2680 0x7fe6040c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.938+0000 7fe60c71b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe60415f1a0 0x7fe6040ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.938+0000 7fe60c71b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040d4f00 con 0x7fe6040d2680 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.938+0000 7fe60c71b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040d1070 con 0x7fe6040cef70 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.938+0000 7fe60c71b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe6040d1870 con 0x7fe60415f1a0 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.938+0000 7fe609cb6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6040d2680 0x7fe6040c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.938+0000 7fe609cb6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6040d2680 0x7fe6040c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37818/0 (socket says 172.21.15.82:37818) 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.938+0000 7fe609cb6640 1 -- 172.21.15.82:0/2602542903 learned_addr learned my addr 172.21.15.82:0/2602542903 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.939+0000 7fe609cb6640 1 -- 172.21.15.82:0/2602542903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe60415f1a0 msgr2=0x7fe6040ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.939+0000 7fe609cb6640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe60415f1a0 0x7fe6040ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.939+0000 7fe609cb6640 1 -- 172.21.15.82:0/2602542903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6040cef70 msgr2=0x7fe6040b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.939+0000 7fe609cb6640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6040cef70 0x7fe6040b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.939+0000 7fe609cb6640 1 -- 172.21.15.82:0/2602542903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6040ca810 con 0x7fe6040d2680 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.939+0000 7fe609cb6640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6040d2680 0x7fe6040c9c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c820 tx=0x7fe5f800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:45.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.939+0000 7fe602ffd640 1 -- 172.21.15.82:0/2602542903 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8015070 con 0x7fe6040d2680 2024-06-02T22:52:45.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.939+0000 7fe602ffd640 1 -- 172.21.15.82:0/2602542903 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f8007a30 con 0x7fe6040d2680 2024-06-02T22:52:45.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.939+0000 7fe60c71b640 1 -- 172.21.15.82:0/2602542903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6041f4920 con 0x7fe6040d2680 2024-06-02T22:52:45.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.939+0000 7fe602ffd640 1 -- 172.21.15.82:0/2602542903 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8007de0 con 0x7fe6040d2680 2024-06-02T22:52:45.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.939+0000 7fe60c71b640 1 -- 172.21.15.82:0/2602542903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe604156590 con 0x7fe6040d2680 2024-06-02T22:52:45.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.940+0000 7fe60c71b640 1 -- 172.21.15.82:0/2602542903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe604073620 con 0x7fe6040d2680 2024-06-02T22:52:45.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.940+0000 7fe602ffd640 1 -- 172.21.15.82:0/2602542903 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5f8018070 con 0x7fe6040d2680 2024-06-02T22:52:45.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.941+0000 7fe602ffd640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe5f006be60 0x7fe5f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:45.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.941+0000 7fe602ffd640 1 -- 172.21.15.82:0/2602542903 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe5f808b130 con 0x7fe6040d2680 2024-06-02T22:52:45.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.941+0000 7fe60a4b7640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe5f006be60 0x7fe5f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:45.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.941+0000 7fe60a4b7640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe5f006be60 0x7fe5f006e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6040b3200 tx=0x7fe5f4007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:45.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:45.945+0000 7fe602ffd640 1 -- 172.21.15.82:0/2602542903 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe604073620 con 0x7fe6040d2680 2024-06-02T22:52:46.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.156+0000 7fe60c71b640 1 -- 172.21.15.82:0/2602542903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6041f4730 con 0x7fe6040d2680 2024-06-02T22:52:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.157+0000 7fe602ffd640 1 -- 172.21.15.82:0/2602542903 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7fe5f80596c0 con 0x7fe6040d2680 2024-06-02T22:52:46.157 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:46.157 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/598338197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":598338197},{"type":"v1","addr":"172.21.15.184:6835","nonce":598338197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2379089503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2379089503},{"type":"v1","addr":"172.21.15.82:6836","nonce":2379089503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:02.905481+0000","modified":"2024-06-02T22:52:21.989508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1449064574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1449064574},{"type":"v1","addr":"172.21.15.82:6837","nonce":1449064574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-06-02T22:52:46.158 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 -- 172.21.15.82:0/2602542903 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe5f006be60 msgr2=0x7fe5f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe5f006be60 0x7fe5f006e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6040b3200 tx=0x7fe5f4007d30 comp rx=0 tx=0).stop 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 -- 172.21.15.82:0/2602542903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6040d2680 msgr2=0x7fe6040c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6040d2680 0x7fe6040c9c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c820 tx=0x7fe5f800cce0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 -- 172.21.15.82:0/2602542903 shutdown_connections 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe5f006be60 0x7fe5f006e320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe60415f1a0 0x7fe6040ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6040d2680 0x7fe6040c9c50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 --2- 172.21.15.82:0/2602542903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6040cef70 0x7fe6040b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 -- 172.21.15.82:0/2602542903 >> 172.21.15.82:0/2602542903 conn(0x7fe60409d3f0 msgr2=0x7fe6040cfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 -- 172.21.15.82:0/2602542903 shutdown_connections 2024-06-02T22:52:46.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.159+0000 7fe60c71b640 1 -- 172.21.15.82:0/2602542903 wait complete. 2024-06-02T22:52:46.170 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.270+0000 7fccbd631640 1 Processor -- start 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.270+0000 7fccbd631640 1 -- start start 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.271+0000 7fccbd631640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb815e1f0 0x7fccb80b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.271+0000 7fccbd631640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fccb809aa10 0x7fccb809aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.271+0000 7fccbd631640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb80b5800 con 0x7fccb80b1d20 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.271+0000 7fccbd631640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fccb815e5d0 con 0x7fccb815e1f0 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.271+0000 7fccbd631640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fccb80b5ae0 con 0x7fccb809aa10 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.271+0000 7fccb6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb815e1f0 0x7fccb80b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.271+0000 7fccb6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fccb815e1f0 0x7fccb80b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37832/0 (socket says 172.21.15.82:37832) 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.271+0000 7fccb6ffd640 1 -- 172.21.15.82:0/4152365194 learned_addr learned my addr 172.21.15.82:0/4152365194 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.272+0000 7fccb6ffd640 1 -- 172.21.15.82:0/4152365194 >> v2:172.21.15.184:3300/0 conn(0x7fccb809aa10 msgr2=0x7fccb809aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.272+0000 7fccb6ffd640 1 --2- 172.21.15.82:0/4152365194 >> v2:172.21.15.184:3300/0 conn(0x7fccb809aa10 0x7fccb809aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.272+0000 7fccb6ffd640 1 -- 172.21.15.82:0/4152365194 >> v1:172.21.15.184:6789/0 conn(0x7fccb80b1d20 legacy=0x7fccb80b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.272+0000 7fccb6ffd640 1 -- 172.21.15.82:0/4152365194 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb80b5dc0 con 0x7fccb815e1f0 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.272+0000 7fccb6ffd640 1 --2- 172.21.15.82:0/4152365194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb815e1f0 0x7fccb80b65c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009e50 tx=0x7fcca802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab0b8b325999b6b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.272+0000 7fccb5ffb640 1 -- 172.21.15.82:0/4152365194 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8036070 con 0x7fccb815e1f0 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.272+0000 7fccb5ffb640 1 -- 172.21.15.82:0/4152365194 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca8031600 con 0x7fccb815e1f0 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.272+0000 7fccb5ffb640 1 -- 172.21.15.82:0/4152365194 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca80319d0 con 0x7fccb815e1f0 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.273+0000 7fccbd631640 1 -- 172.21.15.82:0/4152365194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb815e1f0 msgr2=0x7fccb80b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.273+0000 7fccbd631640 1 --2- 172.21.15.82:0/4152365194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb815e1f0 0x7fccb80b65c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009e50 tx=0x7fcca802a710 comp rx=0 tx=0).stop 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.273+0000 7fccbd631640 1 -- 172.21.15.82:0/4152365194 shutdown_connections 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.273+0000 7fccbd631640 1 --2- 172.21.15.82:0/4152365194 >> v2:172.21.15.184:3300/0 conn(0x7fccb809aa10 0x7fccb809aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.273+0000 7fccbd631640 1 --2- 172.21.15.82:0/4152365194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb815e1f0 0x7fccb80b65c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.273+0000 7fccbd631640 1 -- 172.21.15.82:0/4152365194 >> 172.21.15.82:0/4152365194 conn(0x7fccb80b7270 msgr2=0x7fccb80b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.273+0000 7fccbd631640 1 -- 172.21.15.82:0/4152365194 shutdown_connections 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.273+0000 7fccbd631640 1 -- 172.21.15.82:0/4152365194 wait complete. 2024-06-02T22:52:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.274+0000 7fccbd631640 1 Processor -- start 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.274+0000 7fccbd631640 1 -- start start 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.275+0000 7fccbd631640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb809aa10 0x7fccb81ea530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.275+0000 7fccbd631640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccb80b1d20 0x7fccb8152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.275+0000 7fccbd631640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb815e1f0 0x7fccb80cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.275+0000 7fccbd631640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80b6b00 con 0x7fccb815e1f0 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.275+0000 7fccbd631640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80d2b80 con 0x7fccb809aa10 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.275+0000 7fccbd631640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fccb80b6c80 con 0x7fccb80b1d20 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.275+0000 7fccb77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb815e1f0 0x7fccb80cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.275+0000 7fccb77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb815e1f0 0x7fccb80cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37848/0 (socket says 172.21.15.82:37848) 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.275+0000 7fccb77fe640 1 -- 172.21.15.82:0/389567225 learned_addr learned my addr 172.21.15.82:0/389567225 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.275+0000 7fccb77fe640 1 -- 172.21.15.82:0/389567225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccb80b1d20 msgr2=0x7fccb8152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.275+0000 7fccb77fe640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccb80b1d20 0x7fccb8152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.276+0000 7fccb77fe640 1 -- 172.21.15.82:0/389567225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb809aa10 msgr2=0x7fccb81ea530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.276+0000 7fccb77fe640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb809aa10 0x7fccb81ea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.276+0000 7fccb77fe640 1 -- 172.21.15.82:0/389567225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb80d0e10 con 0x7fccb815e1f0 2024-06-02T22:52:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.276+0000 7fccb77fe640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb815e1f0 0x7fccb80cd9b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c390 tx=0x7fccb000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.276+0000 7fcc9f7fe640 1 -- 172.21.15.82:0/389567225 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0017070 con 0x7fccb815e1f0 2024-06-02T22:52:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.276+0000 7fcc9f7fe640 1 -- 172.21.15.82:0/389567225 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb00035f0 con 0x7fccb815e1f0 2024-06-02T22:52:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.276+0000 7fccbd631640 1 -- 172.21.15.82:0/389567225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb80cdef0 con 0x7fccb815e1f0 2024-06-02T22:52:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.276+0000 7fcc9f7fe640 1 -- 172.21.15.82:0/389567225 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb00039e0 con 0x7fccb815e1f0 2024-06-02T22:52:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.276+0000 7fccbd631640 1 -- 172.21.15.82:0/389567225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb80d0b30 con 0x7fccb815e1f0 2024-06-02T22:52:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.277+0000 7fccbd631640 1 -- 172.21.15.82:0/389567225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb8068ad0 con 0x7fccb815e1f0 2024-06-02T22:52:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.277+0000 7fcc9f7fe640 1 -- 172.21.15.82:0/389567225 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccb0003b80 con 0x7fccb815e1f0 2024-06-02T22:52:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.278+0000 7fcc9f7fe640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcca406be30 0x7fcca406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.278+0000 7fccb6ffd640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcca406be30 0x7fcca406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.278+0000 7fcc9f7fe640 1 -- 172.21.15.82:0/389567225 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fccb008a4f0 con 0x7fccb815e1f0 2024-06-02T22:52:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.278+0000 7fccb6ffd640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcca406be30 0x7fcca406e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcca8033000 tx=0x7fcca802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.282+0000 7fcc9f7fe640 1 -- 172.21.15.82:0/389567225 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fccb0058a00 con 0x7fccb815e1f0 2024-06-02T22:52:46.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.459+0000 7fccbd631640 1 -- 172.21.15.82:0/389567225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccb80b1b00 con 0x7fccb815e1f0 2024-06-02T22:52:46.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.460+0000 7fcc9f7fe640 1 -- 172.21.15.82:0/389567225 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18890 (secure 0 0 0) 0x7fccb0058300 con 0x7fccb815e1f0 2024-06-02T22:52:46.460 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:46.460 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:45.711589+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 -- 172.21.15.82:0/389567225 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcca406be30 msgr2=0x7fcca406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcca406be30 0x7fcca406e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcca8033000 tx=0x7fcca802e000 comp rx=0 tx=0).stop 2024-06-02T22:52:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 -- 172.21.15.82:0/389567225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb815e1f0 msgr2=0x7fccb80cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb815e1f0 0x7fccb80cd9b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c390 tx=0x7fccb000c850 comp rx=0 tx=0).stop 2024-06-02T22:52:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 -- 172.21.15.82:0/389567225 shutdown_connections 2024-06-02T22:52:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcca406be30 0x7fcca406e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fccb815e1f0 0x7fccb80cd9b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccb80b1d20 0x7fccb8152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 --2- 172.21.15.82:0/389567225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb809aa10 0x7fccb81ea530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 -- 172.21.15.82:0/389567225 >> 172.21.15.82:0/389567225 conn(0x7fccb80b7270 msgr2=0x7fccb80b7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 -- 172.21.15.82:0/389567225 shutdown_connections 2024-06-02T22:52:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.462+0000 7fccbd631640 1 -- 172.21.15.82:0/389567225 wait complete. 2024-06-02T22:52:46.473 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T22:52:46.473 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:52:46.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.574+0000 7f38e9872640 1 Processor -- start 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.574+0000 7f38e9872640 1 -- start start 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.574+0000 7f38e9872640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38e41618e0 0x7f38e40cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.574+0000 7f38e9872640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f38e40d2c20 0x7f38e40b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.574+0000 7f38e9872640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e40d03e0 con 0x7f38e4161cc0 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.574+0000 7f38e9872640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f38e40b4130 con 0x7f38e40d2c20 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.574+0000 7f38e9872640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f38e40d0100 con 0x7f38e41618e0 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.575+0000 7f38e37fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f38e40d2c20 0x7f38e40b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.575+0000 7f38e37fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f38e40d2c20 0x7f38e40b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37856/0 (socket says 172.21.15.82:37856) 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.575+0000 7f38e37fe640 1 -- 172.21.15.82:0/3338454132 learned_addr learned my addr 172.21.15.82:0/3338454132 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.575+0000 7f38e2ffd640 1 --2- 172.21.15.82:0/3338454132 >> v2:172.21.15.184:3300/0 conn(0x7f38e41618e0 0x7f38e40cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.575+0000 7f38e37fe640 1 -- 172.21.15.82:0/3338454132 >> v2:172.21.15.184:3300/0 conn(0x7f38e41618e0 msgr2=0x7f38e40cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:46.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.575+0000 7f38e37fe640 1 --2- 172.21.15.82:0/3338454132 >> v2:172.21.15.184:3300/0 conn(0x7f38e41618e0 0x7f38e40cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.575+0000 7f38e37fe640 1 -- 172.21.15.82:0/3338454132 >> v1:172.21.15.184:6789/0 conn(0x7f38e4161cc0 legacy=0x7f38e40d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.575+0000 7f38e37fe640 1 -- 172.21.15.82:0/3338454132 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e40b3ae0 con 0x7f38e40d2c20 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e37fe640 1 --2- 172.21.15.82:0/3338454132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38e40d2c20 0x7f38e40b45c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f38e408ca20 tx=0x7f38dc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20796731831be2b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e1ffb640 1 -- 172.21.15.82:0/3338454132 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc036070 con 0x7f38e40d2c20 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e1ffb640 1 -- 172.21.15.82:0/3338454132 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38dc031600 con 0x7f38e40d2c20 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e1ffb640 1 -- 172.21.15.82:0/3338454132 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc0319d0 con 0x7f38e40d2c20 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e9872640 1 -- 172.21.15.82:0/3338454132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38e40d2c20 msgr2=0x7f38e40b45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e9872640 1 --2- 172.21.15.82:0/3338454132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38e40d2c20 0x7f38e40b45c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f38e408ca20 tx=0x7f38dc02a6f0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e9872640 1 -- 172.21.15.82:0/3338454132 shutdown_connections 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e9872640 1 --2- 172.21.15.82:0/3338454132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38e40d2c20 0x7f38e40b45c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e9872640 1 --2- 172.21.15.82:0/3338454132 >> v2:172.21.15.184:3300/0 conn(0x7f38e41618e0 0x7f38e40cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e9872640 1 -- 172.21.15.82:0/3338454132 >> 172.21.15.82:0/3338454132 conn(0x7f38e409d410 msgr2=0x7f38e40d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:46.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e9872640 1 -- 172.21.15.82:0/3338454132 shutdown_connections 2024-06-02T22:52:46.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.576+0000 7f38e9872640 1 -- 172.21.15.82:0/3338454132 wait complete. 2024-06-02T22:52:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.577+0000 7f38e9872640 1 Processor -- start 2024-06-02T22:52:46.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.578+0000 7f38e9872640 1 -- start start 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.578+0000 7f38e9872640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38e40d2c20 0x7f38e40cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.578+0000 7f38e9872640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38e41618e0 0x7f38e4153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.578+0000 7f38e9872640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38e4161cc0 0x7f38e41541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.578+0000 7f38e9872640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38e40cfec0 con 0x7f38e4161cc0 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.578+0000 7f38e9872640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f38e40cfd40 con 0x7f38e41618e0 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.578+0000 7f38e9872640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f38e40d4cd0 con 0x7f38e40d2c20 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38e4161cc0 0x7f38e41541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38e4161cc0 0x7f38e41541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37866/0 (socket says 172.21.15.82:37866) 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e37fe640 1 -- 172.21.15.82:0/1570973292 learned_addr learned my addr 172.21.15.82:0/1570973292 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e27fc640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38e41618e0 0x7f38e4153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e2ffd640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38e40d2c20 0x7f38e40cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e37fe640 1 -- 172.21.15.82:0/1570973292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38e40d2c20 msgr2=0x7f38e40cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e37fe640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38e40d2c20 0x7f38e40cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e37fe640 1 -- 172.21.15.82:0/1570973292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38e41618e0 msgr2=0x7f38e4153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e37fe640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38e41618e0 0x7f38e4153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e37fe640 1 -- 172.21.15.82:0/1570973292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e40ca530 con 0x7f38e4161cc0 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e27fc640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38e41618e0 0x7f38e4153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e37fe640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38e4161cc0 0x7f38e41541d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009f40 tx=0x7f38dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38cbfff640 1 -- 172.21.15.82:0/1570973292 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc036050 con 0x7f38e4161cc0 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38cbfff640 1 -- 172.21.15.82:0/1570973292 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38dc042070 con 0x7f38e4161cc0 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e9872640 1 -- 172.21.15.82:0/1570973292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e40ca810 con 0x7f38e4161cc0 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38cbfff640 1 -- 172.21.15.82:0/1570973292 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc009510 con 0x7f38e4161cc0 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.579+0000 7f38e9872640 1 -- 172.21.15.82:0/1570973292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e40cd260 con 0x7f38e4161cc0 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.580+0000 7f38e9872640 1 -- 172.21.15.82:0/1570973292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e4068430 con 0x7f38e4161cc0 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.581+0000 7f38cbfff640 1 -- 172.21.15.82:0/1570973292 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38dc007bd0 con 0x7f38e4161cc0 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.581+0000 7f38cbfff640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38d006be30 0x7f38d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.581+0000 7f38e2ffd640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38d006be30 0x7f38d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.581+0000 7f38cbfff640 1 -- 172.21.15.82:0/1570973292 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f38dc0ac0b0 con 0x7f38e4161cc0 2024-06-02T22:52:46.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.582+0000 7f38e2ffd640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38d006be30 0x7f38d006e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f38d4006fd0 tx=0x7f38d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.586+0000 7f38cbfff640 1 -- 172.21.15.82:0/1570973292 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f38dc07a6d0 con 0x7f38e4161cc0 2024-06-02T22:52:46.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.796+0000 7f38e9872640 1 -- 172.21.15.82:0/1570973292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38e415fcf0 con 0x7f38e4161cc0 2024-06-02T22:52:46.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.797+0000 7f38cbfff640 1 -- 172.21.15.82:0/1570973292 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f38dc079fd0 con 0x7f38e4161cc0 2024-06-02T22:52:46.797 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:46.797 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/598338197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":598338197},{"type":"v1","addr":"172.21.15.184:6835","nonce":598338197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2379089503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2379089503},{"type":"v1","addr":"172.21.15.82:6836","nonce":2379089503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:02.905481+0000","modified":"2024-06-02T22:52:21.989508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1449064574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1449064574},{"type":"v1","addr":"172.21.15.82:6837","nonce":1449064574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-06-02T22:52:46.797 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 -- 172.21.15.82:0/1570973292 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38d006be30 msgr2=0x7f38d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38d006be30 0x7f38d006e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f38d4006fd0 tx=0x7f38d4008040 comp rx=0 tx=0).stop 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 -- 172.21.15.82:0/1570973292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38e4161cc0 msgr2=0x7f38e41541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38e4161cc0 0x7f38e41541d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009f40 tx=0x7f38dc004a40 comp rx=0 tx=0).stop 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 -- 172.21.15.82:0/1570973292 shutdown_connections 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38d006be30 0x7f38d006e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38e4161cc0 0x7f38e41541d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38e41618e0 0x7f38e4153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 --2- 172.21.15.82:0/1570973292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38e40d2c20 0x7f38e40cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 -- 172.21.15.82:0/1570973292 >> 172.21.15.82:0/1570973292 conn(0x7f38e409d410 msgr2=0x7f38e41601c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 -- 172.21.15.82:0/1570973292 shutdown_connections 2024-06-02T22:52:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.799+0000 7f38e9872640 1 -- 172.21.15.82:0/1570973292 wait complete. 2024-06-02T22:52:46.810 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:52:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.909+0000 7fb3cac72640 1 Processor -- start 2024-06-02T22:52:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.909+0000 7fb3cac72640 1 -- start start 2024-06-02T22:52:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3cac72640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3c40cc6d0 0x7fb3c40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3cac72640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c4071c60 0x7fb3c40720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3cac72640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c40ccff0 con 0x7fb3c40b36c0 2024-06-02T22:52:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3cac72640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb3c4072820 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3cac72640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c4072b00 con 0x7fb3c4071c60 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3c8a0e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3c40cc6d0 0x7fb3c40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3c8a0e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3c40cc6d0 0x7fb3c40ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37872/0 (socket says 172.21.15.82:37872) 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3c8a0e640 1 -- 172.21.15.82:0/2105684548 learned_addr learned my addr 172.21.15.82:0/2105684548 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3c920f640 1 --1- 172.21.15.82:0/2105684548 >> v1:172.21.15.82:6789/0 conn(0x7fb3c40b36c0 0x7fb3c40b3b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53570/0 (socket says 172.21.15.82:53570) 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3c3fff640 1 --2- 172.21.15.82:0/2105684548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c4071c60 0x7fb3c40720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3c8a0e640 1 -- 172.21.15.82:0/2105684548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c4071c60 msgr2=0x7fb3c40720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3c8a0e640 1 --2- 172.21.15.82:0/2105684548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c4071c60 0x7fb3c40720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3c8a0e640 1 -- 172.21.15.82:0/2105684548 >> v1:172.21.15.82:6789/0 conn(0x7fb3c40b36c0 legacy=0x7fb3c40b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3c8a0e640 1 -- 172.21.15.82:0/2105684548 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c4072de0 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.910+0000 7fb3c3fff640 1 --2- 172.21.15.82:0/2105684548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c4071c60 0x7fb3c40720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.911+0000 7fb3c8a0e640 1 --2- 172.21.15.82:0/2105684548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3c40cc6d0 0x7fb3c40ccab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009870 tx=0x7fb3b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edbf9fb248200575 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.911+0000 7fb3c37fe640 1 -- 172.21.15.82:0/2105684548 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8037070 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.911+0000 7fb3c37fe640 1 -- 172.21.15.82:0/2105684548 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b8032440 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.911+0000 7fb3c37fe640 1 -- 172.21.15.82:0/2105684548 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8032810 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.912+0000 7fb3cac72640 1 -- 172.21.15.82:0/2105684548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3c40cc6d0 msgr2=0x7fb3c40ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.912+0000 7fb3cac72640 1 --2- 172.21.15.82:0/2105684548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3c40cc6d0 0x7fb3c40ccab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009870 tx=0x7fb3b802a270 comp rx=0 tx=0).stop 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.912+0000 7fb3cac72640 1 -- 172.21.15.82:0/2105684548 shutdown_connections 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.912+0000 7fb3cac72640 1 --2- 172.21.15.82:0/2105684548 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c4071c60 0x7fb3c40720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.912+0000 7fb3cac72640 1 --2- 172.21.15.82:0/2105684548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3c40cc6d0 0x7fb3c40ccab0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.912+0000 7fb3cac72640 1 -- 172.21.15.82:0/2105684548 >> 172.21.15.82:0/2105684548 conn(0x7fb3c40b19f0 msgr2=0x7fb3c40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.912+0000 7fb3cac72640 1 -- 172.21.15.82:0/2105684548 shutdown_connections 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.912+0000 7fb3cac72640 1 -- 172.21.15.82:0/2105684548 wait complete. 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.913+0000 7fb3cac72640 1 Processor -- start 2024-06-02T22:52:46.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.913+0000 7fb3cac72640 1 -- start start 2024-06-02T22:52:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3cac72640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c4071c60 0x7fb3c406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3cac72640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c40b36c0 0x7fb3c41f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3cac72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3c40cc6d0 0x7fb3c41f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3cac72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c4159f60 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3cac72640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c415c890 con 0x7fb3c4071c60 2024-06-02T22:52:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3cac72640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c40b4240 con 0x7fb3c40b36c0 2024-06-02T22:52:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c920f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3c40cc6d0 0x7fb3c41f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c920f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3c40cc6d0 0x7fb3c41f7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37874/0 (socket says 172.21.15.82:37874) 2024-06-02T22:52:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c920f640 1 -- 172.21.15.82:0/3767047960 learned_addr learned my addr 172.21.15.82:0/3767047960 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:46.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c3fff640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c40b36c0 0x7fb3c41f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c8a0e640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c4071c60 0x7fb3c406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c920f640 1 -- 172.21.15.82:0/3767047960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c40b36c0 msgr2=0x7fb3c41f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c920f640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c40b36c0 0x7fb3c41f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c920f640 1 -- 172.21.15.82:0/3767047960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c4071c60 msgr2=0x7fb3c406cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c920f640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c4071c60 0x7fb3c406cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c920f640 1 -- 172.21.15.82:0/3767047960 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c40c9ac0 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c3fff640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c40b36c0 0x7fb3c41f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c8a0e640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c4071c60 0x7fb3c406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c920f640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3c40cc6d0 0x7fb3c41f7a90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00c780 tx=0x7fb3bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c17fa640 1 -- 172.21.15.82:0/3767047960 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc017070 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c17fa640 1 -- 172.21.15.82:0/3767047960 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3bc00a640 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3cac72640 1 -- 172.21.15.82:0/3767047960 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c40c9da0 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3c17fa640 1 -- 172.21.15.82:0/3767047960 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc00aa30 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.914+0000 7fb3cac72640 1 -- 172.21.15.82:0/3767047960 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c40ca360 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.915+0000 7fb3cac72640 1 -- 172.21.15.82:0/3767047960 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c40ccd50 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.916+0000 7fb3c17fa640 1 -- 172.21.15.82:0/3767047960 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3bc01a070 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.916+0000 7fb3c17fa640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3a806be30 0x7fb3a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.916+0000 7fb3c17fa640 1 -- 172.21.15.82:0/3767047960 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb3bc08a710 con 0x7fb3c40cc6d0 2024-06-02T22:52:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.916+0000 7fb3c8a0e640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3a806be30 0x7fb3a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:46.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.917+0000 7fb3c8a0e640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3a806be30 0x7fb3a806e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8034000 tx=0x7fb3b802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:46.920+0000 7fb3c17fa640 1 -- 172.21.15.82:0/3767047960 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb3c40ccd50 con 0x7fb3c40cc6d0 2024-06-02T22:52:47.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.130+0000 7fb3cac72640 1 -- 172.21.15.82:0/3767047960 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3c4068430 con 0x7fb3c40cc6d0 2024-06-02T22:52:47.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.130+0000 7fb3c17fa640 1 -- 172.21.15.82:0/3767047960 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7fb3bc0586e0 con 0x7fb3c40cc6d0 2024-06-02T22:52:47.130 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:47.130 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/598338197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":598338197},{"type":"v1","addr":"172.21.15.184:6835","nonce":598338197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/1516771012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1516771012},{"type":"v1","addr":"172.21.15.184:6834","nonce":1516771012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2379089503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2379089503},{"type":"v1","addr":"172.21.15.82:6836","nonce":2379089503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:02.905481+0000","modified":"2024-06-02T22:52:21.989508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1449064574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1449064574},{"type":"v1","addr":"172.21.15.82:6837","nonce":1449064574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-06-02T22:52:47.131 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-06-02T22:52:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 -- 172.21.15.82:0/3767047960 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3a806be30 msgr2=0x7fb3a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3a806be30 0x7fb3a806e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8034000 tx=0x7fb3b802e000 comp rx=0 tx=0).stop 2024-06-02T22:52:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 -- 172.21.15.82:0/3767047960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3c40cc6d0 msgr2=0x7fb3c41f7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3c40cc6d0 0x7fb3c41f7a90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00c780 tx=0x7fb3bc00cc40 comp rx=0 tx=0).stop 2024-06-02T22:52:47.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 -- 172.21.15.82:0/3767047960 shutdown_connections 2024-06-02T22:52:47.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3a806be30 0x7fb3a806e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3c40cc6d0 0x7fb3c41f7a90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3c40b36c0 0x7fb3c41f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 --2- 172.21.15.82:0/3767047960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3c4071c60 0x7fb3c406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 -- 172.21.15.82:0/3767047960 >> 172.21.15.82:0/3767047960 conn(0x7fb3c40b19f0 msgr2=0x7fb3c415c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:47.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 -- 172.21.15.82:0/3767047960 shutdown_connections 2024-06-02T22:52:47.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.132+0000 7fb3cac72640 1 -- 172.21.15.82:0/3767047960 wait complete. 2024-06-02T22:52:47.143 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.242+0000 7f5ac665d640 1 Processor -- start 2024-06-02T22:52:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.242+0000 7f5ac665d640 1 -- start start 2024-06-02T22:52:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.243+0000 7f5ac665d640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5ac00b46d0 0x7f5ac0071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.243+0000 7f5ac665d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac0072820 con 0x7f5ac00721a0 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.243+0000 7f5ac665d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac0072b00 con 0x7f5ac00cc6d0 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.243+0000 7f5ac665d640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac00725d0 con 0x7f5ac00b46d0 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.243+0000 7f5ac4bfa640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5ac00721a0 0x7f5ac0165c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53574/0 (socket says 172.21.15.82:53574) 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.243+0000 7f5ac4bfa640 1 -- 172.21.15.82:0/1140242581 learned_addr learned my addr 172.21.15.82:0/1140242581 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.243+0000 7f5abf7fe640 1 --2- 172.21.15.82:0/1140242581 >> v2:172.21.15.184:3300/0 conn(0x7f5ac00b46d0 0x7f5ac0071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.243+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4082475850 0 0) 0x7f5ac0072820 con 0x7f5ac00721a0 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.243+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa8003520 con 0x7f5ac00721a0 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489670931 0 0) 0x7f5ac0072b00 con 0x7f5ac00cc6d0 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ac0072820 con 0x7f5ac00cc6d0 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4260744672 0 0) 0x7f5aa8003520 con 0x7f5ac00721a0 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 >> v2:172.21.15.184:3300/0 conn(0x7f5ac00b46d0 msgr2=0x7f5ac0071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 --2- 172.21.15.82:0/1140242581 >> v2:172.21.15.184:3300/0 conn(0x7f5ac00b46d0 0x7f5ac0071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 >> v1:172.21.15.184:6789/0 conn(0x7f5ac00cc6d0 legacy=0x7f5ac00ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac0072de0 con 0x7f5ac00721a0 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f5ab80019f0 con 0x7f5ac00721a0 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 >> v1:172.21.15.82:6789/0 conn(0x7f5ac00721a0 legacy=0x7f5ac0165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5aa8003b40 0x7f5aa8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aa8004800 0x7f5aa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa80051c0 0x7f5aa800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00725d0 con 0x7f5aa8004800 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa800c040 con 0x7f5aa80051c0 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa800c240 con 0x7f5aa8003b40 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abf7fe640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aa8004800 0x7f5aa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abffff640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5aa8003b40 0x7f5aa8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5ac4bfa640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa80051c0 0x7f5aa800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abf7fe640 1 -- 172.21.15.82:0/1140242581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5aa8003b40 msgr2=0x7f5aa8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abf7fe640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5aa8003b40 0x7f5aa8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abf7fe640 1 -- 172.21.15.82:0/1140242581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa80051c0 msgr2=0x7f5aa800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abf7fe640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa80051c0 0x7f5aa800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5abf7fe640 1 -- 172.21.15.82:0/1140242581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa8003520 con 0x7f5aa8004800 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5ac4bfa640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa80051c0 0x7f5aa800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.244+0000 7f5ac4bfa640 1 -- 172.21.15.82:0/1140242581 reap_dead start 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.245+0000 7f5abf7fe640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aa8004800 0x7f5aa8004c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009a90 tx=0x7f5aa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8621ad89818bdb60 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.245+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4036070 con 0x7f5aa8004800 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.245+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab4031400 con 0x7f5aa8004800 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.245+0000 7f5abeffd640 1 -- 172.21.15.82:0/1140242581 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4009690 con 0x7f5aa8004800 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.246+0000 7f5ac665d640 1 -- 172.21.15.82:0/1140242581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aa8004800 msgr2=0x7f5aa8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.246+0000 7f5ac665d640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aa8004800 0x7f5aa8004c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009a90 tx=0x7f5aa8005830 comp rx=0 tx=0).stop 2024-06-02T22:52:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.246+0000 7f5ac665d640 1 -- 172.21.15.82:0/1140242581 shutdown_connections 2024-06-02T22:52:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.246+0000 7f5ac665d640 1 --2- 172.21.15.82:0/1140242581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aa8004800 0x7f5aa8004c80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.246+0000 7f5ac665d640 1 -- 172.21.15.82:0/1140242581 >> 172.21.15.82:0/1140242581 conn(0x7f5ac00b19f0 msgr2=0x7f5ac00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.246+0000 7f5ac665d640 1 -- 172.21.15.82:0/1140242581 shutdown_connections 2024-06-02T22:52:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.246+0000 7f5ac665d640 1 -- 172.21.15.82:0/1140242581 wait complete. 2024-06-02T22:52:47.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.247+0000 7f5ac665d640 1 Processor -- start 2024-06-02T22:52:47.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.247+0000 7f5ac665d640 1 -- start start 2024-06-02T22:52:47.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5ac665d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5aa8004800 0x7f5ac0154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5ac665d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac00ca900 0x7f5ac00cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5ac665d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ac009c000 0x7f5ac009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5ac665d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0159f60 con 0x7f5ac00ca900 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5ac665d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac015c890 con 0x7f5ac009c000 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5ac665d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac0071c60 con 0x7f5aa8004800 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac00ca900 0x7f5ac00cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac00ca900 0x7f5ac00cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37892/0 (socket says 172.21.15.82:37892) 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abf7fe640 1 -- 172.21.15.82:0/3237898585 learned_addr learned my addr 172.21.15.82:0/3237898585 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abffff640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5aa8004800 0x7f5ac0154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5ac4bfa640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ac009c000 0x7f5ac009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abf7fe640 1 -- 172.21.15.82:0/3237898585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5aa8004800 msgr2=0x7f5ac0154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abf7fe640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5aa8004800 0x7f5ac0154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abf7fe640 1 -- 172.21.15.82:0/3237898585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ac009c000 msgr2=0x7f5ac009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abf7fe640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ac009c000 0x7f5ac009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abf7fe640 1 -- 172.21.15.82:0/3237898585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac00c91a0 con 0x7f5ac00ca900 2024-06-02T22:52:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abf7fe640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac00ca900 0x7f5ac00cad80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4034040 tx=0x7f5ab4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abcff9640 1 -- 172.21.15.82:0/3237898585 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab403f020 con 0x7f5ac00ca900 2024-06-02T22:52:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abcff9640 1 -- 172.21.15.82:0/3237898585 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab4037040 con 0x7f5ac00ca900 2024-06-02T22:52:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5ac665d640 1 -- 172.21.15.82:0/3237898585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac00c9480 con 0x7f5ac00ca900 2024-06-02T22:52:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5abcff9640 1 -- 172.21.15.82:0/3237898585 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4036070 con 0x7f5ac00ca900 2024-06-02T22:52:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.248+0000 7f5ac665d640 1 -- 172.21.15.82:0/3237898585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac00c9a40 con 0x7f5ac00ca900 2024-06-02T22:52:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.249+0000 7f5ac665d640 1 -- 172.21.15.82:0/3237898585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac0068430 con 0x7f5ac00ca900 2024-06-02T22:52:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.250+0000 7f5abcff9640 1 -- 172.21.15.82:0/3237898585 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ab4042020 con 0x7f5ac00ca900 2024-06-02T22:52:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.250+0000 7f5abcff9640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aac06be60 0x7f5aac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.250+0000 7f5abcff9640 1 -- 172.21.15.82:0/3237898585 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5ab40ab090 con 0x7f5ac00ca900 2024-06-02T22:52:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.250+0000 7f5abffff640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aac06be60 0x7f5aac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.251+0000 7f5abffff640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aac06be60 0x7f5aac06e320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00afa80 tx=0x7f5ab0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.254+0000 7f5abcff9640 1 -- 172.21.15.82:0/3237898585 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5ab4049030 con 0x7f5ac00ca900 2024-06-02T22:52:47.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.428+0000 7f5ac665d640 1 -- 172.21.15.82:0/3237898585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ac0074e10 con 0x7f5ac00ca900 2024-06-02T22:52:47.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.429+0000 7f5abcff9640 1 -- 172.21.15.82:0/3237898585 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18890 (secure 0 0 0) 0x7f5ab40796b0 con 0x7f5ac00ca900 2024-06-02T22:52:47.429 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:47.429 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:45.711589+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:00.634690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:01.883112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:52:05.594970+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 -- 172.21.15.82:0/3237898585 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aac06be60 msgr2=0x7f5aac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aac06be60 0x7f5aac06e320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00afa80 tx=0x7f5ab0009040 comp rx=0 tx=0).stop 2024-06-02T22:52:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 -- 172.21.15.82:0/3237898585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac00ca900 msgr2=0x7f5ac00cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac00ca900 0x7f5ac00cad80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4034040 tx=0x7f5ab4004730 comp rx=0 tx=0).stop 2024-06-02T22:52:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 -- 172.21.15.82:0/3237898585 shutdown_connections 2024-06-02T22:52:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5aac06be60 0x7f5aac06e320 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ac009c000 0x7f5ac009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac00ca900 0x7f5ac00cad80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 --2- 172.21.15.82:0/3237898585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5aa8004800 0x7f5ac0154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 -- 172.21.15.82:0/3237898585 >> 172.21.15.82:0/3237898585 conn(0x7f5ac00b19f0 msgr2=0x7f5ac015ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 -- 172.21.15.82:0/3237898585 shutdown_connections 2024-06-02T22:52:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.431+0000 7f5ac665d640 1 -- 172.21.15.82:0/3237898585 wait complete. 2024-06-02T22:52:47.442 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-02T22:52:47.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.543+0000 7f3edbb34640 1 Processor -- start 2024-06-02T22:52:47.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.543+0000 7f3edbb34640 1 -- start start 2024-06-02T22:52:47.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3edbb34640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3ed4158770 0x7f3ed406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3edbb34640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed406e0c0 0x7f3ed406c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3edbb34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ed406e670 con 0x7f3ed4158b50 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3edbb34640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3ed406e950 con 0x7f3ed4158770 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3edbb34640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed406ec30 con 0x7f3ed406e0c0 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3ed98d0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3ed4158770 0x7f3ed406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3ed90cf640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3ed4158b50 0x7f3ed406d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53576/0 (socket says 172.21.15.82:53576) 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3ed98d0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3ed4158770 0x7f3ed406c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37904/0 (socket says 172.21.15.82:37904) 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3ed90cf640 1 -- 172.21.15.82:0/2930191098 learned_addr learned my addr 172.21.15.82:0/2930191098 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3eda0d1640 1 --2- 172.21.15.82:0/2930191098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed406e0c0 0x7f3ed406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3ed98d0640 1 -- 172.21.15.82:0/2930191098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed406e0c0 msgr2=0x7f3ed406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3ed98d0640 1 --2- 172.21.15.82:0/2930191098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed406e0c0 0x7f3ed406c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3ed98d0640 1 -- 172.21.15.82:0/2930191098 >> v1:172.21.15.82:6789/0 conn(0x7f3ed4158b50 legacy=0x7f3ed406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.544+0000 7f3ed98d0640 1 -- 172.21.15.82:0/2930191098 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed40ae890 con 0x7f3ed4158770 2024-06-02T22:52:47.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.545+0000 7f3ed98d0640 1 --2- 172.21.15.82:0/2930191098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed4158770 0x7f3ed406c3d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097a0 tx=0x7f3ed002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6861131dd97c6b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:47.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.545+0000 7f3ed88ce640 1 -- 172.21.15.82:0/2930191098 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0037070 con 0x7f3ed4158770 2024-06-02T22:52:47.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.545+0000 7f3ed88ce640 1 -- 172.21.15.82:0/2930191098 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed002adb0 con 0x7f3ed4158770 2024-06-02T22:52:47.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.545+0000 7f3ed88ce640 1 -- 172.21.15.82:0/2930191098 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0032660 con 0x7f3ed4158770 2024-06-02T22:52:47.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.545+0000 7f3edbb34640 1 -- 172.21.15.82:0/2930191098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed4158770 msgr2=0x7f3ed406c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.545+0000 7f3edbb34640 1 --2- 172.21.15.82:0/2930191098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed4158770 0x7f3ed406c3d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097a0 tx=0x7f3ed002a060 comp rx=0 tx=0).stop 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.545+0000 7f3edbb34640 1 -- 172.21.15.82:0/2930191098 shutdown_connections 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.545+0000 7f3edbb34640 1 --2- 172.21.15.82:0/2930191098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed406e0c0 0x7f3ed406c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.545+0000 7f3edbb34640 1 --2- 172.21.15.82:0/2930191098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed4158770 0x7f3ed406c3d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.545+0000 7f3edbb34640 1 -- 172.21.15.82:0/2930191098 >> 172.21.15.82:0/2930191098 conn(0x7f3ed4071950 msgr2=0x7f3ed4071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.546+0000 7f3edbb34640 1 -- 172.21.15.82:0/2930191098 shutdown_connections 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.546+0000 7f3edbb34640 1 -- 172.21.15.82:0/2930191098 wait complete. 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.547+0000 7f3edbb34640 1 Processor -- start 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.547+0000 7f3edbb34640 1 -- start start 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.547+0000 7f3edbb34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed406e0c0 0x7f3ed40cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.547+0000 7f3edbb34640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ed4158770 0x7f3ed415b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.547+0000 7f3edbb34640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed4158b50 0x7f3ed415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.547+0000 7f3edbb34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed40aef30 con 0x7f3ed406e0c0 2024-06-02T22:52:47.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.547+0000 7f3edbb34640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed40aedb0 con 0x7f3ed4158770 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.547+0000 7f3edbb34640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed40af0b0 con 0x7f3ed4158b50 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.547+0000 7f3ed98d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed406e0c0 0x7f3ed40cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.547+0000 7f3ed98d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed406e0c0 0x7f3ed40cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37906/0 (socket says 172.21.15.82:37906) 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3ed98d0640 1 -- 172.21.15.82:0/2450826375 learned_addr learned my addr 172.21.15.82:0/2450826375 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3eda0d1640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed4158b50 0x7f3ed415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3ed98d0640 1 -- 172.21.15.82:0/2450826375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed4158b50 msgr2=0x7f3ed415bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3ed98d0640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed4158b50 0x7f3ed415bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3ed98d0640 1 -- 172.21.15.82:0/2450826375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ed4158770 msgr2=0x7f3ed415b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3ed90cf640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ed4158770 0x7f3ed415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3ed98d0640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ed4158770 0x7f3ed415b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3ed98d0640 1 -- 172.21.15.82:0/2450826375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed40cf490 con 0x7f3ed406e0c0 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3eda0d1640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed4158b50 0x7f3ed415bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:47.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3ed90cf640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ed4158770 0x7f3ed415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:47.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3ed98d0640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed406e0c0 0x7f3ed40cef50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00098c0 tx=0x7f3ed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:47.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3eca7fc640 1 -- 172.21.15.82:0/2450826375 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0041070 con 0x7f3ed406e0c0 2024-06-02T22:52:47.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3eca7fc640 1 -- 172.21.15.82:0/2450826375 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed003c670 con 0x7f3ed406e0c0 2024-06-02T22:52:47.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3edbb34640 1 -- 172.21.15.82:0/2450826375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed41f4560 con 0x7f3ed406e0c0 2024-06-02T22:52:47.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3eca7fc640 1 -- 172.21.15.82:0/2450826375 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0037040 con 0x7f3ed406e0c0 2024-06-02T22:52:47.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.548+0000 7f3edbb34640 1 -- 172.21.15.82:0/2450826375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed415a2b0 con 0x7f3ed406e0c0 2024-06-02T22:52:47.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.549+0000 7f3edbb34640 1 -- 172.21.15.82:0/2450826375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed4068430 con 0x7f3ed406e0c0 2024-06-02T22:52:47.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.550+0000 7f3eca7fc640 1 -- 172.21.15.82:0/2450826375 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ed0044070 con 0x7f3ed406e0c0 2024-06-02T22:52:47.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.550+0000 7f3eca7fc640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.550+0000 7f3eca7fc640 1 -- 172.21.15.82:0/2450826375 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3ed00abc60 con 0x7f3ed406e0c0 2024-06-02T22:52:47.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.550+0000 7f3ed90cf640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.551+0000 7f3ed90cf640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3eb806be30 0x7f3eb806e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4154520 tx=0x7f3ec4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:47.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.554+0000 7f3eca7fc640 1 -- 172.21.15.82:0/2450826375 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3ed007a310 con 0x7f3ed406e0c0 2024-06-02T22:52:47.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.769+0000 7f3edbb34640 1 -- 172.21.15.82:0/2450826375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3ed4160050 con 0x7f3ed406e0c0 2024-06-02T22:52:47.770 INFO:tasks.ceph.mon.a.smithi082.stderr:2024-06-02T22:52:47.770+0000 7fc5cceb2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T22:52:47.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.771+0000 7f3eca7fc640 1 -- 172.21.15.82:0/2450826375 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f3ed0079c10 con 0x7f3ed406e0c0 2024-06-02T22:52:47.771 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-02T22:52:47.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 -- 172.21.15.82:0/2450826375 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3eb806be30 msgr2=0x7f3eb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3eb806be30 0x7f3eb806e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4154520 tx=0x7f3ec4009040 comp rx=0 tx=0).stop 2024-06-02T22:52:47.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 -- 172.21.15.82:0/2450826375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed406e0c0 msgr2=0x7f3ed40cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed406e0c0 0x7f3ed40cef50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00098c0 tx=0x7f3ed00046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 -- 172.21.15.82:0/2450826375 shutdown_connections 2024-06-02T22:52:47.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3eb806be30 0x7f3eb806e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed4158b50 0x7f3ed415bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ed4158770 0x7f3ed415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 --2- 172.21.15.82:0/2450826375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed406e0c0 0x7f3ed40cef50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 -- 172.21.15.82:0/2450826375 >> 172.21.15.82:0/2450826375 conn(0x7f3ed4071950 msgr2=0x7f3ed40b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:47.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 -- 172.21.15.82:0/2450826375 shutdown_connections 2024-06-02T22:52:47.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.774+0000 7f3edbb34640 1 -- 172.21.15.82:0/2450826375 wait complete. 2024-06-02T22:52:47.776 INFO:tasks.ceph.mds.c.smithi082.stderr: -3249> 2024-06-02T22:52:08.432+0000 7f00bb5d5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T22:52:47.786 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-02T22:52:47.806 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2024-06-02T22:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.889+0000 7fbfb62f5640 1 Processor -- start 2024-06-02T22:52:47.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.890+0000 7fbfb62f5640 1 -- start start 2024-06-02T22:52:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.890+0000 7fbfb62f5640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbfb00d08f0 0x7fbfb00b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.890+0000 7fbfb62f5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbfb00cf360 0x7fbfb00d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.890+0000 7fbfb62f5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb00cf8a0 con 0x7fbfb00d0cd0 2024-06-02T22:52:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.890+0000 7fbfb62f5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb00d1c80 con 0x7fbfb00cf360 2024-06-02T22:52:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.890+0000 7fbfb62f5640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb00cfb80 con 0x7fbfb00d08f0 2024-06-02T22:52:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.890+0000 7fbfb4892640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbfb00cf360 0x7fbfb00d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.891+0000 7fbfb4892640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbfb00cf360 0x7fbfb00d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37932/0 (socket says 172.21.15.82:37932) 2024-06-02T22:52:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.891+0000 7fbfb4892640 1 -- 172.21.15.82:0/2857340138 learned_addr learned my addr 172.21.15.82:0/2857340138 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.891+0000 7fbfaffff640 1 --2- 172.21.15.82:0/2857340138 >> v2:172.21.15.184:3300/0 conn(0x7fbfb00d08f0 0x7fbfb00b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.891+0000 7fbfb4892640 1 -- 172.21.15.82:0/2857340138 >> v2:172.21.15.184:3300/0 conn(0x7fbfb00d08f0 msgr2=0x7fbfb00b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.891+0000 7fbfb4892640 1 --2- 172.21.15.82:0/2857340138 >> v2:172.21.15.184:3300/0 conn(0x7fbfb00d08f0 0x7fbfb00b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.891+0000 7fbfb4892640 1 -- 172.21.15.82:0/2857340138 >> v1:172.21.15.184:6789/0 conn(0x7fbfb00d0cd0 legacy=0x7fbfb00cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:47.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.891+0000 7fbfb4892640 1 -- 172.21.15.82:0/2857340138 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb00cfe60 con 0x7fbfb00cf360 2024-06-02T22:52:47.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.891+0000 7fbfaffff640 1 --2- 172.21.15.82:0/2857340138 >> v2:172.21.15.184:3300/0 conn(0x7fbfb00d08f0 0x7fbfb00b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:47.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.891+0000 7fbfb4892640 1 --2- 172.21.15.82:0/2857340138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb00cf360 0x7fbfb00d23f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009e50 tx=0x7fbfa802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63dd6b3babe22061 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:47.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.892+0000 7fbfaeffd640 1 -- 172.21.15.82:0/2857340138 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8036070 con 0x7fbfb00cf360 2024-06-02T22:52:47.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.892+0000 7fbfaeffd640 1 -- 172.21.15.82:0/2857340138 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa8031600 con 0x7fbfb00cf360 2024-06-02T22:52:47.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.892+0000 7fbfaeffd640 1 -- 172.21.15.82:0/2857340138 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80319d0 con 0x7fbfb00cf360 2024-06-02T22:52:47.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.892+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2857340138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb00cf360 msgr2=0x7fbfb00d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.892+0000 7fbfb62f5640 1 --2- 172.21.15.82:0/2857340138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb00cf360 0x7fbfb00d23f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009e50 tx=0x7fbfa802a710 comp rx=0 tx=0).stop 2024-06-02T22:52:47.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.892+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2857340138 shutdown_connections 2024-06-02T22:52:47.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.892+0000 7fbfb62f5640 1 --2- 172.21.15.82:0/2857340138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb00cf360 0x7fbfb00d23f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.892+0000 7fbfb62f5640 1 --2- 172.21.15.82:0/2857340138 >> v2:172.21.15.184:3300/0 conn(0x7fbfb00d08f0 0x7fbfb00b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.892+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2857340138 >> 172.21.15.82:0/2857340138 conn(0x7fbfb009d3c0 msgr2=0x7fbfb00d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:47.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.892+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2857340138 shutdown_connections 2024-06-02T22:52:47.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.892+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2857340138 wait complete. 2024-06-02T22:52:47.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.893+0000 7fbfb62f5640 1 Processor -- start 2024-06-02T22:52:47.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfb62f5640 1 -- start start 2024-06-02T22:52:47.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfb62f5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb00cf360 0x7fbfb0155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfb62f5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfb00d08f0 0x7fbfb00b9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfb62f5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbfb00d0cd0 0x7fbfb00b95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfb62f5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb00d1180 con 0x7fbfb00cf360 2024-06-02T22:52:47.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfb62f5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb00b50c0 con 0x7fbfb00d08f0 2024-06-02T22:52:47.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfb62f5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb00b4a60 con 0x7fbfb00d0cd0 2024-06-02T22:52:47.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfaffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb00cf360 0x7fbfb0155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfaffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb00cf360 0x7fbfb0155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37948/0 (socket says 172.21.15.82:37948) 2024-06-02T22:52:47.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfaffff640 1 -- 172.21.15.82:0/2880836416 learned_addr learned my addr 172.21.15.82:0/2880836416 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:47.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfaf7fe640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfb00d08f0 0x7fbfb00b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.894+0000 7fbfb4892640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbfb00d0cd0 0x7fbfb00b95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfaffff640 1 -- 172.21.15.82:0/2880836416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbfb00d0cd0 msgr2=0x7fbfb00b95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfaffff640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbfb00d0cd0 0x7fbfb00b95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfaffff640 1 -- 172.21.15.82:0/2880836416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfb00d08f0 msgr2=0x7fbfb00b9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:47.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfaffff640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfb00d08f0 0x7fbfb00b9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:47.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfaffff640 1 -- 172.21.15.82:0/2880836416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb00b76c0 con 0x7fbfb00cf360 2024-06-02T22:52:47.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfaf7fe640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfb00d08f0 0x7fbfb00b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:47.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfaffff640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb00cf360 0x7fbfb0155560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000c7f0 tx=0x7fbfa000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:47.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfacff9640 1 -- 172.21.15.82:0/2880836416 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0015070 con 0x7fbfb00cf360 2024-06-02T22:52:47.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfacff9640 1 -- 172.21.15.82:0/2880836416 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa0007a30 con 0x7fbfb00cf360 2024-06-02T22:52:47.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2880836416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb00b79a0 con 0x7fbfb00cf360 2024-06-02T22:52:47.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfacff9640 1 -- 172.21.15.82:0/2880836416 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0007e00 con 0x7fbfb00cf360 2024-06-02T22:52:47.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.895+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2880836416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb00cc8a0 con 0x7fbfb00cf360 2024-06-02T22:52:47.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.896+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2880836416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb00683c0 con 0x7fbfb00cf360 2024-06-02T22:52:47.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.897+0000 7fbfacff9640 1 -- 172.21.15.82:0/2880836416 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfa0018070 con 0x7fbfb00cf360 2024-06-02T22:52:47.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.897+0000 7fbfacff9640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbf9c06be30 0x7fbf9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:47.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.897+0000 7fbfacff9640 1 -- 172.21.15.82:0/2880836416 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7fbfa008b240 con 0x7fbfb00cf360 2024-06-02T22:52:47.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.897+0000 7fbfaf7fe640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbf9c06be30 0x7fbf9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:47.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.897+0000 7fbfaf7fe640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbf9c06be30 0x7fbf9c06e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4006fd0 tx=0x7fbfa4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:47.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:47.901+0000 7fbfacff9640 1 -- 172.21.15.82:0/2880836416 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbfa0059800 con 0x7fbfb00cf360 2024-06-02T22:52:48.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.111+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2880836416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbfb00d1730 con 0x7fbfb00cf360 2024-06-02T22:52:48.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.776+0000 7fbfacff9640 1 -- 172.21.15.82:0/2880836416 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fbfa0059100 con 0x7fbfb00cf360 2024-06-02T22:52:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2880836416 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbf9c06be30 msgr2=0x7fbf9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbf9c06be30 0x7fbf9c06e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4006fd0 tx=0x7fbfa4008040 comp rx=0 tx=0).stop 2024-06-02T22:52:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2880836416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb00cf360 msgr2=0x7fbfb0155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb00cf360 0x7fbfb0155560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000c7f0 tx=0x7fbfa000cbf0 comp rx=0 tx=0).stop 2024-06-02T22:52:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2880836416 shutdown_connections 2024-06-02T22:52:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbf9c06be30 0x7fbf9c06e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbfb00d0cd0 0x7fbfb00b95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfb00d08f0 0x7fbfb00b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 --2- 172.21.15.82:0/2880836416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb00cf360 0x7fbfb0155560 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2880836416 >> 172.21.15.82:0/2880836416 conn(0x7fbfb009d3c0 msgr2=0x7fbfb00b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2880836416 shutdown_connections 2024-06-02T22:52:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.778+0000 7fbfb62f5640 1 -- 172.21.15.82:0/2880836416 wait complete. 2024-06-02T22:52:48.791 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-02T22:52:48.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.938+0000 7f9162e4d640 1 Processor -- start 2024-06-02T22:52:48.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.938+0000 7f9162e4d640 1 -- start start 2024-06-02T22:52:48.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f9162e4d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f915c15e670 0x7f915c0d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:48.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f9162e4d640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f915c0d0e00 0x7f915c0cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:48.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f9162e4d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f915c15ec90 con 0x7f915c0d1f30 2024-06-02T22:52:48.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f9162e4d640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f915c15fa50 con 0x7f915c0d0e00 2024-06-02T22:52:48.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f9162e4d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f915c15ea50 con 0x7f915c15e670 2024-06-02T22:52:48.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f915c0d1f30 0x7f915c0d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53594/0 (socket says 172.21.15.82:53594) 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915bfff640 1 -- 172.21.15.82:0/1611712609 learned_addr learned my addr 172.21.15.82:0/1611712609 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4126821909 0 0) 0x7f915c15ec90 con 0x7f915c0d1f30 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f914c003520 con 0x7f915c0d1f30 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f91613ea640 1 --2- 172.21.15.82:0/1611712609 >> v2:172.21.15.184:3300/0 conn(0x7f915c0d0e00 0x7f915c0cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f9160be9640 1 --2- 172.21.15.82:0/1611712609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f915c15e670 0x7f915c0d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3774006734 0 0) 0x7f914c003520 con 0x7f915c0d1f30 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f915c15e670 msgr2=0x7f915c0d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 --2- 172.21.15.82:0/1611712609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f915c15e670 0x7f915c0d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 >> v2:172.21.15.184:3300/0 conn(0x7f915c0d0e00 msgr2=0x7f915c0cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 --2- 172.21.15.82:0/1611712609 >> v2:172.21.15.184:3300/0 conn(0x7f915c0d0e00 0x7f915c0cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915c15ef70 con 0x7f915c0d1f30 2024-06-02T22:52:48.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f9148001670 con 0x7f915c0d1f30 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 >> v1:172.21.15.82:6789/0 conn(0x7f915c0d1f30 legacy=0x7f915c0d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 --2- 172.21.15.82:0/1611712609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f914c0039b0 0x7f914c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 --2- 172.21.15.82:0/1611712609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c004800 0x7f914c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 --2- 172.21.15.82:0/1611712609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f915c15e670 0x7f914c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f915c15fa50 con 0x7f914c004800 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f915c15ea50 con 0x7f914c0039b0 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f914c00bb00 con 0x7f915c15e670 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.939+0000 7f915bfff640 1 --2- 172.21.15.82:0/1611712609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c004800 0x7f914c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.940+0000 7f9160be9640 1 --2- 172.21.15.82:0/1611712609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f914c0039b0 0x7f914c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.940+0000 7f915bfff640 1 -- 172.21.15.82:0/1611712609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f915c15e670 msgr2=0x7f914c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.940+0000 7f915bfff640 1 --2- 172.21.15.82:0/1611712609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f915c15e670 0x7f914c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.940+0000 7f915bfff640 1 -- 172.21.15.82:0/1611712609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f914c0039b0 msgr2=0x7f914c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:48.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.940+0000 7f915bfff640 1 --2- 172.21.15.82:0/1611712609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f914c0039b0 0x7f914c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.940+0000 7f915bfff640 1 -- 172.21.15.82:0/1611712609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914c003520 con 0x7f914c004800 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.940+0000 7f915bfff640 1 --2- 172.21.15.82:0/1611712609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c004800 0x7f914c004c80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9148001eb0 tx=0x7f914c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5508b27e07db703e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.940+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148007d70 con 0x7f914c004800 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.941+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91480058d0 con 0x7f914c004800 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.941+0000 7f915b7fe640 1 -- 172.21.15.82:0/1611712609 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148005ca0 con 0x7f914c004800 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.941+0000 7f9162e4d640 1 -- 172.21.15.82:0/1611712609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c004800 msgr2=0x7f914c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.941+0000 7f9162e4d640 1 --2- 172.21.15.82:0/1611712609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f914c004800 0x7f914c004c80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9148001eb0 tx=0x7f914c005830 comp rx=0 tx=0).stop 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.941+0000 7f91613ea640 1 -- 172.21.15.82:0/1611712609 reap_dead start 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.941+0000 7f9162e4d640 1 -- 172.21.15.82:0/1611712609 shutdown_connections 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.941+0000 7f9162e4d640 1 -- 172.21.15.82:0/1611712609 >> 172.21.15.82:0/1611712609 conn(0x7f915c09d400 msgr2=0x7f915c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.941+0000 7f9162e4d640 1 -- 172.21.15.82:0/1611712609 shutdown_connections 2024-06-02T22:52:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.941+0000 7f9162e4d640 1 -- 172.21.15.82:0/1611712609 wait complete. 2024-06-02T22:52:48.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.942+0000 7f9162e4d640 1 Processor -- start 2024-06-02T22:52:48.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.942+0000 7f9162e4d640 1 -- start start 2024-06-02T22:52:48.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.943+0000 7f9162e4d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f914c004800 0x7f915c161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:48.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.943+0000 7f9162e4d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f915c1539b0 0x7f915c0b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:48.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.943+0000 7f9162e4d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f915c152d00 0x7f915c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:48.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.943+0000 7f9162e4d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f915c0d2370 con 0x7f915c152d00 2024-06-02T22:52:48.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.943+0000 7f9162e4d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f915c15f530 con 0x7f915c1539b0 2024-06-02T22:52:48.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.943+0000 7f9162e4d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f915c0d49f0 con 0x7f914c004800 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.943+0000 7f91613ea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f915c152d00 0x7f915c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.943+0000 7f91613ea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f915c152d00 0x7f915c1531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37966/0 (socket says 172.21.15.82:37966) 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.943+0000 7f91613ea640 1 -- 172.21.15.82:0/3502047831 learned_addr learned my addr 172.21.15.82:0/3502047831 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.943+0000 7f9160be9640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f914c004800 0x7f915c161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.943+0000 7f915bfff640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f915c1539b0 0x7f915c0b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.944+0000 7f91613ea640 1 -- 172.21.15.82:0/3502047831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f914c004800 msgr2=0x7f915c161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.944+0000 7f91613ea640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f914c004800 0x7f915c161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.944+0000 7f91613ea640 1 -- 172.21.15.82:0/3502047831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f915c1539b0 msgr2=0x7f915c0b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.944+0000 7f91613ea640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f915c1539b0 0x7f915c0b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.944+0000 7f91613ea640 1 -- 172.21.15.82:0/3502047831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915c15ff90 con 0x7f915c152d00 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.944+0000 7f91613ea640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f915c152d00 0x7f915c1531b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f915c08cc40 tx=0x7f915400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.944+0000 7f91597fa640 1 -- 172.21.15.82:0/3502047831 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915400ed90 con 0x7f915c152d00 2024-06-02T22:52:48.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.944+0000 7f91597fa640 1 -- 172.21.15.82:0/3502047831 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9154019070 con 0x7f915c152d00 2024-06-02T22:52:48.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.944+0000 7f9162e4d640 1 -- 172.21.15.82:0/3502047831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915c160270 con 0x7f915c152d00 2024-06-02T22:52:48.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.944+0000 7f91597fa640 1 -- 172.21.15.82:0/3502047831 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154014660 con 0x7f915c152d00 2024-06-02T22:52:48.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.944+0000 7f9162e4d640 1 -- 172.21.15.82:0/3502047831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915c160830 con 0x7f915c152d00 2024-06-02T22:52:48.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.945+0000 7f9162e4d640 1 -- 172.21.15.82:0/3502047831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f915c068540 con 0x7f915c152d00 2024-06-02T22:52:48.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.945+0000 7f91597fa640 1 -- 172.21.15.82:0/3502047831 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9154014800 con 0x7f915c152d00 2024-06-02T22:52:48.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.946+0000 7f91597fa640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f914006be30 0x7f914006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:48.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.946+0000 7f91597fa640 1 -- 172.21.15.82:0/3502047831 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7f915408b7b0 con 0x7f915c152d00 2024-06-02T22:52:48.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.946+0000 7f9160be9640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f914006be30 0x7f914006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:48.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.946+0000 7f9160be9640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f914006be30 0x7f914006e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f915c162db0 tx=0x7f9150008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:48.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:48.950+0000 7f91597fa640 1 -- 172.21.15.82:0/3502047831 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9154059ce0 con 0x7f915c152d00 2024-06-02T22:52:49.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.125+0000 7f9162e4d640 1 -- 172.21.15.82:0/3502047831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f915c0d47d0 con 0x7f915c152d00 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.777+0000 7f91597fa640 1 -- 172.21.15.82:0/3502047831 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f91540595e0 con 0x7f915c152d00 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.780+0000 7f9162e4d640 1 -- 172.21.15.82:0/3502047831 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f914006be30 msgr2=0x7f914006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.780+0000 7f9162e4d640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f914006be30 0x7f914006e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f915c162db0 tx=0x7f9150008040 comp rx=0 tx=0).stop 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.780+0000 7f9162e4d640 1 -- 172.21.15.82:0/3502047831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f915c152d00 msgr2=0x7f915c1531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.780+0000 7f9162e4d640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f915c152d00 0x7f915c1531b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f915c08cc40 tx=0x7f915400e4b0 comp rx=0 tx=0).stop 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.780+0000 7f9162e4d640 1 -- 172.21.15.82:0/3502047831 shutdown_connections 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.780+0000 7f9162e4d640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f914006be30 0x7f914006e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.780+0000 7f9162e4d640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f915c152d00 0x7f915c1531b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.780+0000 7f9162e4d640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f915c1539b0 0x7f915c0b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.780+0000 7f9162e4d640 1 --2- 172.21.15.82:0/3502047831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f914c004800 0x7f915c161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.780+0000 7f9162e4d640 1 -- 172.21.15.82:0/3502047831 >> 172.21.15.82:0/3502047831 conn(0x7f915c09d400 msgr2=0x7f915c06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.781+0000 7f9162e4d640 1 -- 172.21.15.82:0/3502047831 shutdown_connections 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.781+0000 7f9162e4d640 1 -- 172.21.15.82:0/3502047831 wait complete. 2024-06-02T22:52:49.793 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-02T22:52:49.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.898+0000 7fb44dd4f640 1 Processor -- start 2024-06-02T22:52:49.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.898+0000 7fb44dd4f640 1 -- start start 2024-06-02T22:52:49.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.899+0000 7fb44dd4f640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb448158870 0x7fb44815e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:49.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.899+0000 7fb44dd4f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4480b56f0 0x7fb4480b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:49.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.899+0000 7fb44dd4f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44806d9e0 con 0x7fb4480b3b60 2024-06-02T22:52:49.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.899+0000 7fb44dd4f640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fb44806e5f0 con 0x7fb448158870 2024-06-02T22:52:49.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.899+0000 7fb44dd4f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb44806dcc0 con 0x7fb4480b56f0 2024-06-02T22:52:49.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.899+0000 7fb447fff640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb4480b3b60 0x7fb448161e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:59314/0 (socket says 172.21.15.82:59314) 2024-06-02T22:52:49.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.899+0000 7fb447fff640 1 -- 172.21.15.82:0/3185742852 learned_addr learned my addr 172.21.15.82:0/3185742852 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:49.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.899+0000 7fb4477fe640 1 --2- 172.21.15.82:0/3185742852 >> v2:172.21.15.184:3300/0 conn(0x7fb448158870 0x7fb44815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:49.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.899+0000 7fb446ffd640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4480b56f0 0x7fb4480b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:49.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.899+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633343792 0 0) 0x7fb44806d9e0 con 0x7fb4480b3b60 2024-06-02T22:52:49.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.899+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb430003520 con 0x7fb4480b3b60 2024-06-02T22:52:49.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 811585430 0 0) 0x7fb430003520 con 0x7fb4480b3b60 2024-06-02T22:52:49.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4480b56f0 msgr2=0x7fb4480b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:49.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4480b56f0 0x7fb4480b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:49.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 >> v2:172.21.15.184:3300/0 conn(0x7fb448158870 msgr2=0x7fb44815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:49.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 --2- 172.21.15.82:0/3185742852 >> v2:172.21.15.184:3300/0 conn(0x7fb448158870 0x7fb44815e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:49.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44806dfa0 con 0x7fb4480b3b60 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fb4400019f0 con 0x7fb4480b3b60 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 >> v1:172.21.15.184:6789/0 conn(0x7fb4480b3b60 legacy=0x7fb448161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4480b56f0 0x7fb4300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb430003f30 0x7fb430004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb430004d40 0x7fb4300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb44806e5f0 con 0x7fb430004d40 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb44806dcc0 con 0x7fb430003f30 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb43000ba10 con 0x7fb4480b56f0 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb447fff640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb430004d40 0x7fb4300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4477fe640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4480b56f0 0x7fb4300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb446ffd640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb430003f30 0x7fb430004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb447fff640 1 -- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4480b56f0 msgr2=0x7fb4300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb447fff640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4480b56f0 0x7fb4300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:49.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb447fff640 1 -- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb430003f30 msgr2=0x7fb430004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:49.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb447fff640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb430003f30 0x7fb430004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:49.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb447fff640 1 -- 172.21.15.82:0/3185742852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb430003520 con 0x7fb430004d40 2024-06-02T22:52:49.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb4477fe640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4480b56f0 0x7fb4300039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:49.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.900+0000 7fb446ffd640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb430003f30 0x7fb430004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:49.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.901+0000 7fb447fff640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb430004d40 0x7fb4300051c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb44000a8d0 tx=0x7fb430005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e0d3ca6d603830 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:49.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.901+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44000a4c0 con 0x7fb430004d40 2024-06-02T22:52:49.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.901+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44002f070 con 0x7fb430004d40 2024-06-02T22:52:49.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.901+0000 7fb4467fc640 1 -- 172.21.15.82:0/3185742852 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44002bd40 con 0x7fb430004d40 2024-06-02T22:52:49.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.901+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3185742852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb430004d40 msgr2=0x7fb4300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:49.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.901+0000 7fb44dd4f640 1 --2- 172.21.15.82:0/3185742852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb430004d40 0x7fb4300051c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb44000a8d0 tx=0x7fb430005830 comp rx=0 tx=0).stop 2024-06-02T22:52:49.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.902+0000 7fb447fff640 1 -- 172.21.15.82:0/3185742852 reap_dead start 2024-06-02T22:52:49.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.902+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3185742852 shutdown_connections 2024-06-02T22:52:49.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.902+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3185742852 >> 172.21.15.82:0/3185742852 conn(0x7fb4480d05b0 msgr2=0x7fb4480d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:49.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.902+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3185742852 shutdown_connections 2024-06-02T22:52:49.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.902+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3185742852 wait complete. 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.903+0000 7fb44dd4f640 1 Processor -- start 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.903+0000 7fb44dd4f640 1 -- start start 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb44dd4f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44814a300 0x7fb448155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb44dd4f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb448155f50 0x7fb4481f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb44dd4f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4481f4ad0 0x7fb448158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb44dd4f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb44806f590 con 0x7fb44814a300 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb44dd4f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb448158c50 con 0x7fb448155f50 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb44dd4f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb44806f710 con 0x7fb4481f4ad0 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb4477fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44814a300 0x7fb448155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb4477fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44814a300 0x7fb448155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37984/0 (socket says 172.21.15.82:37984) 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb4477fe640 1 -- 172.21.15.82:0/3398075305 learned_addr learned my addr 172.21.15.82:0/3398075305 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb447fff640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4481f4ad0 0x7fb448158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb446ffd640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb448155f50 0x7fb4481f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb4477fe640 1 -- 172.21.15.82:0/3398075305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4481f4ad0 msgr2=0x7fb448158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb4477fe640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4481f4ad0 0x7fb448158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb4477fe640 1 -- 172.21.15.82:0/3398075305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb448155f50 msgr2=0x7fb4481f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb4477fe640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb448155f50 0x7fb4481f4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb4477fe640 1 -- 172.21.15.82:0/3398075305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4481f8870 con 0x7fb44814a300 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.904+0000 7fb4477fe640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44814a300 0x7fb448155a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb4380109d0 tx=0x7fb438010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.905+0000 7fb42ffff640 1 -- 172.21.15.82:0/3398075305 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43800f040 con 0x7fb44814a300 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.905+0000 7fb42ffff640 1 -- 172.21.15.82:0/3398075305 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb43800ebc0 con 0x7fb44814a300 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.905+0000 7fb42ffff640 1 -- 172.21.15.82:0/3398075305 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43801c400 con 0x7fb44814a300 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.905+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3398075305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44814a6e0 con 0x7fb44814a300 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.905+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3398075305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4481f7d90 con 0x7fb44814a300 2024-06-02T22:52:49.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.906+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3398075305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb448068540 con 0x7fb44814a300 2024-06-02T22:52:49.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.908+0000 7fb42ffff640 1 -- 172.21.15.82:0/3398075305 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb43801c5a0 con 0x7fb44814a300 2024-06-02T22:52:49.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.909+0000 7fb42ffff640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb43406be60 0x7fb43406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:49.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.909+0000 7fb42ffff640 1 -- 172.21.15.82:0/3398075305 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6412+0+0 (secure 0 0 0) 0x7fb43808b780 con 0x7fb44814a300 2024-06-02T22:52:49.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.909+0000 7fb446ffd640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb43406be60 0x7fb43406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:49.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.909+0000 7fb446ffd640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb43406be60 0x7fb43406e320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb4480b0980 tx=0x7fb43c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:49.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:49.914+0000 7fb42ffff640 1 -- 172.21.15.82:0/3398075305 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb438018030 con 0x7fb44814a300 2024-06-02T22:52:50.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.087+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3398075305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb448156330 con 0x7fb44814a300 2024-06-02T22:52:50.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.784+0000 7fb42ffff640 1 -- 172.21.15.82:0/3398075305 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7fb438059e70 con 0x7fb44814a300 2024-06-02T22:52:50.784 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2024-06-02T22:52:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.787+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3398075305 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb43406be60 msgr2=0x7fb43406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.787+0000 7fb44dd4f640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb43406be60 0x7fb43406e320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb4480b0980 tx=0x7fb43c008040 comp rx=0 tx=0).stop 2024-06-02T22:52:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.787+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3398075305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44814a300 msgr2=0x7fb448155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.787+0000 7fb44dd4f640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44814a300 0x7fb448155a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb4380109d0 tx=0x7fb438010e90 comp rx=0 tx=0).stop 2024-06-02T22:52:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.787+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3398075305 shutdown_connections 2024-06-02T22:52:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.787+0000 7fb44dd4f640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb43406be60 0x7fb43406e320 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.787+0000 7fb44dd4f640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4481f4ad0 0x7fb448158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.787+0000 7fb44dd4f640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb448155f50 0x7fb4481f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.787+0000 7fb44dd4f640 1 --2- 172.21.15.82:0/3398075305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44814a300 0x7fb448155a10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.787+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3398075305 >> 172.21.15.82:0/3398075305 conn(0x7fb4480d05b0 msgr2=0x7fb448160cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.788+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3398075305 shutdown_connections 2024-06-02T22:52:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.788+0000 7fb44dd4f640 1 -- 172.21.15.82:0/3398075305 wait complete. 2024-06-02T22:52:50.800 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-06-02T22:52:50.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.905+0000 7faa0581c640 1 Processor -- start 2024-06-02T22:52:50.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.905+0000 7faa0581c640 1 -- start start 2024-06-02T22:52:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.906+0000 7faa0581c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa0015e380 0x7faa000d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.906+0000 7faa0581c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa000b4430 0x7faa0006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.906+0000 7faa0581c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faa00070510 0x7faa0009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.906+0000 7faa0581c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7faa0015e760 con 0x7faa000b4430 2024-06-02T22:52:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.906+0000 7faa0581c640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7faa0006fb40 con 0x7faa00070510 2024-06-02T22:52:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.906+0000 7faa0581c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7faa0009b690 con 0x7faa0015e380 2024-06-02T22:52:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.906+0000 7fa9fe7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa000b4430 0x7faa0006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.906+0000 7fa9fe7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa000b4430 0x7faa0006ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37994/0 (socket says 172.21.15.82:37994) 2024-06-02T22:52:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.906+0000 7fa9fe7fc640 1 -- 172.21.15.82:0/1260529216 learned_addr learned my addr 172.21.15.82:0/1260529216 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:50.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.907+0000 7fa9feffd640 1 --2- 172.21.15.82:0/1260529216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa0015e380 0x7faa000d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:50.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.907+0000 7fa9ff7fe640 1 --2- 172.21.15.82:0/1260529216 >> v2:172.21.15.184:3300/0 conn(0x7faa00070510 0x7faa0009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:50.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.907+0000 7fa9fe7fc640 1 -- 172.21.15.82:0/1260529216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa0015e380 msgr2=0x7faa000d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:50.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.907+0000 7fa9fe7fc640 1 --2- 172.21.15.82:0/1260529216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa0015e380 0x7faa000d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.907+0000 7fa9fe7fc640 1 -- 172.21.15.82:0/1260529216 >> v2:172.21.15.184:3300/0 conn(0x7faa00070510 msgr2=0x7faa0009aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:50.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.907+0000 7fa9fe7fc640 1 --2- 172.21.15.82:0/1260529216 >> v2:172.21.15.184:3300/0 conn(0x7faa00070510 0x7faa0009aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.907+0000 7fa9fe7fc640 1 -- 172.21.15.82:0/1260529216 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa000d1130 con 0x7faa000b4430 2024-06-02T22:52:50.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.907+0000 7fa9fe7fc640 1 --2- 172.21.15.82:0/1260529216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa000b4430 0x7faa0006ffd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faa00162ea0 tx=0x7fa9f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56e1d5c6ade2d3e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:50.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7fa9fdffb640 1 -- 172.21.15.82:0/1260529216 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4037070 con 0x7faa000b4430 2024-06-02T22:52:50.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7fa9fdffb640 1 -- 172.21.15.82:0/1260529216 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f4032440 con 0x7faa000b4430 2024-06-02T22:52:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7fa9fdffb640 1 -- 172.21.15.82:0/1260529216 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4032810 con 0x7faa000b4430 2024-06-02T22:52:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7faa0581c640 1 -- 172.21.15.82:0/1260529216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa000b4430 msgr2=0x7faa0006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7faa0581c640 1 --2- 172.21.15.82:0/1260529216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa000b4430 0x7faa0006ffd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faa00162ea0 tx=0x7fa9f402a1e0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7faa0581c640 1 -- 172.21.15.82:0/1260529216 shutdown_connections 2024-06-02T22:52:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7faa0581c640 1 --2- 172.21.15.82:0/1260529216 >> v2:172.21.15.184:3300/0 conn(0x7faa00070510 0x7faa0009aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7faa0581c640 1 --2- 172.21.15.82:0/1260529216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa000b4430 0x7faa0006ffd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7faa0581c640 1 --2- 172.21.15.82:0/1260529216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa0015e380 0x7faa000d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7faa0581c640 1 -- 172.21.15.82:0/1260529216 >> 172.21.15.82:0/1260529216 conn(0x7faa000b3910 msgr2=0x7faa000b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7faa0581c640 1 -- 172.21.15.82:0/1260529216 shutdown_connections 2024-06-02T22:52:50.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.908+0000 7faa0581c640 1 -- 172.21.15.82:0/1260529216 wait complete. 2024-06-02T22:52:50.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.909+0000 7faa0581c640 1 Processor -- start 2024-06-02T22:52:50.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.909+0000 7faa0581c640 1 -- start start 2024-06-02T22:52:50.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.910+0000 7faa0581c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa00070510 0x7faa000b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:50.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.910+0000 7faa0581c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa000b4430 0x7faa000c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:50.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.910+0000 7faa0581c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0015e380 0x7faa0014e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:50.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.910+0000 7faa0581c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faa0009af50 con 0x7faa0015e380 2024-06-02T22:52:50.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.910+0000 7faa0581c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faa0006f7d0 con 0x7faa000b4430 2024-06-02T22:52:50.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.910+0000 7faa0581c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7faa0009b0d0 con 0x7faa00070510 2024-06-02T22:52:50.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.910+0000 7fa9ff7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0015e380 0x7faa0014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:50.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.910+0000 7fa9ff7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0015e380 0x7faa0014e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38000/0 (socket says 172.21.15.82:38000) 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.910+0000 7fa9ff7fe640 1 -- 172.21.15.82:0/1891336079 learned_addr learned my addr 172.21.15.82:0/1891336079 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.911+0000 7fa9ff7fe640 1 -- 172.21.15.82:0/1891336079 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa00070510 msgr2=0x7faa000b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.911+0000 7fa9ff7fe640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa00070510 0x7faa000b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.911+0000 7fa9ff7fe640 1 -- 172.21.15.82:0/1891336079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa000b4430 msgr2=0x7faa000c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.911+0000 7fa9ff7fe640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa000b4430 0x7faa000c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.911+0000 7fa9ff7fe640 1 -- 172.21.15.82:0/1891336079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa000b6610 con 0x7faa0015e380 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.911+0000 7fa9ff7fe640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0015e380 0x7faa0014e160 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800d5c0 tx=0x7fa9f800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.911+0000 7fa9e7fff640 1 -- 172.21.15.82:0/1891336079 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80125f0 con 0x7faa0015e380 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.911+0000 7fa9e7fff640 1 -- 172.21.15.82:0/1891336079 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f8019070 con 0x7faa0015e380 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.911+0000 7fa9e7fff640 1 -- 172.21.15.82:0/1891336079 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80129f0 con 0x7faa0015e380 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.911+0000 7faa0581c640 1 -- 172.21.15.82:0/1891336079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa000b68f0 con 0x7faa0015e380 2024-06-02T22:52:50.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.911+0000 7faa0581c640 1 -- 172.21.15.82:0/1891336079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa000b6eb0 con 0x7faa0015e380 2024-06-02T22:52:50.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.912+0000 7faa0581c640 1 -- 172.21.15.82:0/1891336079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa00068540 con 0x7faa0015e380 2024-06-02T22:52:50.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.912+0000 7fa9e7fff640 1 -- 172.21.15.82:0/1891336079 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9f8012b90 con 0x7faa0015e380 2024-06-02T22:52:50.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.913+0000 7fa9e7fff640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa9ec06be30 0x7fa9ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:50.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.913+0000 7fa9e7fff640 1 -- 172.21.15.82:0/1891336079 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7fa9f808b260 con 0x7faa0015e380 2024-06-02T22:52:50.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.913+0000 7fa9feffd640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa9ec06be30 0x7fa9ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:50.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.913+0000 7fa9feffd640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa9ec06be30 0x7fa9ec06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00070b0 tx=0x7fa9f0007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:50.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:50.917+0000 7fa9e7fff640 1 -- 172.21.15.82:0/1891336079 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa9f8059c10 con 0x7faa0015e380 2024-06-02T22:52:51.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.092+0000 7faa0581c640 1 -- 172.21.15.82:0/1891336079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7faa000b3f40 con 0x7faa0015e380 2024-06-02T22:52:51.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.785+0000 7fa9e7fff640 1 -- 172.21.15.82:0/1891336079 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7fa9f8059510 con 0x7faa0015e380 2024-06-02T22:52:51.785 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data_ec' removed 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.788+0000 7faa0581c640 1 -- 172.21.15.82:0/1891336079 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa9ec06be30 msgr2=0x7fa9ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.788+0000 7faa0581c640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa9ec06be30 0x7fa9ec06e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00070b0 tx=0x7fa9f0007040 comp rx=0 tx=0).stop 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.789+0000 7faa0581c640 1 -- 172.21.15.82:0/1891336079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0015e380 msgr2=0x7faa0014e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.789+0000 7faa0581c640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0015e380 0x7faa0014e160 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800d5c0 tx=0x7fa9f800da80 comp rx=0 tx=0).stop 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.789+0000 7faa0581c640 1 -- 172.21.15.82:0/1891336079 shutdown_connections 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.789+0000 7faa0581c640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa9ec06be30 0x7fa9ec06e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.789+0000 7faa0581c640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0015e380 0x7faa0014e160 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.789+0000 7faa0581c640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa000b4430 0x7faa000c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.789+0000 7faa0581c640 1 --2- 172.21.15.82:0/1891336079 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa00070510 0x7faa000b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.789+0000 7faa0581c640 1 -- 172.21.15.82:0/1891336079 >> 172.21.15.82:0/1891336079 conn(0x7faa000b3910 msgr2=0x7faa0006d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.789+0000 7faa0581c640 1 -- 172.21.15.82:0/1891336079 shutdown_connections 2024-06-02T22:52:51.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.789+0000 7faa0581c640 1 -- 172.21.15.82:0/1891336079 wait complete. 2024-06-02T22:52:51.801 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-02T22:52:51.802 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-02T22:52:51.802 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-02T22:52:51.802 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:52:51.802 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-02T22:52:51.802 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-02T22:52:51.802 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-02T22:52:51.802 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:52:51.803 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-02T22:52:51.803 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-02T22:52:51.803 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-02T22:52:51.803 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:52:51.803 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-02T22:52:51.803 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-02T22:52:51.803 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-02T22:52:51.804 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:52:51.813 INFO:tasks.ceph.mds.a:Stopped 2024-06-02T22:52:51.813 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-02T22:52:51.814 INFO:tasks.ceph.mds.c:Stopped 2024-06-02T22:52:51.814 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-02T22:52:51.815 INFO:tasks.ceph.mds.b:Stopped 2024-06-02T22:52:51.815 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-02T22:52:51.816 INFO:tasks.ceph.mds.d:Stopped 2024-06-02T22:52:51.816 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-02T22:52:51.855 INFO:tasks.ceph.mds.a:Started 2024-06-02T22:52:51.855 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:51.856 INFO:tasks.ceph.mds.c:Started 2024-06-02T22:52:51.857 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:51.858 INFO:tasks.ceph.mds.b:Started 2024-06-02T22:52:51.858 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:51.858 INFO:tasks.ceph.mds.d:Started 2024-06-02T22:52:51.858 DEBUG:teuthology.parallel:result is None 2024-06-02T22:52:51.859 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-02T22:52:51.931 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2024-06-02T22:52:51.931 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2024-06-02T22:52:51.939 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2024-06-02T22:52:51.939 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2024-06-02T22:52:51.940 INFO:tasks.ceph.mds.b.smithi184.stderr:2024-06-02T22:52:51.940+0000 7f52a6c11640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6834/0: (98) Address already in use 2024-06-02T22:52:51.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.963+0000 7f3432529640 1 Processor -- start 2024-06-02T22:52:51.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.963+0000 7f3432529640 1 -- start start 2024-06-02T22:52:51.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.964+0000 7f3432529640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f342c0d1fc0 0x7f342c0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:51.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.964+0000 7f3432529640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342c15f5e0 con 0x7f342c0d2680 2024-06-02T22:52:51.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.964+0000 7f3432529640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342c0d2450 con 0x7f342c15f1a0 2024-06-02T22:52:51.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.964+0000 7f3432529640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f342c0d13e0 con 0x7f342c0d1fc0 2024-06-02T22:52:51.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.964+0000 7f342bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f342c0d2680 0x7f342c0d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50524/0 (socket says 172.21.15.82:50524) 2024-06-02T22:52:51.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.964+0000 7f342bfff640 1 -- 172.21.15.82:0/854890030 learned_addr learned my addr 172.21.15.82:0/854890030 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.964+0000 7f3430ac6640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f342c0d1fc0 0x7f342c0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.964+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678156225 0 0) 0x7f342c15f5e0 con 0x7f342c0d2680 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.964+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3414003520 con 0x7f342c0d2680 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4214927487 0 0) 0x7f342c0d2450 con 0x7f342c15f1a0 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f342c15f5e0 con 0x7f342c15f1a0 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1317114904 0 0) 0x7f3414003520 con 0x7f342c0d2680 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f342c0d1fc0 msgr2=0x7f342c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f342c0d1fc0 0x7f342c0cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 >> v1:172.21.15.184:6789/0 conn(0x7f342c15f1a0 legacy=0x7f342c0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342c0d0ad0 con 0x7f342c0d2680 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f341c001670 con 0x7f342c0d2680 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 >> v1:172.21.15.82:6789/0 conn(0x7f342c0d2680 legacy=0x7f342c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3414003b70 0x7f3414003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3414004800 0x7f3414004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f342c0d1fc0 0x7f34140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f342c0d13e0 con 0x7f3414004800 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f341400ba70 con 0x7f3414003b70 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f341400bc40 con 0x7f342c0d1fc0 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342b7fe640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3414004800 0x7f3414004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342bfff640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3414003b70 0x7f3414003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f3430ac6640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f342c0d1fc0 0x7f34140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342b7fe640 1 -- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f342c0d1fc0 msgr2=0x7f34140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342b7fe640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f342c0d1fc0 0x7f34140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342b7fe640 1 -- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3414003b70 msgr2=0x7f3414003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342b7fe640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3414003b70 0x7f3414003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342b7fe640 1 -- 172.21.15.82:0/854890030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3414003520 con 0x7f3414004800 2024-06-02T22:52:51.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.965+0000 7f342bfff640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3414003b70 0x7f3414003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.966+0000 7f342b7fe640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3414004800 0x7f3414004c80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f34200018d0 tx=0x7f3414005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d40b6cc52629bb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.966+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34200014f0 con 0x7f3414004800 2024-06-02T22:52:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.966+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34200052d0 con 0x7f3414004800 2024-06-02T22:52:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.966+0000 7f342affd640 1 -- 172.21.15.82:0/854890030 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342002ac30 con 0x7f3414004800 2024-06-02T22:52:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.966+0000 7f3432529640 1 -- 172.21.15.82:0/854890030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3414004800 msgr2=0x7f3414004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.966+0000 7f3432529640 1 --2- 172.21.15.82:0/854890030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3414004800 0x7f3414004c80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f34200018d0 tx=0x7f3414005830 comp rx=0 tx=0).stop 2024-06-02T22:52:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.966+0000 7f3430ac6640 1 -- 172.21.15.82:0/854890030 reap_dead start 2024-06-02T22:52:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.966+0000 7f3432529640 1 -- 172.21.15.82:0/854890030 shutdown_connections 2024-06-02T22:52:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.967+0000 7f3432529640 1 -- 172.21.15.82:0/854890030 >> 172.21.15.82:0/854890030 conn(0x7f342c09d3f0 msgr2=0x7f342c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.967+0000 7f3432529640 1 -- 172.21.15.82:0/854890030 shutdown_connections 2024-06-02T22:52:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.967+0000 7f3432529640 1 -- 172.21.15.82:0/854890030 wait complete. 2024-06-02T22:52:51.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.968+0000 7f3432529640 1 Processor -- start 2024-06-02T22:52:51.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.968+0000 7f3432529640 1 -- start start 2024-06-02T22:52:51.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3432529640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3414004800 0x7f342c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:51.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3432529640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f342c0cce10 0x7f342c1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:51.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3432529640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f342c0cd430 0x7f342c160e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:51.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3432529640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f342c0d1070 con 0x7f342c0cce10 2024-06-02T22:52:51.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3432529640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f342c0d0d90 con 0x7f342c0cd430 2024-06-02T22:52:51.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3432529640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f342c0d4f00 con 0x7f3414004800 2024-06-02T22:52:51.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f342b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f342c0cce10 0x7f342c1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:51.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f342b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f342c0cce10 0x7f342c1527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40052/0 (socket says 172.21.15.82:40052) 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f342b7fe640 1 -- 172.21.15.82:0/2251123309 learned_addr learned my addr 172.21.15.82:0/2251123309 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f342bfff640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3414004800 0x7f342c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3430ac6640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f342c0cd430 0x7f342c160e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f342b7fe640 1 -- 172.21.15.82:0/2251123309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3414004800 msgr2=0x7f342c0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f342b7fe640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3414004800 0x7f342c0cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f342b7fe640 1 -- 172.21.15.82:0/2251123309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f342c0cd430 msgr2=0x7f342c160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f342b7fe640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f342c0cd430 0x7f342c160e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f342b7fe640 1 -- 172.21.15.82:0/2251123309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342c0cddf0 con 0x7f342c0cce10 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f342b7fe640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f342c0cce10 0x7f342c1527b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f34200018d0 tx=0x7f34200012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3428ff9640 1 -- 172.21.15.82:0/2251123309 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342003f020 con 0x7f342c0cce10 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3428ff9640 1 -- 172.21.15.82:0/2251123309 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3420006e50 con 0x7f342c0cce10 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3432529640 1 -- 172.21.15.82:0/2251123309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f342c0cb3a0 con 0x7f342c0cce10 2024-06-02T22:52:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3432529640 1 -- 172.21.15.82:0/2251123309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f342c0cb960 con 0x7f342c0cce10 2024-06-02T22:52:51.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.969+0000 7f3428ff9640 1 -- 172.21.15.82:0/2251123309 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420037040 con 0x7f342c0cce10 2024-06-02T22:52:51.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.971+0000 7f3432529640 1 -- 172.21.15.82:0/2251123309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342c068430 con 0x7f342c0cce10 2024-06-02T22:52:51.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.971+0000 7f3428ff9640 1 -- 172.21.15.82:0/2251123309 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3420042020 con 0x7f342c0cce10 2024-06-02T22:52:51.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.971+0000 7f3428ff9640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f341806be30 0x7f341806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:51.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.972+0000 7f3428ff9640 1 -- 172.21.15.82:0/2251123309 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5335+0+0 (secure 0 0 0) 0x7f34200aa6f0 con 0x7f342c0cce10 2024-06-02T22:52:51.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.972+0000 7f342bfff640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f341806be30 0x7f341806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:51.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.972+0000 7f342bfff640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f341806be30 0x7f341806e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f342c161ae0 tx=0x7f341c001e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:51.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:51.976+0000 7f3428ff9640 1 -- 172.21.15.82:0/2251123309 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3420049030 con 0x7f342c0cce10 2024-06-02T22:52:52.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.163+0000 7f3432529640 1 -- 172.21.15.82:0/2251123309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f342c0d04e0 con 0x7f342c0cce10 2024-06-02T22:52:52.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.805+0000 7f3428ff9640 1 -- 172.21.15.82:0/2251123309 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) ==== 97+0+0 (secure 0 0 0) 0x7f34200aa070 con 0x7f342c0cce10 2024-06-02T22:52:52.805 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2024-06-02T22:52:52.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.807+0000 7f3432529640 1 -- 172.21.15.82:0/2251123309 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f341806be30 msgr2=0x7f341806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:52.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.807+0000 7f3432529640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f341806be30 0x7f341806e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f342c161ae0 tx=0x7f341c001e40 comp rx=0 tx=0).stop 2024-06-02T22:52:52.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.807+0000 7f3432529640 1 -- 172.21.15.82:0/2251123309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f342c0cce10 msgr2=0x7f342c1527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:52.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.807+0000 7f3432529640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f342c0cce10 0x7f342c1527b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f34200018d0 tx=0x7f34200012d0 comp rx=0 tx=0).stop 2024-06-02T22:52:52.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.808+0000 7f3432529640 1 -- 172.21.15.82:0/2251123309 shutdown_connections 2024-06-02T22:52:52.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.808+0000 7f3432529640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f341806be30 0x7f341806e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:52.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.808+0000 7f3432529640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f342c0cd430 0x7f342c160e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:52.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.808+0000 7f3432529640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f342c0cce10 0x7f342c1527b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:52.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.808+0000 7f3432529640 1 --2- 172.21.15.82:0/2251123309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3414004800 0x7f342c0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:52.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.808+0000 7f3432529640 1 -- 172.21.15.82:0/2251123309 >> 172.21.15.82:0/2251123309 conn(0x7f342c09d3f0 msgr2=0x7f342c06d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:52.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.808+0000 7f3432529640 1 -- 172.21.15.82:0/2251123309 shutdown_connections 2024-06-02T22:52:52.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.808+0000 7f3432529640 1 -- 172.21.15.82:0/2251123309 wait complete. 2024-06-02T22:52:52.827 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-02T22:52:52.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.929+0000 7f1558714640 1 Processor -- start 2024-06-02T22:52:52.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.929+0000 7f1558714640 1 -- start start 2024-06-02T22:52:52.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.930+0000 7f1558714640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15500d2680 0x7f155015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:52.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.930+0000 7f1558714640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15500d0ad0 con 0x7f15500d1fc0 2024-06-02T22:52:52.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.930+0000 7f1558714640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f155015f890 con 0x7f15500cef70 2024-06-02T22:52:52.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.930+0000 7f1558714640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f15500d13e0 con 0x7f15500d2680 2024-06-02T22:52:52.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.930+0000 7f15564b0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15500d2680 0x7f155015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:52.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.931+0000 7f15564b0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15500d2680 0x7f155015f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40066/0 (socket says 172.21.15.82:40066) 2024-06-02T22:52:52.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.931+0000 7f15564b0640 1 -- 172.21.15.82:0/348634773 learned_addr learned my addr 172.21.15.82:0/348634773 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:52.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.931+0000 7f15564b0640 1 -- 172.21.15.82:0/348634773 >> v1:172.21.15.184:6789/0 conn(0x7f15500cef70 legacy=0x7f15500cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:52.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.931+0000 7f15564b0640 1 -- 172.21.15.82:0/348634773 >> v1:172.21.15.82:6789/0 conn(0x7f15500d1fc0 legacy=0x7f15500d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:52.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.931+0000 7f15554ae640 1 -- 172.21.15.82:0/348634773 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1619010325 0 0) 0x7f15500d0ad0 con 0x7f15500d1fc0 2024-06-02T22:52:52.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.931+0000 7f15564b0640 1 -- 172.21.15.82:0/348634773 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15500d0d90 con 0x7f15500d2680 2024-06-02T22:52:52.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.931+0000 7f15564b0640 1 --2- 172.21.15.82:0/348634773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15500d2680 0x7f155015f1a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f15500d1560 tx=0x7f154802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86aa48619045265c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:52.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.932+0000 7f15554ae640 1 -- 172.21.15.82:0/348634773 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548037070 con 0x7f15500d2680 2024-06-02T22:52:52.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.932+0000 7f15554ae640 1 -- 172.21.15.82:0/348634773 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1548032440 con 0x7f15500d2680 2024-06-02T22:52:52.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.932+0000 7f15554ae640 1 -- 172.21.15.82:0/348634773 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548032810 con 0x7f15500d2680 2024-06-02T22:52:52.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.932+0000 7f1558714640 1 -- 172.21.15.82:0/348634773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15500d2680 msgr2=0x7f155015f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:52.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.932+0000 7f1558714640 1 --2- 172.21.15.82:0/348634773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15500d2680 0x7f155015f1a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f15500d1560 tx=0x7f154802a290 comp rx=0 tx=0).stop 2024-06-02T22:52:52.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.932+0000 7f1558714640 1 -- 172.21.15.82:0/348634773 shutdown_connections 2024-06-02T22:52:52.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.932+0000 7f1558714640 1 --2- 172.21.15.82:0/348634773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15500d2680 0x7f155015f1a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:52.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.932+0000 7f1558714640 1 -- 172.21.15.82:0/348634773 >> 172.21.15.82:0/348634773 conn(0x7f155009d3f0 msgr2=0x7f15500d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:52.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.932+0000 7f1558714640 1 -- 172.21.15.82:0/348634773 shutdown_connections 2024-06-02T22:52:52.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.932+0000 7f1558714640 1 -- 172.21.15.82:0/348634773 wait complete. 2024-06-02T22:52:52.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.933+0000 7f1558714640 1 Processor -- start 2024-06-02T22:52:52.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.933+0000 7f1558714640 1 -- start start 2024-06-02T22:52:52.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f1558714640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15500cef70 0x7f15500b9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:52.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f1558714640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15500d1fc0 0x7f15501f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:52.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f1558714640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15500d2680 0x7f15501f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:52.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f1558714640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15500d4f00 con 0x7f15500cef70 2024-06-02T22:52:52.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f1558714640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15500d2400 con 0x7f15500d1fc0 2024-06-02T22:52:52.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f1558714640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f15500d1870 con 0x7f15500d2680 2024-06-02T22:52:52.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f15564b0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15500cef70 0x7f15500b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f15564b0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15500cef70 0x7f15500b9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40076/0 (socket says 172.21.15.82:40076) 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f15564b0640 1 -- 172.21.15.82:0/2487189974 learned_addr learned my addr 172.21.15.82:0/2487189974 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f1555caf640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15500d1fc0 0x7f15501f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f1556cb1640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15500d2680 0x7f15501f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f15564b0640 1 -- 172.21.15.82:0/2487189974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15500d2680 msgr2=0x7f15501f8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.934+0000 7f15564b0640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15500d2680 0x7f15501f8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.935+0000 7f15564b0640 1 -- 172.21.15.82:0/2487189974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15500d1fc0 msgr2=0x7f15501f7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.935+0000 7f15564b0640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15500d1fc0 0x7f15501f7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.935+0000 7f15564b0640 1 -- 172.21.15.82:0/2487189974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15500b80d0 con 0x7f15500cef70 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.935+0000 7f1556cb1640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15500d2680 0x7f15501f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.935+0000 7f15564b0640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15500cef70 0x7f15500b9170 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1548000c00 tx=0x7f15480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.935+0000 7f154effd640 1 -- 172.21.15.82:0/2487189974 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548041070 con 0x7f15500cef70 2024-06-02T22:52:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.935+0000 7f154effd640 1 -- 172.21.15.82:0/2487189974 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154803c870 con 0x7f15500cef70 2024-06-02T22:52:52.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.935+0000 7f154effd640 1 -- 172.21.15.82:0/2487189974 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548037040 con 0x7f15500cef70 2024-06-02T22:52:52.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.935+0000 7f1558714640 1 -- 172.21.15.82:0/2487189974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15500b83b0 con 0x7f15500cef70 2024-06-02T22:52:52.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.935+0000 7f1558714640 1 -- 172.21.15.82:0/2487189974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15500b8970 con 0x7f15500cef70 2024-06-02T22:52:52.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.936+0000 7f1558714640 1 -- 172.21.15.82:0/2487189974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1550068430 con 0x7f15500cef70 2024-06-02T22:52:52.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.936+0000 7f154effd640 1 -- 172.21.15.82:0/2487189974 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1548044070 con 0x7f15500cef70 2024-06-02T22:52:52.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.937+0000 7f154effd640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f153c06be30 0x7f153c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:52.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.937+0000 7f154effd640 1 -- 172.21.15.82:0/2487189974 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f15480aba00 con 0x7f15500cef70 2024-06-02T22:52:52.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.937+0000 7f1555caf640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f153c06be30 0x7f153c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:52.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.937+0000 7f1555caf640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f153c06be30 0x7f153c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1550152a70 tx=0x7f1544009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:52.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:52.941+0000 7f154effd640 1 -- 172.21.15.82:0/2487189974 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f154807a720 con 0x7f15500cef70 2024-06-02T22:52:53.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.187+0000 7f1558714640 1 -- 172.21.15.82:0/2487189974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f15500d04e0 con 0x7f15500cef70 2024-06-02T22:52:53.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.188+0000 7f154effd640 1 -- 172.21.15.82:0/2487189974 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f154807a020 con 0x7f15500cef70 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xm0JTKCBAAndEAxOeEeclgFu+ITHYS5g==", 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmuZhxFRAA/Sj+Z2Hh0XmmMLB27h+SgA==", 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmYVVpEBAA+49UXndP6JiF1dcwkBFqlw==", 2024-06-02T22:52:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmf4THHBAAXUhfYk2mRNxtPj5B4HHVZQ==", 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-06-02T22:52:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBd91xmEasoOhAAn6YZXmsI4CVreLyIC30o4Q==", 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBg91xmJdkfORAA0rRjyHkrw/mK6gUgZvQNBA==", 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBj91xmeTPxNhAAooQjxmZuy8trF6vOdHJTiA==", 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:52:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBm91xmcjbGNRAAuvxHJk3NYqJ6qFVwfN4pTg==", 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2024-06-02T22:52:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBs91xmCHjaORAA3dKnGKAZH64lFFq2rkReiA==", 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBv91xmaeZ7OBAAs12vs2Jp8AB/3/Pjp3fHEQ==", 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:52:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBy91xmTfXNNhAAXYTITs5gu0klkjGHWW4s2Q==", 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2024-06-02T22:52:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQB191xm/2M9NRAAg194AhFY+9WbbJ/9DufSMw==", 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g==", 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2024-06-02T22:52:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmDhLEKRAA9fyng5JM+1I/MYHEX3ITgw==", 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xm352MJhAAEMeMOG4RTRYcbQU3S3v2MA==", 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmxPxRLxAAO6UAflCnHzmvq4DrYZfTKg==", 2024-06-02T22:52:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBZ91xm3be1JBAA4askgNcaQ2jlpYOcLYeQAQ==", 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-06-02T22:52:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-mds", 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQB791xmfAA9KRAAePxQBfrh1DW2zg9+yJnYvg==", 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-mds" 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-mgr", 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQB791xm/gg9KRAAvkAVS4hLKcei+4HFgjZKcw==", 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-mgr" 2024-06-02T22:52:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-osd", 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQB791xm2RA9KRAAlWrX0kgx7tGbQsniW/mIHA==", 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-osd" 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rbd", 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQB791xmpxc9KRAAJ7gmnFh1hsEzN0znO4ahTA==", 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rbd" 2024-06-02T22:52:53.201 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQB791xm7x49KRAAqe/aGLyebCH5YE+71ScGbg==", 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rgw", 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQB791xmaSY9KRAA6nsUvvZvio5pkusuVoU7lg==", 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.202 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rgw" 2024-06-02T22:52:53.203 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.203 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2024-06-02T22:52:53.203 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xm8/dxBRAAav4Fr7WoUlsnw8abkaZlTA==", 2024-06-02T22:52:53.203 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.203 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2024-06-02T22:52:53.203 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2024-06-02T22:52:53.203 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.203 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmnhQdARAAmNiCMML2eHb0wcNAW45Fyw==", 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-02T22:52:53.204 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:52:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 -- 172.21.15.82:0/2487189974 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f153c06be30 msgr2=0x7f153c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f153c06be30 0x7f153c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1550152a70 tx=0x7f1544009040 comp rx=0 tx=0).stop 2024-06-02T22:52:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 -- 172.21.15.82:0/2487189974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15500cef70 msgr2=0x7f15500b9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15500cef70 0x7f15500b9170 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1548000c00 tx=0x7f15480046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 -- 172.21.15.82:0/2487189974 shutdown_connections 2024-06-02T22:52:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f153c06be30 0x7f153c06e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15500d2680 0x7f15501f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15500d1fc0 0x7f15501f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 --2- 172.21.15.82:0/2487189974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15500cef70 0x7f15500b9170 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 -- 172.21.15.82:0/2487189974 >> 172.21.15.82:0/2487189974 conn(0x7f155009d3f0 msgr2=0x7f15500cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:53.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 -- 172.21.15.82:0/2487189974 shutdown_connections 2024-06-02T22:52:53.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.190+0000 7f1558714640 1 -- 172.21.15.82:0/2487189974 wait complete. 2024-06-02T22:52:53.207 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-06-02T22:52:53.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.309+0000 7f0f25bce640 1 Processor -- start 2024-06-02T22:52:53.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.310+0000 7f0f25bce640 1 -- start start 2024-06-02T22:52:53.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.310+0000 7f0f25bce640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0f2009aa10 0x7f0f2009aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.310+0000 7f0f25bce640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2015c550 0x7f0f2015c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.310+0000 7f0f25bce640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2015cf20 con 0x7f0f20159d80 2024-06-02T22:52:53.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.310+0000 7f0f25bce640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f0f200b50c0 con 0x7f0f2009aa10 2024-06-02T22:52:53.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.310+0000 7f0f25bce640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2015d1a0 con 0x7f0f2015c550 2024-06-02T22:52:53.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.311+0000 7f0f1effd640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0f2009aa10 0x7f0f2009aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.311+0000 7f0f1ffff640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2015c550 0x7f0f2015c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.311+0000 7f0f1effd640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0f2009aa10 0x7f0f2009aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:54460/0 (socket says 172.21.15.82:54460) 2024-06-02T22:52:53.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.311+0000 7f0f1effd640 1 -- 172.21.15.82:0/4173431047 learned_addr learned my addr 172.21.15.82:0/4173431047 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:53.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.311+0000 7f0f1f7fe640 1 --1- 172.21.15.82:0/4173431047 >> v1:172.21.15.184:6789/0 conn(0x7f0f20159d80 0x7f0f200d2680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:59210/0 (socket says 172.21.15.82:59210) 2024-06-02T22:52:53.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.311+0000 7f0f1effd640 1 -- 172.21.15.82:0/4173431047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2015c550 msgr2=0x7f0f2015c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:53.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.311+0000 7f0f1effd640 1 --2- 172.21.15.82:0/4173431047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2015c550 0x7f0f2015c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.311+0000 7f0f1effd640 1 -- 172.21.15.82:0/4173431047 >> v1:172.21.15.184:6789/0 conn(0x7f0f20159d80 legacy=0x7f0f200d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.311+0000 7f0f1effd640 1 -- 172.21.15.82:0/4173431047 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2015d480 con 0x7f0f2009aa10 2024-06-02T22:52:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.312+0000 7f0f1effd640 1 --2- 172.21.15.82:0/4173431047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2009aa10 0x7f0f2009aec0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f140098a0 tx=0x7f0f1402a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63d2f4144de2786b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.312+0000 7f0f1e7fc640 1 -- 172.21.15.82:0/4173431047 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14037070 con 0x7f0f2009aa10 2024-06-02T22:52:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.312+0000 7f0f1e7fc640 1 -- 172.21.15.82:0/4173431047 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f14032440 con 0x7f0f2009aa10 2024-06-02T22:52:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.312+0000 7f0f1e7fc640 1 -- 172.21.15.82:0/4173431047 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14032810 con 0x7f0f2009aa10 2024-06-02T22:52:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.313+0000 7f0f25bce640 1 -- 172.21.15.82:0/4173431047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2009aa10 msgr2=0x7f0f2009aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.313+0000 7f0f25bce640 1 --2- 172.21.15.82:0/4173431047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2009aa10 0x7f0f2009aec0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f140098a0 tx=0x7f0f1402a200 comp rx=0 tx=0).stop 2024-06-02T22:52:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.313+0000 7f0f25bce640 1 -- 172.21.15.82:0/4173431047 shutdown_connections 2024-06-02T22:52:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.313+0000 7f0f25bce640 1 --2- 172.21.15.82:0/4173431047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2015c550 0x7f0f2015c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.313+0000 7f0f25bce640 1 --2- 172.21.15.82:0/4173431047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2009aa10 0x7f0f2009aec0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.313+0000 7f0f25bce640 1 -- 172.21.15.82:0/4173431047 >> 172.21.15.82:0/4173431047 conn(0x7f0f200b7270 msgr2=0x7f0f200b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:53.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.313+0000 7f0f25bce640 1 -- 172.21.15.82:0/4173431047 shutdown_connections 2024-06-02T22:52:53.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.313+0000 7f0f25bce640 1 -- 172.21.15.82:0/4173431047 wait complete. 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.314+0000 7f0f25bce640 1 Processor -- start 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.314+0000 7f0f25bce640 1 -- start start 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f25bce640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2009aa10 0x7f0f2014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f25bce640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2015c550 0x7f0f2009e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f25bce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f2009eb90 0x7f0f201582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f25bce640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f200d2160 con 0x7f0f2009eb90 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f25bce640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0f200d1e80 con 0x7f0f2015c550 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f25bce640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0f200b1d20 con 0x7f0f2009aa10 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f1ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f2009eb90 0x7f0f201582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f1ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f2009eb90 0x7f0f201582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40090/0 (socket says 172.21.15.82:40090) 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f1ffff640 1 -- 172.21.15.82:0/3565625794 learned_addr learned my addr 172.21.15.82:0/3565625794 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f1effd640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2015c550 0x7f0f2009e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f1f7fe640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2009aa10 0x7f0f2014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f1ffff640 1 -- 172.21.15.82:0/3565625794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2009aa10 msgr2=0x7f0f2014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f1ffff640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2009aa10 0x7f0f2014a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f1ffff640 1 -- 172.21.15.82:0/3565625794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2015c550 msgr2=0x7f0f2009e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f1ffff640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2015c550 0x7f0f2009e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f1ffff640 1 -- 172.21.15.82:0/3565625794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f20159030 con 0x7f0f2009eb90 2024-06-02T22:52:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.315+0000 7f0f1ffff640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f2009eb90 0x7f0f201582d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800efc0 tx=0x7f0f1800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.316+0000 7f0f07fff640 1 -- 172.21.15.82:0/3565625794 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18018020 con 0x7f0f2009eb90 2024-06-02T22:52:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.316+0000 7f0f07fff640 1 -- 172.21.15.82:0/3565625794 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f18014480 con 0x7f0f2009eb90 2024-06-02T22:52:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.316+0000 7f0f07fff640 1 -- 172.21.15.82:0/3565625794 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18014870 con 0x7f0f2009eb90 2024-06-02T22:52:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.316+0000 7f0f25bce640 1 -- 172.21.15.82:0/3565625794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2009c050 con 0x7f0f2009eb90 2024-06-02T22:52:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.316+0000 7f0f25bce640 1 -- 172.21.15.82:0/3565625794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f2009c610 con 0x7f0f2009eb90 2024-06-02T22:52:53.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.317+0000 7f0f05ffb640 1 -- 172.21.15.82:0/3565625794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef8005290 con 0x7f0f2009eb90 2024-06-02T22:52:53.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.317+0000 7f0f07fff640 1 -- 172.21.15.82:0/3565625794 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f18005d10 con 0x7f0f2009eb90 2024-06-02T22:52:53.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.318+0000 7f0f07fff640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f0c06be60 0x7f0f0c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.318+0000 7f0f1f7fe640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f0c06be60 0x7f0f0c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.318+0000 7f0f07fff640 1 -- 172.21.15.82:0/3565625794 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f0f1808b610 con 0x7f0f2009eb90 2024-06-02T22:52:53.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.318+0000 7f0f1f7fe640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f0c06be60 0x7f0f0c06e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f10007fd0 tx=0x7f0f10007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:53.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.322+0000 7f0f07fff640 1 -- 172.21.15.82:0/3565625794 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0f18022070 con 0x7f0f2009eb90 2024-06-02T22:52:53.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.570+0000 7f0f05ffb640 1 -- 172.21.15.82:0/3565625794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f0ef8005850 con 0x7f0f2009eb90 2024-06-02T22:52:53.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.572+0000 7f0f07fff640 1 -- 172.21.15.82:0/3565625794 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f0f18010040 con 0x7f0f2009eb90 2024-06-02T22:52:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 -- 172.21.15.82:0/3565625794 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f0c06be60 msgr2=0x7f0f0c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f0c06be60 0x7f0f0c06e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f10007fd0 tx=0x7f0f10007e80 comp rx=0 tx=0).stop 2024-06-02T22:52:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 -- 172.21.15.82:0/3565625794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f2009eb90 msgr2=0x7f0f201582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f2009eb90 0x7f0f201582d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800efc0 tx=0x7f0f1800c490 comp rx=0 tx=0).stop 2024-06-02T22:52:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 -- 172.21.15.82:0/3565625794 shutdown_connections 2024-06-02T22:52:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f0c06be60 0x7f0f0c06e320 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f2009eb90 0x7f0f201582d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2015c550 0x7f0f2009e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 --2- 172.21.15.82:0/3565625794 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2009aa10 0x7f0f2014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 -- 172.21.15.82:0/3565625794 >> 172.21.15.82:0/3565625794 conn(0x7f0f200b7270 msgr2=0x7f0f2015d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 -- 172.21.15.82:0/3565625794 shutdown_connections 2024-06-02T22:52:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.575+0000 7f0f05ffb640 1 -- 172.21.15.82:0/3565625794 wait complete. 2024-06-02T22:52:53.586 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-06-02T22:52:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.689+0000 7ff26e714640 1 Processor -- start 2024-06-02T22:52:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.689+0000 7ff26e714640 1 -- start start 2024-06-02T22:52:53.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.689+0000 7ff26e714640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff2680d2680 0x7ff26815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.689+0000 7ff26e714640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2680d0ad0 con 0x7ff2680d1fc0 2024-06-02T22:52:53.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.689+0000 7ff26e714640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff26815f890 con 0x7ff2680cef70 2024-06-02T22:52:53.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.689+0000 7ff26e714640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7ff2680d13e0 con 0x7ff2680d2680 2024-06-02T22:52:53.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff2677fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff2680d1fc0 0x7ff2680d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50538/0 (socket says 172.21.15.82:50538) 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff2677fe640 1 -- 172.21.15.82:0/507171428 learned_addr learned my addr 172.21.15.82:0/507171428 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff267fff640 1 --2- 172.21.15.82:0/507171428 >> v2:172.21.15.184:3300/0 conn(0x7ff2680d2680 0x7ff26815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315704828 0 0) 0x7ff2680d0ad0 con 0x7ff2680d1fc0 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff250003520 con 0x7ff2680d1fc0 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4066116754 0 0) 0x7ff250003520 con 0x7ff2680d1fc0 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 >> v2:172.21.15.184:3300/0 conn(0x7ff2680d2680 msgr2=0x7ff26815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 --2- 172.21.15.82:0/507171428 >> v2:172.21.15.184:3300/0 conn(0x7ff2680d2680 0x7ff26815f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 >> v1:172.21.15.184:6789/0 conn(0x7ff2680cef70 legacy=0x7ff2680cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2680d0d90 con 0x7ff2680d1fc0 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7ff25c001670 con 0x7ff2680d1fc0 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 >> v1:172.21.15.82:6789/0 conn(0x7ff2680d1fc0 legacy=0x7ff2680d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 --2- 172.21.15.82:0/507171428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2500039b0 0x7ff250003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 --2- 172.21.15.82:0/507171428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff250004800 0x7ff250004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 --2- 172.21.15.82:0/507171428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2500051c0 0x7ff25000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2680d13e0 con 0x7ff2500039b0 2024-06-02T22:52:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff25000c060 con 0x7ff250004800 2024-06-02T22:52:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff25000c260 con 0x7ff2500051c0 2024-06-02T22:52:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff267fff640 1 --2- 172.21.15.82:0/507171428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2500039b0 0x7ff250003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.690+0000 7ff2677fe640 1 --2- 172.21.15.82:0/507171428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff250004800 0x7ff250004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.691+0000 7ff267fff640 1 -- 172.21.15.82:0/507171428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2500051c0 msgr2=0x7ff25000b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:52:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.691+0000 7ff267fff640 1 --2- 172.21.15.82:0/507171428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2500051c0 0x7ff25000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.691+0000 7ff267fff640 1 -- 172.21.15.82:0/507171428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff250004800 msgr2=0x7ff250004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.691+0000 7ff267fff640 1 --2- 172.21.15.82:0/507171428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff250004800 0x7ff250004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.691+0000 7ff26ccb1640 1 -- 172.21.15.82:0/507171428 reap_dead start 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.691+0000 7ff267fff640 1 -- 172.21.15.82:0/507171428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff250003520 con 0x7ff2500039b0 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.691+0000 7ff267fff640 1 --2- 172.21.15.82:0/507171428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2500039b0 0x7ff250003dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff258009ac0 tx=0x7ff250005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6fc9a4568028f5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.691+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258036070 con 0x7ff2500039b0 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.692+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff258031400 con 0x7ff2500039b0 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.692+0000 7ff266ffd640 1 -- 172.21.15.82:0/507171428 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258009690 con 0x7ff2500039b0 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.692+0000 7ff26e714640 1 -- 172.21.15.82:0/507171428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2500039b0 msgr2=0x7ff250003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.692+0000 7ff26e714640 1 --2- 172.21.15.82:0/507171428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2500039b0 0x7ff250003dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff258009ac0 tx=0x7ff250005830 comp rx=0 tx=0).stop 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.692+0000 7ff26e714640 1 -- 172.21.15.82:0/507171428 shutdown_connections 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.692+0000 7ff26e714640 1 --2- 172.21.15.82:0/507171428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2500039b0 0x7ff250003dd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.692+0000 7ff26e714640 1 -- 172.21.15.82:0/507171428 >> 172.21.15.82:0/507171428 conn(0x7ff26809d3f0 msgr2=0x7ff2680d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.692+0000 7ff26e714640 1 -- 172.21.15.82:0/507171428 shutdown_connections 2024-06-02T22:52:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.692+0000 7ff26e714640 1 -- 172.21.15.82:0/507171428 wait complete. 2024-06-02T22:52:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.693+0000 7ff26e714640 1 Processor -- start 2024-06-02T22:52:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.694+0000 7ff26e714640 1 -- start start 2024-06-02T22:52:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.694+0000 7ff26e714640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2500039b0 0x7ff2680cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.694+0000 7ff26e714640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2680b9190 0x7ff26814da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.694+0000 7ff26e714640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2680b9610 0x7ff26814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.694+0000 7ff26e714640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2680d4f00 con 0x7ff2680b9610 2024-06-02T22:52:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.694+0000 7ff26e714640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff2680d2400 con 0x7ff2500039b0 2024-06-02T22:52:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.694+0000 7ff26e714640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff2680d1870 con 0x7ff2680b9190 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.694+0000 7ff26ccb1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2680b9610 0x7ff26814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.694+0000 7ff26ccb1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2680b9610 0x7ff26814abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40114/0 (socket says 172.21.15.82:40114) 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.694+0000 7ff26ccb1640 1 -- 172.21.15.82:0/1516127495 learned_addr learned my addr 172.21.15.82:0/1516127495 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff267fff640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2500039b0 0x7ff2680cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff2677fe640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2680b9190 0x7ff26814da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff26ccb1640 1 -- 172.21.15.82:0/1516127495 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2680b9190 msgr2=0x7ff26814da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff26ccb1640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2680b9190 0x7ff26814da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff26ccb1640 1 -- 172.21.15.82:0/1516127495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2500039b0 msgr2=0x7ff2680cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff26ccb1640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2500039b0 0x7ff2680cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff26ccb1640 1 -- 172.21.15.82:0/1516127495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2680cc0e0 con 0x7ff2680b9610 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff2677fe640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2680b9190 0x7ff26814da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff26ccb1640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2680b9610 0x7ff26814abe0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff2680d1c40 tx=0x7ff26000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff264ff9640 1 -- 172.21.15.82:0/1516127495 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260017070 con 0x7ff2680b9610 2024-06-02T22:52:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff264ff9640 1 -- 172.21.15.82:0/1516127495 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2600070d0 con 0x7ff2680b9610 2024-06-02T22:52:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff26e714640 1 -- 172.21.15.82:0/1516127495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26814e520 con 0x7ff2680b9610 2024-06-02T22:52:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff264ff9640 1 -- 172.21.15.82:0/1516127495 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2600074c0 con 0x7ff2680b9610 2024-06-02T22:52:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.695+0000 7ff26e714640 1 -- 172.21.15.82:0/1516127495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2680cb3a0 con 0x7ff2680b9610 2024-06-02T22:52:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.696+0000 7ff26e714640 1 -- 172.21.15.82:0/1516127495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2680d0a70 con 0x7ff2680b9610 2024-06-02T22:52:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.697+0000 7ff264ff9640 1 -- 172.21.15.82:0/1516127495 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff26001a070 con 0x7ff2680b9610 2024-06-02T22:52:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.697+0000 7ff264ff9640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff25406be30 0x7ff25406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.697+0000 7ff267fff640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff25406be30 0x7ff25406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.697+0000 7ff264ff9640 1 -- 172.21.15.82:0/1516127495 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7ff260089ed0 con 0x7ff2680b9610 2024-06-02T22:52:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.698+0000 7ff267fff640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff25406be30 0x7ff25406e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff258033000 tx=0x7ff258008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.701+0000 7ff264ff9640 1 -- 172.21.15.82:0/1516127495 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff2680d0a70 con 0x7ff2680b9610 2024-06-02T22:52:53.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.953+0000 7ff26e714640 1 -- 172.21.15.82:0/1516127495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7ff2680cb190 con 0x7ff2680b9610 2024-06-02T22:52:53.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.954+0000 7ff264ff9640 1 -- 172.21.15.82:0/1516127495 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7ff260058a40 con 0x7ff2680b9610 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.956+0000 7ff26e714640 1 -- 172.21.15.82:0/1516127495 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff25406be30 msgr2=0x7ff25406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.956+0000 7ff26e714640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff25406be30 0x7ff25406e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff258033000 tx=0x7ff258008030 comp rx=0 tx=0).stop 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.956+0000 7ff26e714640 1 -- 172.21.15.82:0/1516127495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2680b9610 msgr2=0x7ff26814abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.956+0000 7ff26e714640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2680b9610 0x7ff26814abe0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff2680d1c40 tx=0x7ff26000c890 comp rx=0 tx=0).stop 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.957+0000 7ff26e714640 1 -- 172.21.15.82:0/1516127495 shutdown_connections 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.957+0000 7ff26e714640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff25406be30 0x7ff25406e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.957+0000 7ff26e714640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2680b9610 0x7ff26814abe0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.957+0000 7ff26e714640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2680b9190 0x7ff26814da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.957+0000 7ff26e714640 1 --2- 172.21.15.82:0/1516127495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2500039b0 0x7ff2680cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.957+0000 7ff26e714640 1 -- 172.21.15.82:0/1516127495 >> 172.21.15.82:0/1516127495 conn(0x7ff26809d3f0 msgr2=0x7ff268161640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.957+0000 7ff26e714640 1 -- 172.21.15.82:0/1516127495 shutdown_connections 2024-06-02T22:52:53.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:53.957+0000 7ff26e714640 1 -- 172.21.15.82:0/1516127495 wait complete. 2024-06-02T22:52:53.970 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-06-02T22:52:54.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.073+0000 7fb1ea083640 1 Processor -- start 2024-06-02T22:52:54.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.073+0000 7fb1ea083640 1 -- start start 2024-06-02T22:52:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1ea083640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb1e40ae910 0x7fb1e406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1ea083640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1e40cf360 0x7fb1e40acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1ea083640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e406d130 con 0x7fb1e406ea20 2024-06-02T22:52:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1ea083640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e406ee90 con 0x7fb1e40ae910 2024-06-02T22:52:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1ea083640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e406d410 con 0x7fb1e40cf360 2024-06-02T22:52:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1e37fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb1e40ae910 0x7fb1e406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1e37fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb1e40ae910 0x7fb1e406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40128/0 (socket says 172.21.15.82:40128) 2024-06-02T22:52:54.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1e37fe640 1 -- 172.21.15.82:0/2027879433 learned_addr learned my addr 172.21.15.82:0/2027879433 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:54.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1e3fff640 1 --2- 172.21.15.82:0/2027879433 >> v2:172.21.15.184:3300/0 conn(0x7fb1e40cf360 0x7fb1e40acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1e37fe640 1 -- 172.21.15.82:0/2027879433 >> v2:172.21.15.184:3300/0 conn(0x7fb1e40cf360 msgr2=0x7fb1e40acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:54.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1e37fe640 1 --2- 172.21.15.82:0/2027879433 >> v2:172.21.15.184:3300/0 conn(0x7fb1e40cf360 0x7fb1e40acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1e37fe640 1 -- 172.21.15.82:0/2027879433 >> v1:172.21.15.184:6789/0 conn(0x7fb1e406ea20 legacy=0x7fb1e40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:54.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1e37fe640 1 -- 172.21.15.82:0/2027879433 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e406d6f0 con 0x7fb1e40ae910 2024-06-02T22:52:54.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.074+0000 7fb1e3fff640 1 --2- 172.21.15.82:0/2027879433 >> v2:172.21.15.184:3300/0 conn(0x7fb1e40cf360 0x7fb1e40acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:54.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.075+0000 7fb1e37fe640 1 --2- 172.21.15.82:0/2027879433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e40ae910 0x7fb1e406e4e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb1e406fbc0 tx=0x7fb1d402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ade8aa9856304d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:54.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.075+0000 7fb1e27fc640 1 -- 172.21.15.82:0/2027879433 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4037070 con 0x7fb1e40ae910 2024-06-02T22:52:54.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.075+0000 7fb1e27fc640 1 -- 172.21.15.82:0/2027879433 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d4032440 con 0x7fb1e40ae910 2024-06-02T22:52:54.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.075+0000 7fb1e27fc640 1 -- 172.21.15.82:0/2027879433 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4032810 con 0x7fb1e40ae910 2024-06-02T22:52:54.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.076+0000 7fb1ea083640 1 -- 172.21.15.82:0/2027879433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e40ae910 msgr2=0x7fb1e406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.076+0000 7fb1ea083640 1 --2- 172.21.15.82:0/2027879433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e40ae910 0x7fb1e406e4e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb1e406fbc0 tx=0x7fb1d402a1a0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.076+0000 7fb1ea083640 1 -- 172.21.15.82:0/2027879433 shutdown_connections 2024-06-02T22:52:54.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.076+0000 7fb1ea083640 1 --2- 172.21.15.82:0/2027879433 >> v2:172.21.15.184:3300/0 conn(0x7fb1e40cf360 0x7fb1e40acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.076+0000 7fb1ea083640 1 --2- 172.21.15.82:0/2027879433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e40ae910 0x7fb1e406e4e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.076+0000 7fb1ea083640 1 -- 172.21.15.82:0/2027879433 >> 172.21.15.82:0/2027879433 conn(0x7fb1e40b19f0 msgr2=0x7fb1e40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.076+0000 7fb1ea083640 1 -- 172.21.15.82:0/2027879433 shutdown_connections 2024-06-02T22:52:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.076+0000 7fb1ea083640 1 -- 172.21.15.82:0/2027879433 wait complete. 2024-06-02T22:52:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.077+0000 7fb1ea083640 1 Processor -- start 2024-06-02T22:52:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.077+0000 7fb1ea083640 1 -- start start 2024-06-02T22:52:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1ea083640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1e406ea20 0x7fb1e414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1ea083640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e40ae910 0x7fb1e41474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1ea083640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1e40cf360 0x7fb1e409cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1ea083640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e40ad280 con 0x7fb1e40ae910 2024-06-02T22:52:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1ea083640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e40aecf0 con 0x7fb1e40cf360 2024-06-02T22:52:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1ea083640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e40ad400 con 0x7fb1e406ea20 2024-06-02T22:52:54.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1e2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e40ae910 0x7fb1e41474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1e2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e40ae910 0x7fb1e41474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40140/0 (socket says 172.21.15.82:40140) 2024-06-02T22:52:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1e2ffd640 1 -- 172.21.15.82:0/70840668 learned_addr learned my addr 172.21.15.82:0/70840668 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1e37fe640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1e406ea20 0x7fb1e414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1e3fff640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1e40cf360 0x7fb1e409cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1e2ffd640 1 -- 172.21.15.82:0/70840668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1e406ea20 msgr2=0x7fb1e414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1e2ffd640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1e406ea20 0x7fb1e414a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1e2ffd640 1 -- 172.21.15.82:0/70840668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1e40cf360 msgr2=0x7fb1e409cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.078+0000 7fb1e2ffd640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1e40cf360 0x7fb1e409cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.079+0000 7fb1e2ffd640 1 -- 172.21.15.82:0/70840668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e414ad10 con 0x7fb1e40ae910 2024-06-02T22:52:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.079+0000 7fb1e3fff640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1e40cf360 0x7fb1e409cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.079+0000 7fb1e2ffd640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e40ae910 0x7fb1e41474a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00b3f0 tx=0x7fb1cc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.079+0000 7fb1dbfff640 1 -- 172.21.15.82:0/70840668 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc015020 con 0x7fb1e40ae910 2024-06-02T22:52:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.079+0000 7fb1dbfff640 1 -- 172.21.15.82:0/70840668 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1cc011830 con 0x7fb1e40ae910 2024-06-02T22:52:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.079+0000 7fb1ea083640 1 -- 172.21.15.82:0/70840668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e41f5b60 con 0x7fb1e40ae910 2024-06-02T22:52:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.079+0000 7fb1dbfff640 1 -- 172.21.15.82:0/70840668 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc011c20 con 0x7fb1e40ae910 2024-06-02T22:52:54.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.079+0000 7fb1ea083640 1 -- 172.21.15.82:0/70840668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e41f6120 con 0x7fb1e40ae910 2024-06-02T22:52:54.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.080+0000 7fb1ea083640 1 -- 172.21.15.82:0/70840668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e4068430 con 0x7fb1e40ae910 2024-06-02T22:52:54.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.080+0000 7fb1dbfff640 1 -- 172.21.15.82:0/70840668 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1cc018020 con 0x7fb1e40ae910 2024-06-02T22:52:54.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.081+0000 7fb1dbfff640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb1c406be60 0x7fb1c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.081+0000 7fb1dbfff640 1 -- 172.21.15.82:0/70840668 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fb1cc08a790 con 0x7fb1e40ae910 2024-06-02T22:52:54.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.081+0000 7fb1e37fe640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb1c406be60 0x7fb1c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.081+0000 7fb1e37fe640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb1c406be60 0x7fb1c406e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4034000 tx=0x7fb1d402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:54.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.085+0000 7fb1dbfff640 1 -- 172.21.15.82:0/70840668 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb1cc01f030 con 0x7fb1e40ae910 2024-06-02T22:52:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.337+0000 7fb1ea083640 1 -- 172.21.15.82:0/70840668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fb1e40b1fe0 con 0x7fb1e40ae910 2024-06-02T22:52:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.339+0000 7fb1dbfff640 1 -- 172.21.15.82:0/70840668 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fb1cc059390 con 0x7fb1e40ae910 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 -- 172.21.15.82:0/70840668 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb1c406be60 msgr2=0x7fb1c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb1c406be60 0x7fb1c406e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4034000 tx=0x7fb1d402e000 comp rx=0 tx=0).stop 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 -- 172.21.15.82:0/70840668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e40ae910 msgr2=0x7fb1e41474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e40ae910 0x7fb1e41474a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00b3f0 tx=0x7fb1cc00b8b0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 -- 172.21.15.82:0/70840668 shutdown_connections 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb1c406be60 0x7fb1c406e320 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1e40cf360 0x7fb1e409cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e40ae910 0x7fb1e41474a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 --2- 172.21.15.82:0/70840668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1e406ea20 0x7fb1e414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 -- 172.21.15.82:0/70840668 >> 172.21.15.82:0/70840668 conn(0x7fb1e40b19f0 msgr2=0x7fb1e40cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 -- 172.21.15.82:0/70840668 shutdown_connections 2024-06-02T22:52:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.342+0000 7fb1ea083640 1 -- 172.21.15.82:0/70840668 wait complete. 2024-06-02T22:52:54.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-06-02T22:52:54.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.454+0000 7faa90f7e640 1 Processor -- start 2024-06-02T22:52:54.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.454+0000 7faa90f7e640 1 -- start start 2024-06-02T22:52:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.455+0000 7faa90f7e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faa8c0ae910 0x7faa8c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.455+0000 7faa90f7e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa8c0cf360 0x7faa8c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.455+0000 7faa90f7e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa8c06d130 con 0x7faa8c06ea20 2024-06-02T22:52:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.455+0000 7faa90f7e640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7faa8c06ee90 con 0x7faa8c0ae910 2024-06-02T22:52:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.455+0000 7faa90f7e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7faa8c06d410 con 0x7faa8c0cf360 2024-06-02T22:52:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.455+0000 7faa81d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7faa8c06ea20 0x7faa8c0cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50548/0 (socket says 172.21.15.82:50548) 2024-06-02T22:52:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.455+0000 7faa81d9b640 1 -- 172.21.15.82:0/1893456016 learned_addr learned my addr 172.21.15.82:0/1893456016 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.455+0000 7faa8ad9d640 1 --2- 172.21.15.82:0/1893456016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa8c0cf360 0x7faa8c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.455+0000 7faa8a59c640 1 --2- 172.21.15.82:0/1893456016 >> v2:172.21.15.184:3300/0 conn(0x7faa8c0ae910 0x7faa8c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.455+0000 7faa89d9b640 1 -- 172.21.15.82:0/1893456016 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393193270 0 0) 0x7faa8c06d130 con 0x7faa8c06ea20 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.455+0000 7faa89d9b640 1 -- 172.21.15.82:0/1893456016 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa78003520 con 0x7faa8c06ea20 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.456+0000 7faa89d9b640 1 -- 172.21.15.82:0/1893456016 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3648879911 0 0) 0x7faa78003520 con 0x7faa8c06ea20 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.456+0000 7faa8a59c640 1 -- 172.21.15.82:0/1893456016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa8c0cf360 msgr2=0x7faa8c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.456+0000 7faa8a59c640 1 --2- 172.21.15.82:0/1893456016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa8c0cf360 0x7faa8c0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.456+0000 7faa8a59c640 1 -- 172.21.15.82:0/1893456016 >> v1:172.21.15.82:6789/0 conn(0x7faa8c06ea20 legacy=0x7faa8c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.456+0000 7faa8a59c640 1 -- 172.21.15.82:0/1893456016 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c06d6f0 con 0x7faa8c0ae910 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.456+0000 7faa8ad9d640 1 --2- 172.21.15.82:0/1893456016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa8c0cf360 0x7faa8c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.456+0000 7faa8a59c640 1 --2- 172.21.15.82:0/1893456016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa8c0ae910 0x7faa8c06e4e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faa7c0097a0 tx=0x7faa7c02a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aca95abe928b20a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.457+0000 7faa89d9b640 1 -- 172.21.15.82:0/1893456016 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c037070 con 0x7faa8c0ae910 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.457+0000 7faa89d9b640 1 -- 172.21.15.82:0/1893456016 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7c02ab10 con 0x7faa8c0ae910 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.457+0000 7faa89d9b640 1 -- 172.21.15.82:0/1893456016 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74001670 con 0x7faa8c0ae910 2024-06-02T22:52:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.457+0000 7faa90f7e640 1 -- 172.21.15.82:0/1893456016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa8c0ae910 msgr2=0x7faa8c06e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.457+0000 7faa90f7e640 1 --2- 172.21.15.82:0/1893456016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa8c0ae910 0x7faa8c06e4e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faa7c0097a0 tx=0x7faa7c02a080 comp rx=0 tx=0).stop 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.457+0000 7faa90f7e640 1 -- 172.21.15.82:0/1893456016 shutdown_connections 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.457+0000 7faa90f7e640 1 --2- 172.21.15.82:0/1893456016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa8c0cf360 0x7faa8c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.457+0000 7faa90f7e640 1 --2- 172.21.15.82:0/1893456016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa8c0ae910 0x7faa8c06e4e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.457+0000 7faa90f7e640 1 -- 172.21.15.82:0/1893456016 >> 172.21.15.82:0/1893456016 conn(0x7faa8c0b19f0 msgr2=0x7faa8c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.457+0000 7faa90f7e640 1 -- 172.21.15.82:0/1893456016 shutdown_connections 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.457+0000 7faa90f7e640 1 -- 172.21.15.82:0/1893456016 wait complete. 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.459+0000 7faa90f7e640 1 Processor -- start 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.459+0000 7faa90f7e640 1 -- start start 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.459+0000 7faa90f7e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa8c06ea20 0x7faa8c14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.459+0000 7faa90f7e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa8c0ae910 0x7faa8c09c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.459+0000 7faa90f7e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa8c0cf360 0x7faa8c09ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.459+0000 7faa90f7e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c0ad280 con 0x7faa8c06ea20 2024-06-02T22:52:54.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.459+0000 7faa90f7e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c0aecf0 con 0x7faa8c0cf360 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.459+0000 7faa90f7e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7faa8c0ad400 con 0x7faa8c0ae910 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.459+0000 7faa8a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa8c06ea20 0x7faa8c14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.459+0000 7faa8a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa8c06ea20 0x7faa8c14c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40154/0 (socket says 172.21.15.82:40154) 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa8a59c640 1 -- 172.21.15.82:0/2596167731 learned_addr learned my addr 172.21.15.82:0/2596167731 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa81d9b640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa8c0ae910 0x7faa8c09c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa8ad9d640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa8c0cf360 0x7faa8c09ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa8a59c640 1 -- 172.21.15.82:0/2596167731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa8c0ae910 msgr2=0x7faa8c09c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa8a59c640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa8c0ae910 0x7faa8c09c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa8a59c640 1 -- 172.21.15.82:0/2596167731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa8c0cf360 msgr2=0x7faa8c09ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa8a59c640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa8c0cf360 0x7faa8c09ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa8a59c640 1 -- 172.21.15.82:0/2596167731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c09c3a0 con 0x7faa8c06ea20 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa8ad9d640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa8c0cf360 0x7faa8c09ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa8a59c640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa8c06ea20 0x7faa8c14c6b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faa7c0098c0 tx=0x7faa7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:54.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa837fe640 1 -- 172.21.15.82:0/2596167731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c006e10 con 0x7faa8c06ea20 2024-06-02T22:52:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa837fe640 1 -- 172.21.15.82:0/2596167731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7c039810 con 0x7faa8c06ea20 2024-06-02T22:52:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa837fe640 1 -- 172.21.15.82:0/2596167731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c039bc0 con 0x7faa8c06ea20 2024-06-02T22:52:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa90f7e640 1 -- 172.21.15.82:0/2596167731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8c0c4eb0 con 0x7faa8c06ea20 2024-06-02T22:52:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.460+0000 7faa90f7e640 1 -- 172.21.15.82:0/2596167731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8c0c5470 con 0x7faa8c06ea20 2024-06-02T22:52:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.461+0000 7faa90f7e640 1 -- 172.21.15.82:0/2596167731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8c068430 con 0x7faa8c06ea20 2024-06-02T22:52:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.462+0000 7faa837fe640 1 -- 172.21.15.82:0/2596167731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa7c03a400 con 0x7faa8c06ea20 2024-06-02T22:52:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.462+0000 7faa837fe640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa6c06be30 0x7faa6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.462+0000 7faa81d9b640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa6c06be30 0x7faa6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.462+0000 7faa837fe640 1 -- 172.21.15.82:0/2596167731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7faa7c0ad6c0 con 0x7faa8c06ea20 2024-06-02T22:52:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.462+0000 7faa81d9b640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa6c06be30 0x7faa6c06e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faa8c159e90 tx=0x7faa74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:54.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.466+0000 7faa837fe640 1 -- 172.21.15.82:0/2596167731 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faa7c07c230 con 0x7faa8c06ea20 2024-06-02T22:52:54.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.710+0000 7faa90f7e640 1 -- 172.21.15.82:0/2596167731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7faa8c0ccfa0 con 0x7faa8c06ea20 2024-06-02T22:52:54.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.712+0000 7faa837fe640 1 -- 172.21.15.82:0/2596167731 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7faa7c07bb30 con 0x7faa8c06ea20 2024-06-02T22:52:54.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 -- 172.21.15.82:0/2596167731 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa6c06be30 msgr2=0x7faa6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa6c06be30 0x7faa6c06e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faa8c159e90 tx=0x7faa74009040 comp rx=0 tx=0).stop 2024-06-02T22:52:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 -- 172.21.15.82:0/2596167731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa8c06ea20 msgr2=0x7faa8c14c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa8c06ea20 0x7faa8c14c6b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faa7c0098c0 tx=0x7faa7c0046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 -- 172.21.15.82:0/2596167731 shutdown_connections 2024-06-02T22:52:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa6c06be30 0x7faa6c06e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa8c0cf360 0x7faa8c09ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa8c0ae910 0x7faa8c09c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 --2- 172.21.15.82:0/2596167731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa8c06ea20 0x7faa8c14c6b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 -- 172.21.15.82:0/2596167731 >> 172.21.15.82:0/2596167731 conn(0x7faa8c0b19f0 msgr2=0x7faa8c071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 -- 172.21.15.82:0/2596167731 shutdown_connections 2024-06-02T22:52:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.714+0000 7faa90f7e640 1 -- 172.21.15.82:0/2596167731 wait complete. 2024-06-02T22:52:54.725 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-06-02T22:52:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.827+0000 7fe95ee2a640 1 Processor -- start 2024-06-02T22:52:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.827+0000 7fe95ee2a640 1 -- start start 2024-06-02T22:52:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.827+0000 7fe95ee2a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9580d2680 0x7fe95815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.827+0000 7fe95ee2a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe9580d1fc0 0x7fe9580d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.827+0000 7fe95ee2a640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe958161fa0 0x7fe958162430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe95ee2a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe9580d13e0 con 0x7fe9580d1fc0 2024-06-02T22:52:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe95ee2a640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fe9580d2fa0 con 0x7fe958161fa0 2024-06-02T22:52:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe95ee2a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe9580d0ad0 con 0x7fe9580d2680 2024-06-02T22:52:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe957fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe9580d1fc0 0x7fe9580d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe957fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe9580d1fc0 0x7fe9580d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40166/0 (socket says 172.21.15.82:40166) 2024-06-02T22:52:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe957fff640 1 -- 172.21.15.82:0/2637807397 learned_addr learned my addr 172.21.15.82:0/2637807397 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe95d3c7640 1 --2- 172.21.15.82:0/2637807397 >> v2:172.21.15.184:3300/0 conn(0x7fe958161fa0 0x7fe958162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe957fff640 1 -- 172.21.15.82:0/2637807397 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9580d2680 msgr2=0x7fe95815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe957fff640 1 --2- 172.21.15.82:0/2637807397 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9580d2680 0x7fe95815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe957fff640 1 -- 172.21.15.82:0/2637807397 >> v2:172.21.15.184:3300/0 conn(0x7fe958161fa0 msgr2=0x7fe958162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe957fff640 1 --2- 172.21.15.82:0/2637807397 >> v2:172.21.15.184:3300/0 conn(0x7fe958161fa0 0x7fe958162430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe957fff640 1 -- 172.21.15.82:0/2637807397 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95815f890 con 0x7fe9580d1fc0 2024-06-02T22:52:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.828+0000 7fe95d3c7640 1 --2- 172.21.15.82:0/2637807397 >> v2:172.21.15.184:3300/0 conn(0x7fe958161fa0 0x7fe958162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe957fff640 1 --2- 172.21.15.82:0/2637807397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9580d1fc0 0x7fe9580d2a60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe958161ee0 tx=0x7fe94402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab406c6af81cd4c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe9577fe640 1 -- 172.21.15.82:0/2637807397 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944037070 con 0x7fe9580d1fc0 2024-06-02T22:52:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe9577fe640 1 -- 172.21.15.82:0/2637807397 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe944032440 con 0x7fe9580d1fc0 2024-06-02T22:52:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe9577fe640 1 -- 172.21.15.82:0/2637807397 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944032810 con 0x7fe9580d1fc0 2024-06-02T22:52:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe95ee2a640 1 -- 172.21.15.82:0/2637807397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9580d1fc0 msgr2=0x7fe9580d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe95ee2a640 1 --2- 172.21.15.82:0/2637807397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9580d1fc0 0x7fe9580d2a60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe958161ee0 tx=0x7fe94402a1e0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe95ee2a640 1 -- 172.21.15.82:0/2637807397 shutdown_connections 2024-06-02T22:52:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe95ee2a640 1 --2- 172.21.15.82:0/2637807397 >> v2:172.21.15.184:3300/0 conn(0x7fe958161fa0 0x7fe958162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe95ee2a640 1 --2- 172.21.15.82:0/2637807397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9580d1fc0 0x7fe9580d2a60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe95ee2a640 1 --2- 172.21.15.82:0/2637807397 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9580d2680 0x7fe95815f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe95ee2a640 1 -- 172.21.15.82:0/2637807397 >> 172.21.15.82:0/2637807397 conn(0x7fe95809d3f0 msgr2=0x7fe9580d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe95ee2a640 1 -- 172.21.15.82:0/2637807397 shutdown_connections 2024-06-02T22:52:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.829+0000 7fe95ee2a640 1 -- 172.21.15.82:0/2637807397 wait complete. 2024-06-02T22:52:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.831+0000 7fe95ee2a640 1 Processor -- start 2024-06-02T22:52:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.831+0000 7fe95ee2a640 1 -- start start 2024-06-02T22:52:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.831+0000 7fe95ee2a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9580d1fc0 0x7fe9580cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.831+0000 7fe95ee2a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9580d2680 0x7fe95815a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95ee2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe958161fa0 0x7fe95806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95ee2a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580d2400 con 0x7fe958161fa0 2024-06-02T22:52:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95ee2a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580d1070 con 0x7fe9580d2680 2024-06-02T22:52:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95ee2a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe9580d4f00 con 0x7fe9580d1fc0 2024-06-02T22:52:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95d3c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe958161fa0 0x7fe95806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95d3c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe958161fa0 0x7fe95806d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40176/0 (socket says 172.21.15.82:40176) 2024-06-02T22:52:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95d3c7640 1 -- 172.21.15.82:0/1738151082 learned_addr learned my addr 172.21.15.82:0/1738151082 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe957fff640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9580d2680 0x7fe95815a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95cbc6640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9580d1fc0 0x7fe9580cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95d3c7640 1 -- 172.21.15.82:0/1738151082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9580d1fc0 msgr2=0x7fe9580cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95d3c7640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9580d1fc0 0x7fe9580cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95d3c7640 1 -- 172.21.15.82:0/1738151082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9580d2680 msgr2=0x7fe95815a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95d3c7640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9580d2680 0x7fe95815a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95d3c7640 1 -- 172.21.15.82:0/1738151082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9581f7b60 con 0x7fe958161fa0 2024-06-02T22:52:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95d3c7640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe958161fa0 0x7fe95806d110 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe950007e20 tx=0x7fe95000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe9557fa640 1 -- 172.21.15.82:0/1738151082 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95001a070 con 0x7fe958161fa0 2024-06-02T22:52:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe9557fa640 1 -- 172.21.15.82:0/1738151082 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950003b90 con 0x7fe958161fa0 2024-06-02T22:52:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95ee2a640 1 -- 172.21.15.82:0/1738151082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9581f7e40 con 0x7fe958161fa0 2024-06-02T22:52:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe9557fa640 1 -- 172.21.15.82:0/1738151082 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95000de80 con 0x7fe958161fa0 2024-06-02T22:52:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.832+0000 7fe95ee2a640 1 -- 172.21.15.82:0/1738151082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9580a14b0 con 0x7fe958161fa0 2024-06-02T22:52:54.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.833+0000 7fe95ee2a640 1 -- 172.21.15.82:0/1738151082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe958068430 con 0x7fe958161fa0 2024-06-02T22:52:54.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.834+0000 7fe9557fa640 1 -- 172.21.15.82:0/1738151082 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe95001d070 con 0x7fe958161fa0 2024-06-02T22:52:54.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.834+0000 7fe9557fa640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe93c06be30 0x7fe93c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:54.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.834+0000 7fe9557fa640 1 -- 172.21.15.82:0/1738151082 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fe95008ae60 con 0x7fe958161fa0 2024-06-02T22:52:54.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.834+0000 7fe95cbc6640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe93c06be30 0x7fe93c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:54.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.835+0000 7fe95cbc6640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe93c06be30 0x7fe93c06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009890 tx=0x7fe94c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:54.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:54.839+0000 7fe9557fa640 1 -- 172.21.15.82:0/1738151082 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe950010070 con 0x7fe958161fa0 2024-06-02T22:52:55.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.080+0000 7fe95ee2a640 1 -- 172.21.15.82:0/1738151082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fe9580d04e0 con 0x7fe958161fa0 2024-06-02T22:52:55.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.082+0000 7fe9557fa640 1 -- 172.21.15.82:0/1738151082 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7fe950059a60 con 0x7fe958161fa0 2024-06-02T22:52:55.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 -- 172.21.15.82:0/1738151082 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe93c06be30 msgr2=0x7fe93c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe93c06be30 0x7fe93c06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009890 tx=0x7fe94c008040 comp rx=0 tx=0).stop 2024-06-02T22:52:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 -- 172.21.15.82:0/1738151082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe958161fa0 msgr2=0x7fe95806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe958161fa0 0x7fe95806d110 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe950007e20 tx=0x7fe95000d4a0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 -- 172.21.15.82:0/1738151082 shutdown_connections 2024-06-02T22:52:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe93c06be30 0x7fe93c06e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe958161fa0 0x7fe95806d110 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9580d2680 0x7fe95815a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 --2- 172.21.15.82:0/1738151082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9580d1fc0 0x7fe9580cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 -- 172.21.15.82:0/1738151082 >> 172.21.15.82:0/1738151082 conn(0x7fe95809d3f0 msgr2=0x7fe958160c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 -- 172.21.15.82:0/1738151082 shutdown_connections 2024-06-02T22:52:55.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.084+0000 7fe95ee2a640 1 -- 172.21.15.82:0/1738151082 wait complete. 2024-06-02T22:52:55.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-06-02T22:52:55.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.196+0000 7fee85153640 1 Processor -- start 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.196+0000 7fee85153640 1 -- start start 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.197+0000 7fee85153640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fee800d1fc0 0x7fee800cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.197+0000 7fee85153640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee8015f5e0 con 0x7fee800d2680 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.197+0000 7fee85153640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee800d0ad0 con 0x7fee8015f1a0 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.197+0000 7fee85153640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fee800d13e0 con 0x7fee800d1fc0 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.197+0000 7fee7ed9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fee800d2680 0x7fee800d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50562/0 (socket says 172.21.15.82:50562) 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.197+0000 7fee7ed9d640 1 -- 172.21.15.82:0/802045805 learned_addr learned my addr 172.21.15.82:0/802045805 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7f59e640 1 --2- 172.21.15.82:0/802045805 >> v2:172.21.15.184:3300/0 conn(0x7fee800d1fc0 0x7fee800cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 323137780 0 0) 0x7fee8015f5e0 con 0x7fee800d2680 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee68003520 con 0x7fee800d2680 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2320108656 0 0) 0x7fee68003520 con 0x7fee800d2680 2024-06-02T22:52:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 >> v2:172.21.15.184:3300/0 conn(0x7fee800d1fc0 msgr2=0x7fee800cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 --2- 172.21.15.82:0/802045805 >> v2:172.21.15.184:3300/0 conn(0x7fee800d1fc0 0x7fee800cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 >> v1:172.21.15.184:6789/0 conn(0x7fee8015f1a0 legacy=0x7fee800cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8015f890 con 0x7fee800d2680 2024-06-02T22:52:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fee70001670 con 0x7fee800d2680 2024-06-02T22:52:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 >> v1:172.21.15.82:6789/0 conn(0x7fee800d2680 legacy=0x7fee800d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 --2- 172.21.15.82:0/802045805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 0x7fee68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 --2- 172.21.15.82:0/802045805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee68004800 0x7fee68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 --2- 172.21.15.82:0/802045805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee680051c0 0x7fee6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fee800d13e0 con 0x7fee680039b0 2024-06-02T22:52:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fee6800c060 con 0x7fee680051c0 2024-06-02T22:52:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fee6800c260 con 0x7fee68004800 2024-06-02T22:52:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7ed9d640 1 --2- 172.21.15.82:0/802045805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 0x7fee68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7e59c640 1 --2- 172.21.15.82:0/802045805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee68004800 0x7fee68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7f59e640 1 --2- 172.21.15.82:0/802045805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee680051c0 0x7fee6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7ed9d640 1 -- 172.21.15.82:0/802045805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee68004800 msgr2=0x7fee68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7ed9d640 1 --2- 172.21.15.82:0/802045805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee68004800 0x7fee68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7ed9d640 1 -- 172.21.15.82:0/802045805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee680051c0 msgr2=0x7fee6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7ed9d640 1 --2- 172.21.15.82:0/802045805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee680051c0 0x7fee6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7ed9d640 1 -- 172.21.15.82:0/802045805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee68003520 con 0x7fee680039b0 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.198+0000 7fee7f59e640 1 -- 172.21.15.82:0/802045805 reap_dead start 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.199+0000 7fee7ed9d640 1 --2- 172.21.15.82:0/802045805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 0x7fee68003dd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c240 tx=0x7fee68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e836471e6618eaa5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.199+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70007d10 con 0x7fee680039b0 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.199+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee700058d0 con 0x7fee680039b0 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.199+0000 7fee7dd9b640 1 -- 172.21.15.82:0/802045805 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70005d40 con 0x7fee680039b0 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.199+0000 7fee85153640 1 -- 172.21.15.82:0/802045805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 msgr2=0x7fee68003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.199+0000 7fee85153640 1 --2- 172.21.15.82:0/802045805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 0x7fee68003dd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c240 tx=0x7fee68005830 comp rx=0 tx=0).stop 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.200+0000 7fee85153640 1 -- 172.21.15.82:0/802045805 shutdown_connections 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.200+0000 7fee85153640 1 --2- 172.21.15.82:0/802045805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 0x7fee68003dd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.200+0000 7fee85153640 1 -- 172.21.15.82:0/802045805 >> 172.21.15.82:0/802045805 conn(0x7fee8009d3f0 msgr2=0x7fee800d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.200+0000 7fee85153640 1 -- 172.21.15.82:0/802045805 shutdown_connections 2024-06-02T22:52:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.200+0000 7fee85153640 1 -- 172.21.15.82:0/802045805 wait complete. 2024-06-02T22:52:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.201+0000 7fee85153640 1 Processor -- start 2024-06-02T22:52:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.201+0000 7fee85153640 1 -- start start 2024-06-02T22:52:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee85153640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 0x7fee8014f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee85153640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee800b9990 0x7fee800b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee85153640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee800b9050 0x7fee8014daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee85153640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fee800d2410 con 0x7fee680039b0 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee85153640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fee800d1070 con 0x7fee800b9990 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee85153640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fee800d4f00 con 0x7fee800b9050 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee7ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 0x7fee8014f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee7ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 0x7fee8014f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40188/0 (socket says 172.21.15.82:40188) 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee7ed9d640 1 -- 172.21.15.82:0/2938977102 learned_addr learned my addr 172.21.15.82:0/2938977102 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee7ed9d640 1 -- 172.21.15.82:0/2938977102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee800b9050 msgr2=0x7fee8014daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee7ed9d640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee800b9050 0x7fee8014daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee7ed9d640 1 -- 172.21.15.82:0/2938977102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee800b9990 msgr2=0x7fee800b8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee7e59c640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee800b9990 0x7fee800b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee7ed9d640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee800b9990 0x7fee800b8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee7ed9d640 1 -- 172.21.15.82:0/2938977102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee800c9c60 con 0x7fee680039b0 2024-06-02T22:52:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.202+0000 7fee7ed9d640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 0x7fee8014f410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fee7002adf0 tx=0x7fee800d4050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.203+0000 7fee677fe640 1 -- 172.21.15.82:0/2938977102 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70040020 con 0x7fee680039b0 2024-06-02T22:52:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.203+0000 7fee677fe640 1 -- 172.21.15.82:0/2938977102 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee70000ed0 con 0x7fee680039b0 2024-06-02T22:52:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.203+0000 7fee677fe640 1 -- 172.21.15.82:0/2938977102 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70007d10 con 0x7fee680039b0 2024-06-02T22:52:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.203+0000 7fee85153640 1 -- 172.21.15.82:0/2938977102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee800c9f40 con 0x7fee680039b0 2024-06-02T22:52:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.203+0000 7fee85153640 1 -- 172.21.15.82:0/2938977102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8014f950 con 0x7fee680039b0 2024-06-02T22:52:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.204+0000 7fee85153640 1 -- 172.21.15.82:0/2938977102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee800b9470 con 0x7fee680039b0 2024-06-02T22:52:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.204+0000 7fee677fe640 1 -- 172.21.15.82:0/2938977102 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee70043020 con 0x7fee680039b0 2024-06-02T22:52:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.205+0000 7fee677fe640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee6c06be30 0x7fee6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.205+0000 7fee677fe640 1 -- 172.21.15.82:0/2938977102 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fee700aab60 con 0x7fee680039b0 2024-06-02T22:52:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.205+0000 7fee7e59c640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee6c06be30 0x7fee6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.205+0000 7fee7e59c640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee6c06be30 0x7fee6c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fee74007fd0 tx=0x7fee74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.209+0000 7fee677fe640 1 -- 172.21.15.82:0/2938977102 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fee7004a020 con 0x7fee680039b0 2024-06-02T22:52:55.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.449+0000 7fee85153640 1 -- 172.21.15.82:0/2938977102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fee80068430 con 0x7fee680039b0 2024-06-02T22:52:55.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.451+0000 7fee677fe640 1 -- 172.21.15.82:0/2938977102 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fee70079880 con 0x7fee680039b0 2024-06-02T22:52:55.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 -- 172.21.15.82:0/2938977102 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee6c06be30 msgr2=0x7fee6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee6c06be30 0x7fee6c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fee74007fd0 tx=0x7fee74009040 comp rx=0 tx=0).stop 2024-06-02T22:52:55.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 -- 172.21.15.82:0/2938977102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 msgr2=0x7fee8014f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 0x7fee8014f410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fee7002adf0 tx=0x7fee800d4050 comp rx=0 tx=0).stop 2024-06-02T22:52:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 -- 172.21.15.82:0/2938977102 shutdown_connections 2024-06-02T22:52:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee6c06be30 0x7fee6c06e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee800b9050 0x7fee8014daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee800b9990 0x7fee800b8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 --2- 172.21.15.82:0/2938977102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee680039b0 0x7fee8014f410 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 -- 172.21.15.82:0/2938977102 >> 172.21.15.82:0/2938977102 conn(0x7fee8009d3f0 msgr2=0x7fee80161460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 -- 172.21.15.82:0/2938977102 shutdown_connections 2024-06-02T22:52:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.453+0000 7fee85153640 1 -- 172.21.15.82:0/2938977102 wait complete. 2024-06-02T22:52:55.465 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-02T22:52:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.564+0000 7fea26bb6640 1 Processor -- start 2024-06-02T22:52:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.564+0000 7fea26bb6640 1 -- start start 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea26bb6640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fea20154fc0 0x7fea201553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea26bb6640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2015f5c0 con 0x7fea2006bad0 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea26bb6640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea20162020 con 0x7fea20162b00 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea26bb6640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fea200d03a0 con 0x7fea20154fc0 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea25153640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fea2006bad0 0x7fea200afde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50568/0 (socket says 172.21.15.82:50568) 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea25153640 1 -- 172.21.15.82:0/460277802 learned_addr learned my addr 172.21.15.82:0/460277802 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1824848379 0 0) 0x7fea2015f5c0 con 0x7fea2006bad0 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea10003520 con 0x7fea2006bad0 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea24952640 1 --2- 172.21.15.82:0/460277802 >> v2:172.21.15.184:3300/0 conn(0x7fea20154fc0 0x7fea201553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2161498102 0 0) 0x7fea10003520 con 0x7fea2006bad0 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 >> v2:172.21.15.184:3300/0 conn(0x7fea20154fc0 msgr2=0x7fea201553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 --2- 172.21.15.82:0/460277802 >> v2:172.21.15.184:3300/0 conn(0x7fea20154fc0 0x7fea201553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 >> v1:172.21.15.184:6789/0 conn(0x7fea20162b00 legacy=0x7fea2006b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea20162300 con 0x7fea2006bad0 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fea180019f0 con 0x7fea2006bad0 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 >> v1:172.21.15.82:6789/0 conn(0x7fea2006bad0 legacy=0x7fea200afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 --2- 172.21.15.82:0/460277802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100039b0 0x7fea10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 --2- 172.21.15.82:0/460277802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea10004800 0x7fea10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 --2- 172.21.15.82:0/460277802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea100051c0 0x7fea1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea200d03a0 con 0x7fea100051c0 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fea1000c060 con 0x7fea10004800 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.565+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fea1000c260 con 0x7fea100039b0 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.566+0000 7fea25153640 1 --2- 172.21.15.82:0/460277802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea100051c0 0x7fea1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.566+0000 7fea1ffff640 1 --2- 172.21.15.82:0/460277802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea10004800 0x7fea10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.566+0000 7fea24952640 1 --2- 172.21.15.82:0/460277802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100039b0 0x7fea10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.566+0000 7fea25153640 1 -- 172.21.15.82:0/460277802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100039b0 msgr2=0x7fea10003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.566+0000 7fea25153640 1 --2- 172.21.15.82:0/460277802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100039b0 0x7fea10003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.566+0000 7fea25153640 1 -- 172.21.15.82:0/460277802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea10004800 msgr2=0x7fea10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.566+0000 7fea25153640 1 --2- 172.21.15.82:0/460277802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea10004800 0x7fea10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.566+0000 7fea25153640 1 -- 172.21.15.82:0/460277802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea10003520 con 0x7fea100051c0 2024-06-02T22:52:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.566+0000 7fea25153640 1 -- 172.21.15.82:0/460277802 reap_dead start 2024-06-02T22:52:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.566+0000 7fea25153640 1 --2- 172.21.15.82:0/460277802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea100051c0 0x7fea1000b9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea1800a810 tx=0x7fea10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27cfef8769ae3fce server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.567+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1800a460 con 0x7fea100051c0 2024-06-02T22:52:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.567+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1802f070 con 0x7fea100051c0 2024-06-02T22:52:55.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.567+0000 7fea1f7fe640 1 -- 172.21.15.82:0/460277802 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1802bc90 con 0x7fea100051c0 2024-06-02T22:52:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.567+0000 7fea26bb6640 1 -- 172.21.15.82:0/460277802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea100051c0 msgr2=0x7fea1000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.567+0000 7fea26bb6640 1 --2- 172.21.15.82:0/460277802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea100051c0 0x7fea1000b9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea1800a810 tx=0x7fea10005830 comp rx=0 tx=0).stop 2024-06-02T22:52:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.567+0000 7fea26bb6640 1 -- 172.21.15.82:0/460277802 shutdown_connections 2024-06-02T22:52:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.567+0000 7fea26bb6640 1 --2- 172.21.15.82:0/460277802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea100051c0 0x7fea1000b9c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.567+0000 7fea26bb6640 1 -- 172.21.15.82:0/460277802 >> 172.21.15.82:0/460277802 conn(0x7fea200b2ae0 msgr2=0x7fea200b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.567+0000 7fea26bb6640 1 -- 172.21.15.82:0/460277802 shutdown_connections 2024-06-02T22:52:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.567+0000 7fea26bb6640 1 -- 172.21.15.82:0/460277802 wait complete. 2024-06-02T22:52:55.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.568+0000 7fea26bb6640 1 Processor -- start 2024-06-02T22:52:55.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.568+0000 7fea26bb6640 1 -- start start 2024-06-02T22:52:55.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.569+0000 7fea26bb6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea100051c0 0x7fea20154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.569+0000 7fea26bb6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea200cd7c0 0x7fea200cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.569+0000 7fea26bb6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea200b0990 0x7fea200b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.569+0000 7fea26bb6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea20155520 con 0x7fea200b0990 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.569+0000 7fea26bb6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fea201553a0 con 0x7fea100051c0 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.569+0000 7fea26bb6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fea201556a0 con 0x7fea200cd7c0 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.569+0000 7fea25153640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea200b0990 0x7fea200b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.569+0000 7fea25153640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea200b0990 0x7fea200b0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40206/0 (socket says 172.21.15.82:40206) 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.569+0000 7fea25153640 1 -- 172.21.15.82:0/4055549954 learned_addr learned my addr 172.21.15.82:0/4055549954 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea24952640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea100051c0 0x7fea20154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea1ffff640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea200cd7c0 0x7fea200cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea25153640 1 -- 172.21.15.82:0/4055549954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea200cd7c0 msgr2=0x7fea200cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea25153640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea200cd7c0 0x7fea200cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea25153640 1 -- 172.21.15.82:0/4055549954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea100051c0 msgr2=0x7fea20154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea25153640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea100051c0 0x7fea20154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea25153640 1 -- 172.21.15.82:0/4055549954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea200b1710 con 0x7fea200b0990 2024-06-02T22:52:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea24952640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea100051c0 0x7fea20154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea1ffff640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea200cd7c0 0x7fea200cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea25153640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea200b0990 0x7fea200b0e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fea18000f80 tx=0x7fea201621f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea1d7fa640 1 -- 172.21.15.82:0/4055549954 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1800a460 con 0x7fea200b0990 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea1d7fa640 1 -- 172.21.15.82:0/4055549954 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea18001a20 con 0x7fea200b0990 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea26bb6640 1 -- 172.21.15.82:0/4055549954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea200b19f0 con 0x7fea200b0990 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea1d7fa640 1 -- 172.21.15.82:0/4055549954 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18001fb0 con 0x7fea200b0990 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.570+0000 7fea26bb6640 1 -- 172.21.15.82:0/4055549954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea200b1350 con 0x7fea200b0990 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.571+0000 7fea26bb6640 1 -- 172.21.15.82:0/4055549954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea200ce180 con 0x7fea200b0990 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.571+0000 7fea1d7fa640 1 -- 172.21.15.82:0/4055549954 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea18034670 con 0x7fea200b0990 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.572+0000 7fea1d7fa640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fea0406be60 0x7fea0406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.572+0000 7fea24952640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fea0406be60 0x7fea0406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.572+0000 7fea1d7fa640 1 -- 172.21.15.82:0/4055549954 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fea180aaaf0 con 0x7fea200b0990 2024-06-02T22:52:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.572+0000 7fea24952640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fea0406be60 0x7fea0406e320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea140093d0 tx=0x7fea14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:55.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.577+0000 7fea1d7fa640 1 -- 172.21.15.82:0/4055549954 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fea18046060 con 0x7fea200b0990 2024-06-02T22:52:55.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.751+0000 7fea26bb6640 1 -- 172.21.15.82:0/4055549954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fea200ce180 con 0x7fea200b0990 2024-06-02T22:52:55.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.752+0000 7fea1d7fa640 1 -- 172.21.15.82:0/4055549954 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) ==== 84+0+65 (secure 0 0 0) 0x7fea18079660 con 0x7fea200b0990 2024-06-02T22:52:55.752 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:55.752 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-06-02T22:52:55.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:52:55.752 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2024-06-02T22:52:55.752 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2024-06-02T22:52:55.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:52:55.752 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-06-02T22:52:55.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 -- 172.21.15.82:0/4055549954 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fea0406be60 msgr2=0x7fea0406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fea0406be60 0x7fea0406e320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea140093d0 tx=0x7fea14008040 comp rx=0 tx=0).stop 2024-06-02T22:52:55.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 -- 172.21.15.82:0/4055549954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea200b0990 msgr2=0x7fea200b0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea200b0990 0x7fea200b0e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fea18000f80 tx=0x7fea201621f0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 -- 172.21.15.82:0/4055549954 shutdown_connections 2024-06-02T22:52:55.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fea0406be60 0x7fea0406e320 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea200b0990 0x7fea200b0e10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea200cd7c0 0x7fea200cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 --2- 172.21.15.82:0/4055549954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea100051c0 0x7fea20154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 -- 172.21.15.82:0/4055549954 >> 172.21.15.82:0/4055549954 conn(0x7fea200b2ae0 msgr2=0x7fea2015f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:55.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 -- 172.21.15.82:0/4055549954 shutdown_connections 2024-06-02T22:52:55.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.754+0000 7fea26bb6640 1 -- 172.21.15.82:0/4055549954 wait complete. 2024-06-02T22:52:55.765 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T22:52:55.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T22:52:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.870+0000 7f390c212640 1 Processor -- start 2024-06-02T22:52:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.870+0000 7f390c212640 1 -- start start 2024-06-02T22:52:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f390c212640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f390415c740 0x7f39040cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f390c212640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f390415c230 0x7f39040ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f390c212640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39040722a0 con 0x7f390415be50 2024-06-02T22:52:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f390c212640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f39040b3020 con 0x7f390415c740 2024-06-02T22:52:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f390c212640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3904072570 con 0x7f390415c230 2024-06-02T22:52:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f39097ad640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f390415c740 0x7f39040cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f39097ad640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f390415c740 0x7f39040cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40216/0 (socket says 172.21.15.82:40216) 2024-06-02T22:52:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f39097ad640 1 -- 172.21.15.82:0/607793764 learned_addr learned my addr 172.21.15.82:0/607793764 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f3909fae640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f390415be50 0x7f3904071b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50576/0 (socket says 172.21.15.82:50576) 2024-06-02T22:52:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f390a7af640 1 --2- 172.21.15.82:0/607793764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f390415c230 0x7f39040ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f39097ad640 1 -- 172.21.15.82:0/607793764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f390415c230 msgr2=0x7f39040ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f39097ad640 1 --2- 172.21.15.82:0/607793764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f390415c230 0x7f39040ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f39097ad640 1 -- 172.21.15.82:0/607793764 >> v1:172.21.15.82:6789/0 conn(0x7f390415be50 legacy=0x7f3904071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f3908fac640 1 -- 172.21.15.82:0/607793764 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 741672269 0 0) 0x7f39040722a0 con 0x7f390415be50 2024-06-02T22:52:55.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.871+0000 7f39097ad640 1 -- 172.21.15.82:0/607793764 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3904072850 con 0x7f390415c740 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.872+0000 7f39097ad640 1 --2- 172.21.15.82:0/607793764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f390415c740 0x7f39040cc620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009870 tx=0x7f38f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe822c212e39bd62 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.872+0000 7f3908fac640 1 -- 172.21.15.82:0/607793764 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4037070 con 0x7f390415c740 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.872+0000 7f3908fac640 1 -- 172.21.15.82:0/607793764 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f4032440 con 0x7f390415c740 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.872+0000 7f3908fac640 1 -- 172.21.15.82:0/607793764 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4032810 con 0x7f390415c740 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.873+0000 7f390c212640 1 -- 172.21.15.82:0/607793764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f390415c740 msgr2=0x7f39040cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.873+0000 7f390c212640 1 --2- 172.21.15.82:0/607793764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f390415c740 0x7f39040cc620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009870 tx=0x7f38f402a270 comp rx=0 tx=0).stop 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.873+0000 7f390c212640 1 -- 172.21.15.82:0/607793764 shutdown_connections 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.873+0000 7f390c212640 1 --2- 172.21.15.82:0/607793764 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f390415c230 0x7f39040ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.873+0000 7f390c212640 1 --2- 172.21.15.82:0/607793764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f390415c740 0x7f39040cc620 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.873+0000 7f390c212640 1 -- 172.21.15.82:0/607793764 >> 172.21.15.82:0/607793764 conn(0x7f39040b1980 msgr2=0x7f39040b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.873+0000 7f390c212640 1 -- 172.21.15.82:0/607793764 shutdown_connections 2024-06-02T22:52:55.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.873+0000 7f390c212640 1 -- 172.21.15.82:0/607793764 wait complete. 2024-06-02T22:52:55.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.874+0000 7f390c212640 1 Processor -- start 2024-06-02T22:52:55.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.874+0000 7f390c212640 1 -- start start 2024-06-02T22:52:55.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390c212640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f390415be50 0x7f39040cf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390c212640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f390415c230 0x7f390414eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390c212640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f390415c740 0x7f390409aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390c212640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f39040b34b0 con 0x7f390415c740 2024-06-02T22:52:55.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390c212640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3904072e10 con 0x7f390415c230 2024-06-02T22:52:55.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390c212640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f39040b3630 con 0x7f390415be50 2024-06-02T22:52:55.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390a7af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f390415c740 0x7f390409aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390a7af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f390415c740 0x7f390409aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40230/0 (socket says 172.21.15.82:40230) 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390a7af640 1 -- 172.21.15.82:0/637539529 learned_addr learned my addr 172.21.15.82:0/637539529 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f39097ad640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f390415c230 0x7f390414eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390a7af640 1 -- 172.21.15.82:0/637539529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f390415be50 msgr2=0x7f39040cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390a7af640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f390415be50 0x7f39040cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390a7af640 1 -- 172.21.15.82:0/637539529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f390415c230 msgr2=0x7f390414eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390a7af640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f390415c230 0x7f390414eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390a7af640 1 -- 172.21.15.82:0/637539529 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390409af50 con 0x7f390415c740 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390a7af640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f390415c740 0x7f390409aa10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f38fc007e30 tx=0x7f38fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f38fa7fc640 1 -- 172.21.15.82:0/637539529 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc014620 con 0x7f390415c740 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f38fa7fc640 1 -- 172.21.15.82:0/637539529 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38fc019070 con 0x7f390415c740 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390c212640 1 -- 172.21.15.82:0/637539529 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390409b1f0 con 0x7f390415c740 2024-06-02T22:52:55.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f38fa7fc640 1 -- 172.21.15.82:0/637539529 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc014a00 con 0x7f390415c740 2024-06-02T22:52:55.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.875+0000 7f390c212640 1 -- 172.21.15.82:0/637539529 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390409b7b0 con 0x7f390415c740 2024-06-02T22:52:55.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.877+0000 7f390c212640 1 -- 172.21.15.82:0/637539529 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3904068540 con 0x7f390415c740 2024-06-02T22:52:55.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.877+0000 7f38fa7fc640 1 -- 172.21.15.82:0/637539529 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38fc014ba0 con 0x7f390415c740 2024-06-02T22:52:55.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.877+0000 7f38fa7fc640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38e806be30 0x7f38e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:55.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.877+0000 7f38fa7fc640 1 -- 172.21.15.82:0/637539529 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f38fc08b5b0 con 0x7f390415c740 2024-06-02T22:52:55.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.877+0000 7f3909fae640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38e806be30 0x7f38e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:55.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.878+0000 7f3909fae640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38e806be30 0x7f38e806e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3900007fd0 tx=0x7f3900007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:55.882+0000 7f38fa7fc640 1 -- 172.21.15.82:0/637539529 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f38fc05a120 con 0x7f390415c740 2024-06-02T22:52:56.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.057+0000 7f390c212640 1 -- 172.21.15.82:0/637539529 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f390409dc50 con 0x7f390415c740 2024-06-02T22:52:56.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.816+0000 7f38fa7fc640 1 -- 172.21.15.82:0/637539529 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) ==== 138+0+0 (secure 0 0 0) 0x7f38fc059a20 con 0x7f390415c740 2024-06-02T22:52:56.816 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2024-06-02T22:52:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.819+0000 7f390c212640 1 -- 172.21.15.82:0/637539529 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38e806be30 msgr2=0x7f38e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.819+0000 7f390c212640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38e806be30 0x7f38e806e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3900007fd0 tx=0x7f3900007920 comp rx=0 tx=0).stop 2024-06-02T22:52:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.819+0000 7f390c212640 1 -- 172.21.15.82:0/637539529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f390415c740 msgr2=0x7f390409aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.819+0000 7f390c212640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f390415c740 0x7f390409aa10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f38fc007e30 tx=0x7f38fc00e4b0 comp rx=0 tx=0).stop 2024-06-02T22:52:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.819+0000 7f390c212640 1 -- 172.21.15.82:0/637539529 shutdown_connections 2024-06-02T22:52:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.819+0000 7f390c212640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38e806be30 0x7f38e806e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.819+0000 7f390c212640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f390415c740 0x7f390409aa10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.819+0000 7f390c212640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f390415c230 0x7f390414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.819+0000 7f390c212640 1 --2- 172.21.15.82:0/637539529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f390415be50 0x7f39040cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.819+0000 7f390c212640 1 -- 172.21.15.82:0/637539529 >> 172.21.15.82:0/637539529 conn(0x7f39040b1980 msgr2=0x7f390415e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.820+0000 7f390c212640 1 -- 172.21.15.82:0/637539529 shutdown_connections 2024-06-02T22:52:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.820+0000 7f390c212640 1 -- 172.21.15.82:0/637539529 wait complete. 2024-06-02T22:52:56.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T22:52:56.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.948+0000 7f47c22c1640 1 Processor -- start 2024-06-02T22:52:56.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.948+0000 7f47c22c1640 1 -- start start 2024-06-02T22:52:56.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.949+0000 7f47c22c1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47bc0b2f60 0x7f47bc0d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:56.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.949+0000 7f47c22c1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47bc0cf9a0 con 0x7f47bc15e1c0 2024-06-02T22:52:56.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.949+0000 7f47c22c1640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47bc0cfc70 con 0x7f47bc0d11f0 2024-06-02T22:52:56.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.949+0000 7f47c22c1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f47bc0cff50 con 0x7f47bc0b2f60 2024-06-02T22:52:56.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.949+0000 7f47c085e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47bc0b2f60 0x7f47bc0d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:56.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.949+0000 7f47bbfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f47bc15e1c0 0x7f47bc0d0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50584/0 (socket says 172.21.15.82:50584) 2024-06-02T22:52:56.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.949+0000 7f47bbfff640 1 -- 172.21.15.82:0/4179990153 learned_addr learned my addr 172.21.15.82:0/4179990153 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:56.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.949+0000 7f47c085e640 1 -- 172.21.15.82:0/4179990153 >> v1:172.21.15.184:6789/0 conn(0x7f47bc0d11f0 legacy=0x7f47bc0d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:56.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.949+0000 7f47c085e640 1 -- 172.21.15.82:0/4179990153 >> v1:172.21.15.82:6789/0 conn(0x7f47bc15e1c0 legacy=0x7f47bc0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:56.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.950+0000 7f47c085e640 1 -- 172.21.15.82:0/4179990153 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc0d0230 con 0x7f47bc0b2f60 2024-06-02T22:52:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.950+0000 7f47c085e640 1 --2- 172.21.15.82:0/4179990153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc0b2f60 0x7f47bc0d4bc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009d90 tx=0x7f47b402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456756bd71435911 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.950+0000 7f47baffd640 1 -- 172.21.15.82:0/4179990153 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4007740 con 0x7f47bc0b2f60 2024-06-02T22:52:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.950+0000 7f47baffd640 1 -- 172.21.15.82:0/4179990153 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b40078e0 con 0x7f47bc0b2f60 2024-06-02T22:52:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.950+0000 7f47baffd640 1 -- 172.21.15.82:0/4179990153 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4007cb0 con 0x7f47bc0b2f60 2024-06-02T22:52:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.951+0000 7f47c22c1640 1 -- 172.21.15.82:0/4179990153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc0b2f60 msgr2=0x7f47bc0d4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.951+0000 7f47c22c1640 1 --2- 172.21.15.82:0/4179990153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc0b2f60 0x7f47bc0d4bc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009d90 tx=0x7f47b402a6a0 comp rx=0 tx=0).stop 2024-06-02T22:52:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.951+0000 7f47c22c1640 1 -- 172.21.15.82:0/4179990153 shutdown_connections 2024-06-02T22:52:56.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.951+0000 7f47c22c1640 1 --2- 172.21.15.82:0/4179990153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc0b2f60 0x7f47bc0d4bc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:56.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.951+0000 7f47c22c1640 1 -- 172.21.15.82:0/4179990153 >> 172.21.15.82:0/4179990153 conn(0x7f47bc09d3e0 msgr2=0x7f47bc0d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:56.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.951+0000 7f47c22c1640 1 -- 172.21.15.82:0/4179990153 shutdown_connections 2024-06-02T22:52:56.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.951+0000 7f47c22c1640 1 -- 172.21.15.82:0/4179990153 wait complete. 2024-06-02T22:52:56.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.952+0000 7f47c22c1640 1 Processor -- start 2024-06-02T22:52:56.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.952+0000 7f47c22c1640 1 -- start start 2024-06-02T22:52:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47c22c1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc0b2f60 0x7f47bc157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47c22c1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47bc0d11f0 0x7f47bc0b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47c22c1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47bc15e1c0 0x7f47bc0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47c22c1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc0b0cd0 con 0x7f47bc0b2f60 2024-06-02T22:52:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47c22c1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc0d1d40 con 0x7f47bc15e1c0 2024-06-02T22:52:56.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47c22c1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f47bc0b0e50 con 0x7f47bc0d11f0 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47bbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc0b2f60 0x7f47bc157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47bbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc0b2f60 0x7f47bc157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40244/0 (socket says 172.21.15.82:40244) 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47bbfff640 1 -- 172.21.15.82:0/2186079713 learned_addr learned my addr 172.21.15.82:0/2186079713 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47bb7fe640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47bc0d11f0 0x7f47bc0b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47bbfff640 1 -- 172.21.15.82:0/2186079713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47bc0d11f0 msgr2=0x7f47bc0b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47bbfff640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47bc0d11f0 0x7f47bc0b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47bbfff640 1 -- 172.21.15.82:0/2186079713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47bc15e1c0 msgr2=0x7f47bc0b1ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47bbfff640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47bc15e1c0 0x7f47bc0b1ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47bbfff640 1 -- 172.21.15.82:0/2186079713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc0c7ca0 con 0x7f47bc0b2f60 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.953+0000 7f47bb7fe640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47bc0d11f0 0x7f47bc0b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.954+0000 7f47bbfff640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc0b2f60 0x7f47bc157bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c3c0 tx=0x7f47ac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.954+0000 7f47b8ff9640 1 -- 172.21.15.82:0/2186079713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac017070 con 0x7f47bc0b2f60 2024-06-02T22:52:56.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.954+0000 7f47b8ff9640 1 -- 172.21.15.82:0/2186079713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac005ce0 con 0x7f47bc0b2f60 2024-06-02T22:52:56.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.954+0000 7f47c22c1640 1 -- 172.21.15.82:0/2186079713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47bc0c7f10 con 0x7f47bc0b2f60 2024-06-02T22:52:56.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.954+0000 7f47b8ff9640 1 -- 172.21.15.82:0/2186079713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0072f0 con 0x7f47bc0b2f60 2024-06-02T22:52:56.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.954+0000 7f47c22c1640 1 -- 172.21.15.82:0/2186079713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47bc0c84d0 con 0x7f47bc0b2f60 2024-06-02T22:52:56.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.955+0000 7f47c22c1640 1 -- 172.21.15.82:0/2186079713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47bc0683c0 con 0x7f47bc0b2f60 2024-06-02T22:52:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.955+0000 7f47b8ff9640 1 -- 172.21.15.82:0/2186079713 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47ac01a070 con 0x7f47bc0b2f60 2024-06-02T22:52:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.956+0000 7f47b8ff9640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47a806be30 0x7f47a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.956+0000 7f47b8ff9640 1 -- 172.21.15.82:0/2186079713 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5619+0+0 (secure 0 0 0) 0x7f47ac08a170 con 0x7f47bc0b2f60 2024-06-02T22:52:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.956+0000 7f47bb7fe640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47a806be30 0x7f47a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.956+0000 7f47bb7fe640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47a806be30 0x7f47a806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0ba180 tx=0x7f47b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:56.960+0000 7f47b8ff9640 1 -- 172.21.15.82:0/2186079713 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f47ac058b70 con 0x7f47bc0b2f60 2024-06-02T22:52:57.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.136+0000 7f47c22c1640 1 -- 172.21.15.82:0/2186079713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f47bc0b5940 con 0x7f47bc0b2f60 2024-06-02T22:52:57.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.818+0000 7f47b8ff9640 1 -- 172.21.15.82:0/2186079713 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) ==== 170+0+0 (secure 0 0 0) 0x7f47ac058470 con 0x7f47bc0b2f60 2024-06-02T22:52:57.818 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2024-06-02T22:52:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.821+0000 7f47c22c1640 1 -- 172.21.15.82:0/2186079713 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47a806be30 msgr2=0x7f47a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.821+0000 7f47c22c1640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47a806be30 0x7f47a806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0ba180 tx=0x7f47b0009040 comp rx=0 tx=0).stop 2024-06-02T22:52:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.821+0000 7f47c22c1640 1 -- 172.21.15.82:0/2186079713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc0b2f60 msgr2=0x7f47bc157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.821+0000 7f47c22c1640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc0b2f60 0x7f47bc157bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c3c0 tx=0x7f47ac00c880 comp rx=0 tx=0).stop 2024-06-02T22:52:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.821+0000 7f47c22c1640 1 -- 172.21.15.82:0/2186079713 shutdown_connections 2024-06-02T22:52:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.821+0000 7f47c22c1640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f47a806be30 0x7f47a806e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.821+0000 7f47c22c1640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47bc15e1c0 0x7f47bc0b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.821+0000 7f47c22c1640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47bc0d11f0 0x7f47bc0b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.821+0000 7f47c22c1640 1 --2- 172.21.15.82:0/2186079713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47bc0b2f60 0x7f47bc157bf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.821+0000 7f47c22c1640 1 -- 172.21.15.82:0/2186079713 >> 172.21.15.82:0/2186079713 conn(0x7f47bc09d3e0 msgr2=0x7f47bc0b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.822+0000 7f47c22c1640 1 -- 172.21.15.82:0/2186079713 shutdown_connections 2024-06-02T22:52:57.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.822+0000 7f47c22c1640 1 -- 172.21.15.82:0/2186079713 wait complete. 2024-06-02T22:52:57.845 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T22:52:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.948+0000 7f736e8f5640 1 Processor -- start 2024-06-02T22:52:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.948+0000 7f736e8f5640 1 -- start start 2024-06-02T22:52:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.949+0000 7f736e8f5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f73680718e0 0x7f736815e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.949+0000 7f736e8f5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73680ce400 0x7f7368071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.949+0000 7f736e8f5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7368072690 con 0x7f7368072200 2024-06-02T22:52:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.949+0000 7f736e8f5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f736806e4e0 con 0x7f73680718e0 2024-06-02T22:52:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.949+0000 7f736e8f5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f73681622a0 con 0x7f73680ce400 2024-06-02T22:52:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.949+0000 7f7367fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f73680718e0 0x7f736815e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.949+0000 7f736ce92640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7368072200 0x7f736806e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50594/0 (socket says 172.21.15.82:50594) 2024-06-02T22:52:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.949+0000 7f736ce92640 1 -- 172.21.15.82:0/1586678033 learned_addr learned my addr 172.21.15.82:0/1586678033 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.950+0000 7f73677fe640 1 --2- 172.21.15.82:0/1586678033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73680ce400 0x7f7368071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.950+0000 7f7367fff640 1 -- 172.21.15.82:0/1586678033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73680ce400 msgr2=0x7f7368071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.950+0000 7f7367fff640 1 --2- 172.21.15.82:0/1586678033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73680ce400 0x7f7368071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.950+0000 7f7367fff640 1 -- 172.21.15.82:0/1586678033 >> v1:172.21.15.82:6789/0 conn(0x7f7368072200 legacy=0x7f736806e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.950+0000 7f7366ffd640 1 -- 172.21.15.82:0/1586678033 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463182926 0 0) 0x7f7368072690 con 0x7f7368072200 2024-06-02T22:52:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.950+0000 7f7367fff640 1 -- 172.21.15.82:0/1586678033 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7368162580 con 0x7f73680718e0 2024-06-02T22:52:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.950+0000 7f73677fe640 1 --2- 172.21.15.82:0/1586678033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73680ce400 0x7f7368071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:57.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.950+0000 7f7367fff640 1 --2- 172.21.15.82:0/1586678033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73680718e0 0x7f736815e910 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f73580097a0 tx=0x7f735802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670d8c33b8aa9356 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:57.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.951+0000 7f7366ffd640 1 -- 172.21.15.82:0/1586678033 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358037070 con 0x7f73680718e0 2024-06-02T22:52:57.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.951+0000 7f7366ffd640 1 -- 172.21.15.82:0/1586678033 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f735802adb0 con 0x7f73680718e0 2024-06-02T22:52:57.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.951+0000 7f7366ffd640 1 -- 172.21.15.82:0/1586678033 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358032660 con 0x7f73680718e0 2024-06-02T22:52:57.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.951+0000 7f736e8f5640 1 -- 172.21.15.82:0/1586678033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73680718e0 msgr2=0x7f736815e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:57.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.951+0000 7f736e8f5640 1 --2- 172.21.15.82:0/1586678033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73680718e0 0x7f736815e910 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f73580097a0 tx=0x7f735802a060 comp rx=0 tx=0).stop 2024-06-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.951+0000 7f736e8f5640 1 -- 172.21.15.82:0/1586678033 shutdown_connections 2024-06-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.951+0000 7f736e8f5640 1 --2- 172.21.15.82:0/1586678033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73680ce400 0x7f7368071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.951+0000 7f736e8f5640 1 --2- 172.21.15.82:0/1586678033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73680718e0 0x7f736815e910 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.951+0000 7f736e8f5640 1 -- 172.21.15.82:0/1586678033 >> 172.21.15.82:0/1586678033 conn(0x7f73680b22b0 msgr2=0x7f73680b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.951+0000 7f736e8f5640 1 -- 172.21.15.82:0/1586678033 shutdown_connections 2024-06-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.951+0000 7f736e8f5640 1 -- 172.21.15.82:0/1586678033 wait complete. 2024-06-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.952+0000 7f736e8f5640 1 Processor -- start 2024-06-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.953+0000 7f736e8f5640 1 -- start start 2024-06-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.953+0000 7f736e8f5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73680718e0 0x7f736814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.953+0000 7f736e8f5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7368072200 0x7f73680ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:57.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.953+0000 7f736e8f5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73680ce400 0x7f73680b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.953+0000 7f736e8f5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f736815c1a0 con 0x7f73680718e0 2024-06-02T22:52:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.953+0000 7f736e8f5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7368162b40 con 0x7f73680ce400 2024-06-02T22:52:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.953+0000 7f736e8f5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f736815c320 con 0x7f7368072200 2024-06-02T22:52:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.953+0000 7f7367fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73680718e0 0x7f736814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.953+0000 7f7367fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73680718e0 0x7f736814ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40256/0 (socket says 172.21.15.82:40256) 2024-06-02T22:52:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.953+0000 7f7367fff640 1 -- 172.21.15.82:0/2170390290 learned_addr learned my addr 172.21.15.82:0/2170390290 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f73677fe640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7368072200 0x7f73680ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f736ce92640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73680ce400 0x7f73680b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f7367fff640 1 -- 172.21.15.82:0/2170390290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7368072200 msgr2=0x7f73680ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f7367fff640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7368072200 0x7f73680ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:57.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f7367fff640 1 -- 172.21.15.82:0/2170390290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73680ce400 msgr2=0x7f73680b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f7367fff640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73680ce400 0x7f73680b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f7367fff640 1 -- 172.21.15.82:0/2170390290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73680ae290 con 0x7f73680718e0 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f736ce92640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73680ce400 0x7f73680b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f73677fe640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7368072200 0x7f73680ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f7367fff640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73680718e0 0x7f736814ae60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f735802a650 tx=0x7f73580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f7364ff9640 1 -- 172.21.15.82:0/2170390290 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358041020 con 0x7f73680718e0 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f7364ff9640 1 -- 172.21.15.82:0/2170390290 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f735803c870 con 0x7f73680718e0 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f736e8f5640 1 -- 172.21.15.82:0/2170390290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73680ae570 con 0x7f73680718e0 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f7364ff9640 1 -- 172.21.15.82:0/2170390290 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358037040 con 0x7f73680718e0 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.954+0000 7f736e8f5640 1 -- 172.21.15.82:0/2170390290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73680aeb30 con 0x7f73680718e0 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.955+0000 7f736e8f5640 1 -- 172.21.15.82:0/2170390290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73680683c0 con 0x7f73680718e0 2024-06-02T22:52:57.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.956+0000 7f7364ff9640 1 -- 172.21.15.82:0/2170390290 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7358044020 con 0x7f73680718e0 2024-06-02T22:52:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.956+0000 7f7364ff9640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f735406be60 0x7f735406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:57.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.956+0000 7f7364ff9640 1 -- 172.21.15.82:0/2170390290 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6001+0+0 (secure 0 0 0) 0x7f73580ab780 con 0x7f73680718e0 2024-06-02T22:52:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.956+0000 7f73677fe640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f735406be60 0x7f735406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.956+0000 7f73677fe640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f735406be60 0x7f735406e320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f73680cc560 tx=0x7f735c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:57.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:57.960+0000 7f7364ff9640 1 -- 172.21.15.82:0/2170390290 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f735804b030 con 0x7f73680718e0 2024-06-02T22:52:58.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.169+0000 7f736e8f5640 1 -- 172.21.15.82:0/2170390290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f73680675e0 con 0x7f73680718e0 2024-06-02T22:52:58.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.843+0000 7f7364ff9640 1 -- 172.21.15.82:0/2170390290 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f735807a000 con 0x7f73680718e0 2024-06-02T22:52:58.844 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 5 and data pool 6 2024-06-02T22:52:58.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.850+0000 7f736e8f5640 1 -- 172.21.15.82:0/2170390290 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f735406be60 msgr2=0x7f735406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:58.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.850+0000 7f736e8f5640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f735406be60 0x7f735406e320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f73680cc560 tx=0x7f735c008040 comp rx=0 tx=0).stop 2024-06-02T22:52:58.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.851+0000 7f736e8f5640 1 -- 172.21.15.82:0/2170390290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73680718e0 msgr2=0x7f736814ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:58.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.851+0000 7f736e8f5640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73680718e0 0x7f736814ae60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f735802a650 tx=0x7f73580046c0 comp rx=0 tx=0).stop 2024-06-02T22:52:58.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.851+0000 7f736e8f5640 1 -- 172.21.15.82:0/2170390290 shutdown_connections 2024-06-02T22:52:58.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.851+0000 7f736e8f5640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f735406be60 0x7f735406e320 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:58.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.851+0000 7f736e8f5640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73680ce400 0x7f73680b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:58.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.851+0000 7f736e8f5640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7368072200 0x7f73680ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:58.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.851+0000 7f736e8f5640 1 --2- 172.21.15.82:0/2170390290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73680718e0 0x7f736814ae60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:58.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.851+0000 7f736e8f5640 1 -- 172.21.15.82:0/2170390290 >> 172.21.15.82:0/2170390290 conn(0x7f73680b22b0 msgr2=0x7f73680cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:58.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.851+0000 7f736e8f5640 1 -- 172.21.15.82:0/2170390290 shutdown_connections 2024-06-02T22:52:58.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.851+0000 7f736e8f5640 1 -- 172.21.15.82:0/2170390290 wait complete. 2024-06-02T22:52:58.869 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.970+0000 7fd57d5f9640 1 Processor -- start 2024-06-02T22:52:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.970+0000 7fd57d5f9640 1 -- start start 2024-06-02T22:52:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.970+0000 7fd57d5f9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd578161cc0 0x7fd5780d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.970+0000 7fd57d5f9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5780d03e0 con 0x7fd5781618e0 2024-06-02T22:52:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.970+0000 7fd57d5f9640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5780d0100 con 0x7fd5780d4cd0 2024-06-02T22:52:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.970+0000 7fd57d5f9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd5780b4130 con 0x7fd578161cc0 2024-06-02T22:52:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.971+0000 7fd5767fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd578161cc0 0x7fd5780d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.971+0000 7fd576ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd5781618e0 0x7fd5780cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50598/0 (socket says 172.21.15.82:50598) 2024-06-02T22:52:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.971+0000 7fd576ffd640 1 -- 172.21.15.82:0/3875725284 learned_addr learned my addr 172.21.15.82:0/3875725284 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:52:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.971+0000 7fd5767fc640 1 -- 172.21.15.82:0/3875725284 >> v1:172.21.15.184:6789/0 conn(0x7fd5780d4cd0 legacy=0x7fd5780b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.971+0000 7fd5767fc640 1 -- 172.21.15.82:0/3875725284 >> v1:172.21.15.82:6789/0 conn(0x7fd5781618e0 legacy=0x7fd5780cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.971+0000 7fd5767fc640 1 -- 172.21.15.82:0/3875725284 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5780b3ae0 con 0x7fd578161cc0 2024-06-02T22:52:58.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.971+0000 7fd5767fc640 1 --2- 172.21.15.82:0/3875725284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd578161cc0 0x7fd5780d2510 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0097a0 tx=0x7fd56c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8a9f5b8f9f380f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:58.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.972+0000 7fd575ffb640 1 -- 172.21.15.82:0/3875725284 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c037070 con 0x7fd578161cc0 2024-06-02T22:52:58.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.972+0000 7fd575ffb640 1 -- 172.21.15.82:0/3875725284 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c032440 con 0x7fd578161cc0 2024-06-02T22:52:58.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.972+0000 7fd575ffb640 1 -- 172.21.15.82:0/3875725284 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c032810 con 0x7fd578161cc0 2024-06-02T22:52:58.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.972+0000 7fd57d5f9640 1 -- 172.21.15.82:0/3875725284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd578161cc0 msgr2=0x7fd5780d2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:58.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.972+0000 7fd57d5f9640 1 --2- 172.21.15.82:0/3875725284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd578161cc0 0x7fd5780d2510 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0097a0 tx=0x7fd56c02a1e0 comp rx=0 tx=0).stop 2024-06-02T22:52:58.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.972+0000 7fd57d5f9640 1 -- 172.21.15.82:0/3875725284 shutdown_connections 2024-06-02T22:52:58.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.972+0000 7fd57d5f9640 1 --2- 172.21.15.82:0/3875725284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd578161cc0 0x7fd5780d2510 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:58.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.972+0000 7fd57d5f9640 1 -- 172.21.15.82:0/3875725284 >> 172.21.15.82:0/3875725284 conn(0x7fd57809d410 msgr2=0x7fd5780d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:58.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.972+0000 7fd57d5f9640 1 -- 172.21.15.82:0/3875725284 shutdown_connections 2024-06-02T22:52:58.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.972+0000 7fd57d5f9640 1 -- 172.21.15.82:0/3875725284 wait complete. 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.974+0000 7fd57d5f9640 1 Processor -- start 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.974+0000 7fd57d5f9640 1 -- start start 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.974+0000 7fd57d5f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5780d4cd0 0x7fd57815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.974+0000 7fd57d5f9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5781618e0 0x7fd5780b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.974+0000 7fd57d5f9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd578161cc0 0x7fd5780b9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.974+0000 7fd57d5f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5780d2bd0 con 0x7fd5780d4cd0 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.974+0000 7fd57d5f9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd5780d2a50 con 0x7fd5781618e0 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.974+0000 7fd57d5f9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd5780d2d50 con 0x7fd578161cc0 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.974+0000 7fd576ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5780d4cd0 0x7fd57815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.974+0000 7fd576ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5780d4cd0 0x7fd57815cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40268/0 (socket says 172.21.15.82:40268) 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.974+0000 7fd576ffd640 1 -- 172.21.15.82:0/2430883048 learned_addr learned my addr 172.21.15.82:0/2430883048 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd5777fe640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd578161cc0 0x7fd5780b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd5767fc640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5781618e0 0x7fd5780b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd576ffd640 1 -- 172.21.15.82:0/2430883048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd578161cc0 msgr2=0x7fd5780b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd576ffd640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd578161cc0 0x7fd5780b9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd576ffd640 1 -- 172.21.15.82:0/2430883048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5781618e0 msgr2=0x7fd5780b8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd576ffd640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5781618e0 0x7fd5780b8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd576ffd640 1 -- 172.21.15.82:0/2430883048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5780cde00 con 0x7fd5780d4cd0 2024-06-02T22:52:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd576ffd640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5780d4cd0 0x7fd57815cae0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd56800cb10 tx=0x7fd56800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd55f7fe640 1 -- 172.21.15.82:0/2430883048 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568017070 con 0x7fd5780d4cd0 2024-06-02T22:52:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd55f7fe640 1 -- 172.21.15.82:0/2430883048 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56800ac70 con 0x7fd5780d4cd0 2024-06-02T22:52:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd55f7fe640 1 -- 172.21.15.82:0/2430883048 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568012620 con 0x7fd5780d4cd0 2024-06-02T22:52:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd57d5f9640 1 -- 172.21.15.82:0/2430883048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5780cbd40 con 0x7fd5780d4cd0 2024-06-02T22:52:58.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.975+0000 7fd57d5f9640 1 -- 172.21.15.82:0/2430883048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5780cc300 con 0x7fd5780d4cd0 2024-06-02T22:52:58.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.976+0000 7fd57d5f9640 1 -- 172.21.15.82:0/2430883048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd578068430 con 0x7fd5780d4cd0 2024-06-02T22:52:58.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.976+0000 7fd55f7fe640 1 -- 172.21.15.82:0/2430883048 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd56801a070 con 0x7fd5780d4cd0 2024-06-02T22:52:58.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.977+0000 7fd55f7fe640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd56406be30 0x7fd56406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:58.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.977+0000 7fd55f7fe640 1 -- 172.21.15.82:0/2430883048 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fd56808ad90 con 0x7fd5780d4cd0 2024-06-02T22:52:58.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.977+0000 7fd5767fc640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd56406be30 0x7fd56406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:58.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.977+0000 7fd5767fc640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd56406be30 0x7fd56406e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd56c034000 tx=0x7fd56c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:58.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:58.981+0000 7fd55f7fe640 1 -- 172.21.15.82:0/2430883048 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd5680595b0 con 0x7fd5780d4cd0 2024-06-02T22:52:59.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.159+0000 7fd57d5f9640 1 -- 172.21.15.82:0/2430883048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd57806d930 con 0x7fd5780d4cd0 2024-06-02T22:52:59.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.160+0000 7fd55f7fe640 1 -- 172.21.15.82:0/2430883048 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16955 (secure 0 0 0) 0x7fd568058eb0 con 0x7fd5780d4cd0 2024-06-02T22:52:59.160 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:59.160 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":37,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:58.170412+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:56.075878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:57.154913+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:59.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 -- 172.21.15.82:0/2430883048 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd56406be30 msgr2=0x7fd56406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:59.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd56406be30 0x7fd56406e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd56c034000 tx=0x7fd56c02e000 comp rx=0 tx=0).stop 2024-06-02T22:52:59.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 -- 172.21.15.82:0/2430883048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5780d4cd0 msgr2=0x7fd57815cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:59.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5780d4cd0 0x7fd57815cae0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd56800cb10 tx=0x7fd56800a060 comp rx=0 tx=0).stop 2024-06-02T22:52:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 -- 172.21.15.82:0/2430883048 shutdown_connections 2024-06-02T22:52:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd56406be30 0x7fd56406e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd578161cc0 0x7fd5780b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5781618e0 0x7fd5780b8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 --2- 172.21.15.82:0/2430883048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5780d4cd0 0x7fd57815cae0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 -- 172.21.15.82:0/2430883048 >> 172.21.15.82:0/2430883048 conn(0x7fd57809d410 msgr2=0x7fd5780d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 -- 172.21.15.82:0/2430883048 shutdown_connections 2024-06-02T22:52:59.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.162+0000 7fd57d5f9640 1 -- 172.21.15.82:0/2430883048 wait complete. 2024-06-02T22:52:59.174 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:59.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.273+0000 7f768da58640 1 Processor -- start 2024-06-02T22:52:59.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.273+0000 7f768da58640 1 -- start start 2024-06-02T22:52:59.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.274+0000 7f768da58640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f768815c1d0 0x7f76880d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.274+0000 7f768da58640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76880d0430 0x7f76880ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.274+0000 7f768da58640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76880ced80 0x7f76880cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.274+0000 7f768da58640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f76880cf1f0 con 0x7f76880d0430 2024-06-02T22:52:59.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.274+0000 7f768da58640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f76880c5fb0 con 0x7f768815c1d0 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.274+0000 7f768da58640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f76880c59a0 con 0x7f76880ced80 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.274+0000 7f767ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76880d0430 0x7f76880ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.274+0000 7f767ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76880d0430 0x7f76880ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40278/0 (socket says 172.21.15.82:40278) 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.274+0000 7f767ffff640 1 -- 172.21.15.82:0/2615625425 learned_addr learned my addr 172.21.15.82:0/2615625425 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.275+0000 7f7686ffd640 1 --2- 172.21.15.82:0/2615625425 >> v2:172.21.15.184:3300/0 conn(0x7f768815c1d0 0x7f76880d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.275+0000 7f76877fe640 1 --2- 172.21.15.82:0/2615625425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76880ced80 0x7f76880cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.275+0000 7f767ffff640 1 -- 172.21.15.82:0/2615625425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76880ced80 msgr2=0x7f76880cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.275+0000 7f767ffff640 1 --2- 172.21.15.82:0/2615625425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76880ced80 0x7f76880cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.275+0000 7f767ffff640 1 -- 172.21.15.82:0/2615625425 >> v2:172.21.15.184:3300/0 conn(0x7f768815c1d0 msgr2=0x7f76880d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.275+0000 7f767ffff640 1 --2- 172.21.15.82:0/2615625425 >> v2:172.21.15.184:3300/0 conn(0x7f768815c1d0 0x7f76880d2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.275+0000 7f767ffff640 1 -- 172.21.15.82:0/2615625425 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76880d0910 con 0x7f76880d0430 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.275+0000 7f76877fe640 1 --2- 172.21.15.82:0/2615625425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76880ced80 0x7f76880cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.275+0000 7f767ffff640 1 --2- 172.21.15.82:0/2615625425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76880d0430 0x7f76880ce840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f76880722a0 tx=0x7f767002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e0f3ed9ddab6c5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:59.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.275+0000 7f76867fc640 1 -- 172.21.15.82:0/2615625425 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670037070 con 0x7f76880d0430 2024-06-02T22:52:59.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.275+0000 7f76867fc640 1 -- 172.21.15.82:0/2615625425 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7670032440 con 0x7f76880d0430 2024-06-02T22:52:59.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.276+0000 7f76867fc640 1 -- 172.21.15.82:0/2615625425 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670032810 con 0x7f76880d0430 2024-06-02T22:52:59.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.276+0000 7f768da58640 1 -- 172.21.15.82:0/2615625425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76880d0430 msgr2=0x7f76880ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:59.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.276+0000 7f768da58640 1 --2- 172.21.15.82:0/2615625425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76880d0430 0x7f76880ce840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f76880722a0 tx=0x7f767002a140 comp rx=0 tx=0).stop 2024-06-02T22:52:59.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.276+0000 7f768da58640 1 -- 172.21.15.82:0/2615625425 shutdown_connections 2024-06-02T22:52:59.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.276+0000 7f768da58640 1 --2- 172.21.15.82:0/2615625425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76880ced80 0x7f76880cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.276+0000 7f768da58640 1 --2- 172.21.15.82:0/2615625425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76880d0430 0x7f76880ce840 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.276+0000 7f768da58640 1 --2- 172.21.15.82:0/2615625425 >> v2:172.21.15.184:3300/0 conn(0x7f768815c1d0 0x7f76880d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.276+0000 7f768da58640 1 -- 172.21.15.82:0/2615625425 >> 172.21.15.82:0/2615625425 conn(0x7f76880d1e50 msgr2=0x7f76880d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:59.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.276+0000 7f768da58640 1 -- 172.21.15.82:0/2615625425 shutdown_connections 2024-06-02T22:52:59.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.276+0000 7f768da58640 1 -- 172.21.15.82:0/2615625425 wait complete. 2024-06-02T22:52:59.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.277+0000 7f768da58640 1 Processor -- start 2024-06-02T22:52:59.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.277+0000 7f768da58640 1 -- start start 2024-06-02T22:52:59.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f768da58640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76880ced80 0x7f76881ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f768da58640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76880d0430 0x7f76880af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f768da58640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768815c1d0 0x7f76881f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f768da58640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f768815c5b0 con 0x7f76880ced80 2024-06-02T22:52:59.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f768da58640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f76880c5c40 con 0x7f768815c1d0 2024-06-02T22:52:59.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f768da58640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f76880cf520 con 0x7f76880d0430 2024-06-02T22:52:59.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f7686ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76880ced80 0x7f76881ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:59.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f7686ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76880ced80 0x7f76881ef0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40294/0 (socket says 172.21.15.82:40294) 2024-06-02T22:52:59.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f7686ffd640 1 -- 172.21.15.82:0/3670926734 learned_addr learned my addr 172.21.15.82:0/3670926734 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:59.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f767ffff640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76880d0430 0x7f76880af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:59.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f76877fe640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768815c1d0 0x7f76881f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:59.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f7686ffd640 1 -- 172.21.15.82:0/3670926734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76880d0430 msgr2=0x7f76880af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:59.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f7686ffd640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76880d0430 0x7f76880af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f7686ffd640 1 -- 172.21.15.82:0/3670926734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768815c1d0 msgr2=0x7f76881f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:59.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.278+0000 7f7686ffd640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768815c1d0 0x7f76881f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.279+0000 7f7686ffd640 1 -- 172.21.15.82:0/3670926734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768809ee10 con 0x7f76880ced80 2024-06-02T22:52:59.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.279+0000 7f76877fe640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768815c1d0 0x7f76881f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:59.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.279+0000 7f7686ffd640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76880ced80 0x7f76881ef0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f767800c7f0 tx=0x7f767800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:59.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.279+0000 7f7684ff9640 1 -- 172.21.15.82:0/3670926734 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678015070 con 0x7f76880ced80 2024-06-02T22:52:59.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.279+0000 7f7684ff9640 1 -- 172.21.15.82:0/3670926734 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7678004220 con 0x7f76880ced80 2024-06-02T22:52:59.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.279+0000 7f768da58640 1 -- 172.21.15.82:0/3670926734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768809f0b0 con 0x7f76880ced80 2024-06-02T22:52:59.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.279+0000 7f7684ff9640 1 -- 172.21.15.82:0/3670926734 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678007620 con 0x7f76880ced80 2024-06-02T22:52:59.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.279+0000 7f768da58640 1 -- 172.21.15.82:0/3670926734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768809f670 con 0x7f76880ced80 2024-06-02T22:52:59.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.280+0000 7f768da58640 1 -- 172.21.15.82:0/3670926734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7688068430 con 0x7f76880ced80 2024-06-02T22:52:59.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.280+0000 7f7684ff9640 1 -- 172.21.15.82:0/3670926734 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76780079d0 con 0x7f76880ced80 2024-06-02T22:52:59.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.281+0000 7f7684ff9640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f766806be60 0x7f766806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.281+0000 7f7684ff9640 1 -- 172.21.15.82:0/3670926734 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f767808afc0 con 0x7f76880ced80 2024-06-02T22:52:59.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.281+0000 7f767ffff640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f766806be60 0x7f766806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:59.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.281+0000 7f767ffff640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f766806be60 0x7f766806e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7670034000 tx=0x7f767002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:59.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.285+0000 7f7684ff9640 1 -- 172.21.15.82:0/3670926734 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f76780597e0 con 0x7f76880ced80 2024-06-02T22:52:59.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.463+0000 7f768da58640 1 -- 172.21.15.82:0/3670926734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f768809e140 con 0x7f76880ced80 2024-06-02T22:52:59.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.464+0000 7f7684ff9640 1 -- 172.21.15.82:0/3670926734 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16955 (secure 0 0 0) 0x7f76780590e0 con 0x7f76880ced80 2024-06-02T22:52:59.464 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:52:59.464 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":37,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:58.170412+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:56.075878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:57.154913+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 -- 172.21.15.82:0/3670926734 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f766806be60 msgr2=0x7f766806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f766806be60 0x7f766806e320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7670034000 tx=0x7f767002e000 comp rx=0 tx=0).stop 2024-06-02T22:52:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 -- 172.21.15.82:0/3670926734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76880ced80 msgr2=0x7f76881ef0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76880ced80 0x7f76881ef0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f767800c7f0 tx=0x7f767800ccb0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 -- 172.21.15.82:0/3670926734 shutdown_connections 2024-06-02T22:52:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f766806be60 0x7f766806e320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768815c1d0 0x7f76881f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76880d0430 0x7f76880af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 --2- 172.21.15.82:0/3670926734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76880ced80 0x7f76881ef0a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 -- 172.21.15.82:0/3670926734 >> 172.21.15.82:0/3670926734 conn(0x7f76880d1e50 msgr2=0x7f76880c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 -- 172.21.15.82:0/3670926734 shutdown_connections 2024-06-02T22:52:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.466+0000 7f768da58640 1 -- 172.21.15.82:0/3670926734 wait complete. 2024-06-02T22:52:59.477 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-02T22:52:59.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.579+0000 7f72de7f9640 1 Processor -- start 2024-06-02T22:52:59.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.580+0000 7f72de7f9640 1 -- start start 2024-06-02T22:52:59.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.580+0000 7f72de7f9640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f72d80b3800 0x7f72d80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.580+0000 7f72de7f9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72d80cf190 0x7f72d80d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.580+0000 7f72de7f9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d80cf600 con 0x7f72d80d08f0 2024-06-02T22:52:59.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.580+0000 7f72de7f9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f72d80d1c80 con 0x7f72d80cf190 2024-06-02T22:52:59.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.580+0000 7f72de7f9640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f72d80b3cb0 con 0x7f72d80b3800 2024-06-02T22:52:59.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.580+0000 7f72dcd96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72d80cf190 0x7f72d80d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.580+0000 7f72dcd96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72d80cf190 0x7f72d80d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40308/0 (socket says 172.21.15.82:40308) 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.580+0000 7f72d7fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f72d80d08f0 0x7f72d80d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50608/0 (socket says 172.21.15.82:50608) 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.580+0000 7f72dcd96640 1 -- 172.21.15.82:0/314123898 learned_addr learned my addr 172.21.15.82:0/314123898 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.581+0000 7f72dcd96640 1 -- 172.21.15.82:0/314123898 >> v2:172.21.15.184:3300/0 conn(0x7f72d80b3800 msgr2=0x7f72d80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.581+0000 7f72d77fe640 1 --2- 172.21.15.82:0/314123898 >> v2:172.21.15.184:3300/0 conn(0x7f72d80b3800 0x7f72d80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.581+0000 7f72dcd96640 1 --2- 172.21.15.82:0/314123898 >> v2:172.21.15.184:3300/0 conn(0x7f72d80b3800 0x7f72d80cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.581+0000 7f72dcd96640 1 -- 172.21.15.82:0/314123898 >> v1:172.21.15.82:6789/0 conn(0x7f72d80d08f0 legacy=0x7f72d80d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.581+0000 7f72d6ffd640 1 -- 172.21.15.82:0/314123898 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1974067805 0 0) 0x7f72d80cf600 con 0x7f72d80d08f0 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.581+0000 7f72dcd96640 1 -- 172.21.15.82:0/314123898 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d80cf8a0 con 0x7f72d80cf190 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.581+0000 7f72dcd96640 1 --2- 172.21.15.82:0/314123898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d80cf190 0x7f72d80d23f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009e50 tx=0x7f72d002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5a75ca486dbd41 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.582+0000 7f72d6ffd640 1 -- 172.21.15.82:0/314123898 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0036070 con 0x7f72d80cf190 2024-06-02T22:52:59.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.582+0000 7f72d6ffd640 1 -- 172.21.15.82:0/314123898 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d0031600 con 0x7f72d80cf190 2024-06-02T22:52:59.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.582+0000 7f72d6ffd640 1 -- 172.21.15.82:0/314123898 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d00319d0 con 0x7f72d80cf190 2024-06-02T22:52:59.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.582+0000 7f72de7f9640 1 -- 172.21.15.82:0/314123898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d80cf190 msgr2=0x7f72d80d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:59.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.582+0000 7f72de7f9640 1 --2- 172.21.15.82:0/314123898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d80cf190 0x7f72d80d23f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009e50 tx=0x7f72d002a760 comp rx=0 tx=0).stop 2024-06-02T22:52:59.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.582+0000 7f72de7f9640 1 -- 172.21.15.82:0/314123898 shutdown_connections 2024-06-02T22:52:59.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.582+0000 7f72de7f9640 1 --2- 172.21.15.82:0/314123898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d80cf190 0x7f72d80d23f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.582+0000 7f72de7f9640 1 --2- 172.21.15.82:0/314123898 >> v2:172.21.15.184:3300/0 conn(0x7f72d80b3800 0x7f72d80cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.582+0000 7f72de7f9640 1 -- 172.21.15.82:0/314123898 >> 172.21.15.82:0/314123898 conn(0x7f72d809d3c0 msgr2=0x7f72d80d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:59.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.582+0000 7f72de7f9640 1 -- 172.21.15.82:0/314123898 shutdown_connections 2024-06-02T22:52:59.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.582+0000 7f72de7f9640 1 -- 172.21.15.82:0/314123898 wait complete. 2024-06-02T22:52:59.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.583+0000 7f72de7f9640 1 Processor -- start 2024-06-02T22:52:59.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.584+0000 7f72de7f9640 1 -- start start 2024-06-02T22:52:59.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.584+0000 7f72de7f9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72d80b3800 0x7f72d80b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.584+0000 7f72de7f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d80cf190 0x7f72d80c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.584+0000 7f72de7f9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72d80d08f0 0x7f72d80c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.584+0000 7f72de7f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72d80d1ed0 con 0x7f72d80cf190 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.584+0000 7f72de7f9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f72d80cfe60 con 0x7f72d80d08f0 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.584+0000 7f72de7f9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f72d80b50c0 con 0x7f72d80b3800 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.584+0000 7f72d77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d80cf190 0x7f72d80c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.584+0000 7f72d77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d80cf190 0x7f72d80c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40312/0 (socket says 172.21.15.82:40312) 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.584+0000 7f72d77fe640 1 -- 172.21.15.82:0/3487122217 learned_addr learned my addr 172.21.15.82:0/3487122217 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.585+0000 7f72d77fe640 1 -- 172.21.15.82:0/3487122217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72d80b3800 msgr2=0x7f72d80b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.585+0000 7f72d77fe640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72d80b3800 0x7f72d80b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.585+0000 7f72d77fe640 1 -- 172.21.15.82:0/3487122217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72d80d08f0 msgr2=0x7f72d80c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.585+0000 7f72d77fe640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72d80d08f0 0x7f72d80c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.585+0000 7f72d77fe640 1 -- 172.21.15.82:0/3487122217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d815f820 con 0x7f72d80cf190 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.585+0000 7f72d77fe640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d80cf190 0x7f72d80c94b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00c820 tx=0x7f72cc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.585+0000 7f72d4ff9640 1 -- 172.21.15.82:0/3487122217 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc015070 con 0x7f72d80cf190 2024-06-02T22:52:59.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.585+0000 7f72d4ff9640 1 -- 172.21.15.82:0/3487122217 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc004240 con 0x7f72d80cf190 2024-06-02T22:52:59.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.585+0000 7f72d4ff9640 1 -- 172.21.15.82:0/3487122217 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc00ce10 con 0x7f72d80cf190 2024-06-02T22:52:59.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.585+0000 7f72de7f9640 1 -- 172.21.15.82:0/3487122217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d80cb3d0 con 0x7f72d80cf190 2024-06-02T22:52:59.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.585+0000 7f72de7f9640 1 -- 172.21.15.82:0/3487122217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d815c7a0 con 0x7f72d80cf190 2024-06-02T22:52:59.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.586+0000 7f72de7f9640 1 -- 172.21.15.82:0/3487122217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d80683c0 con 0x7f72d80cf190 2024-06-02T22:52:59.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.587+0000 7f72d4ff9640 1 -- 172.21.15.82:0/3487122217 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72cc007830 con 0x7f72d80cf190 2024-06-02T22:52:59.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.587+0000 7f72d4ff9640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f72c406be30 0x7f72c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:59.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.587+0000 7f72d4ff9640 1 -- 172.21.15.82:0/3487122217 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f72cc08aee0 con 0x7f72d80cf190 2024-06-02T22:52:59.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.587+0000 7f72d7fff640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f72c406be30 0x7f72c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:59.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.587+0000 7f72d7fff640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f72c406be30 0x7f72c406e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72c8007fd0 tx=0x7f72c8007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:59.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.591+0000 7f72d4ff9640 1 -- 172.21.15.82:0/3487122217 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f72cc059700 con 0x7f72d80cf190 2024-06-02T22:52:59.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:52:59.801+0000 7f72de7f9640 1 -- 172.21.15.82:0/3487122217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f72d80d1730 con 0x7f72d80cf190 2024-06-02T22:53:00.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.494+0000 7f72d4ff9640 1 -- 172.21.15.82:0/3487122217 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f72cc059000 con 0x7f72d80cf190 2024-06-02T22:53:00.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.496+0000 7f72de7f9640 1 -- 172.21.15.82:0/3487122217 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f72c406be30 msgr2=0x7f72c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:00.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.496+0000 7f72de7f9640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f72c406be30 0x7f72c406e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72c8007fd0 tx=0x7f72c8007960 comp rx=0 tx=0).stop 2024-06-02T22:53:00.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.496+0000 7f72de7f9640 1 -- 172.21.15.82:0/3487122217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d80cf190 msgr2=0x7f72d80c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:00.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.496+0000 7f72de7f9640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d80cf190 0x7f72d80c94b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00c820 tx=0x7f72cc00cce0 comp rx=0 tx=0).stop 2024-06-02T22:53:00.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.497+0000 7f72de7f9640 1 -- 172.21.15.82:0/3487122217 shutdown_connections 2024-06-02T22:53:00.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.497+0000 7f72de7f9640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f72c406be30 0x7f72c406e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:00.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.497+0000 7f72de7f9640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72d80d08f0 0x7f72d80c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:00.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.497+0000 7f72de7f9640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d80cf190 0x7f72d80c94b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:00.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.497+0000 7f72de7f9640 1 --2- 172.21.15.82:0/3487122217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72d80b3800 0x7f72d80b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:00.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.497+0000 7f72de7f9640 1 -- 172.21.15.82:0/3487122217 >> 172.21.15.82:0/3487122217 conn(0x7f72d809d3c0 msgr2=0x7f72d80caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:00.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.497+0000 7f72de7f9640 1 -- 172.21.15.82:0/3487122217 shutdown_connections 2024-06-02T22:53:00.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.497+0000 7f72de7f9640 1 -- 172.21.15.82:0/3487122217 wait complete. 2024-06-02T22:53:00.509 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-02T22:53:00.510 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-02T22:53:00.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.616+0000 7fd6c88bd640 1 Processor -- start 2024-06-02T22:53:00.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.617+0000 7fd6c88bd640 1 -- start start 2024-06-02T22:53:00.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.617+0000 7fd6c88bd640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd6c40d08f0 0x7fd6c40b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:00.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.617+0000 7fd6c88bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6c40cf360 0x7fd6c40d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.617+0000 7fd6c88bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6c40cf8a0 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.617+0000 7fd6c88bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c40d1c80 con 0x7fd6c40cf360 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.617+0000 7fd6c88bd640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c40cfb80 con 0x7fd6c40d08f0 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.618+0000 7fd6c2d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6c40cf360 0x7fd6c40d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.618+0000 7fd6c1d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd6c40d0cd0 0x7fd6c40cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50614/0 (socket says 172.21.15.82:50614) 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.618+0000 7fd6c2d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6c40cf360 0x7fd6c40d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40318/0 (socket says 172.21.15.82:40318) 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.618+0000 7fd6c1d9b640 1 -- 172.21.15.82:0/1949918797 learned_addr learned my addr 172.21.15.82:0/1949918797 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.618+0000 7fd6c2d9d640 1 -- 172.21.15.82:0/1949918797 >> v2:172.21.15.184:3300/0 conn(0x7fd6c40d08f0 msgr2=0x7fd6c40b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.618+0000 7fd6c259c640 1 --2- 172.21.15.82:0/1949918797 >> v2:172.21.15.184:3300/0 conn(0x7fd6c40d08f0 0x7fd6c40b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.618+0000 7fd6c2d9d640 1 --2- 172.21.15.82:0/1949918797 >> v2:172.21.15.184:3300/0 conn(0x7fd6c40d08f0 0x7fd6c40b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.618+0000 7fd6c2d9d640 1 -- 172.21.15.82:0/1949918797 >> v1:172.21.15.82:6789/0 conn(0x7fd6c40d0cd0 legacy=0x7fd6c40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.618+0000 7fd6c159a640 1 -- 172.21.15.82:0/1949918797 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530694230 0 0) 0x7fd6c40cf8a0 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.618+0000 7fd6c2d9d640 1 -- 172.21.15.82:0/1949918797 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c40cfe60 con 0x7fd6c40cf360 2024-06-02T22:53:00.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.618+0000 7fd6c259c640 1 --2- 172.21.15.82:0/1949918797 >> v2:172.21.15.184:3300/0 conn(0x7fd6c40d08f0 0x7fd6c40b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:00.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c2d9d640 1 --2- 172.21.15.82:0/1949918797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c40cf360 0x7fd6c40d23f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009d90 tx=0x7fd6bc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55bd70cfb97e6aac server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:00.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c159a640 1 -- 172.21.15.82:0/1949918797 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc007740 con 0x7fd6c40cf360 2024-06-02T22:53:00.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c159a640 1 -- 172.21.15.82:0/1949918797 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6bc0078e0 con 0x7fd6c40cf360 2024-06-02T22:53:00.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c159a640 1 -- 172.21.15.82:0/1949918797 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc007cb0 con 0x7fd6c40cf360 2024-06-02T22:53:00.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c88bd640 1 -- 172.21.15.82:0/1949918797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c40cf360 msgr2=0x7fd6c40d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c88bd640 1 --2- 172.21.15.82:0/1949918797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c40cf360 0x7fd6c40d23f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009d90 tx=0x7fd6bc02a6a0 comp rx=0 tx=0).stop 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c88bd640 1 -- 172.21.15.82:0/1949918797 shutdown_connections 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c88bd640 1 --2- 172.21.15.82:0/1949918797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c40cf360 0x7fd6c40d23f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c88bd640 1 --2- 172.21.15.82:0/1949918797 >> v2:172.21.15.184:3300/0 conn(0x7fd6c40d08f0 0x7fd6c40b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c88bd640 1 -- 172.21.15.82:0/1949918797 >> 172.21.15.82:0/1949918797 conn(0x7fd6c409d3c0 msgr2=0x7fd6c40d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c88bd640 1 -- 172.21.15.82:0/1949918797 shutdown_connections 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.619+0000 7fd6c88bd640 1 -- 172.21.15.82:0/1949918797 wait complete. 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.621+0000 7fd6c88bd640 1 Processor -- start 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.621+0000 7fd6c88bd640 1 -- start start 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.621+0000 7fd6c88bd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6c40cf360 0x7fd6c40cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.621+0000 7fd6c88bd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6c40d08f0 0x7fd6c415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.621+0000 7fd6c88bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c40d0cd0 0x7fd6c415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:00.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.621+0000 7fd6c88bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c40d1180 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.621+0000 7fd6c88bd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c40b50c0 con 0x7fd6c40d08f0 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.621+0000 7fd6c88bd640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c40b4a60 con 0x7fd6c40cf360 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c40d0cd0 0x7fd6c415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c40d0cd0 0x7fd6c415bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40330/0 (socket says 172.21.15.82:40330) 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c2d9d640 1 -- 172.21.15.82:0/2803074690 learned_addr learned my addr 172.21.15.82:0/2803074690 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c1d9b640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6c40d08f0 0x7fd6c415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c2d9d640 1 -- 172.21.15.82:0/2803074690 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6c40cf360 msgr2=0x7fd6c40cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c2d9d640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6c40cf360 0x7fd6c40cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c2d9d640 1 -- 172.21.15.82:0/2803074690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6c40d08f0 msgr2=0x7fd6c415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c2d9d640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6c40d08f0 0x7fd6c415b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c2d9d640 1 -- 172.21.15.82:0/2803074690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c40cdae0 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c2d9d640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c40d0cd0 0x7fd6c415bcf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009eb0 tx=0x7fd6bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:00.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6baffd640 1 -- 172.21.15.82:0/2803074690 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc040070 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6baffd640 1 -- 172.21.15.82:0/2803074690 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6bc031c90 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c88bd640 1 -- 172.21.15.82:0/2803074690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c40cddc0 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6baffd640 1 -- 172.21.15.82:0/2803074690 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc045680 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.622+0000 7fd6c88bd640 1 -- 172.21.15.82:0/2803074690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c415b290 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.623+0000 7fd6c88bd640 1 -- 172.21.15.82:0/2803074690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c415b0c0 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.624+0000 7fd6baffd640 1 -- 172.21.15.82:0/2803074690 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6bc039040 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.624+0000 7fd6baffd640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd6a406be30 0x7fd6a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:00.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.624+0000 7fd6baffd640 1 -- 172.21.15.82:0/2803074690 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fd6bc0aca20 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.624+0000 7fd6c259c640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd6a406be30 0x7fd6a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:00.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.624+0000 7fd6c259c640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd6a406be30 0x7fd6a406e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4006fd0 tx=0x7fd6b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:00.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.628+0000 7fd6baffd640 1 -- 172.21.15.82:0/2803074690 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd6bc043360 con 0x7fd6c40d0cd0 2024-06-02T22:53:00.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:00.840+0000 7fd6c88bd640 1 -- 172.21.15.82:0/2803074690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd6c415b490 con 0x7fd6c40d0cd0 2024-06-02T22:53:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.495+0000 7fd6baffd640 1 -- 172.21.15.82:0/2803074690 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fd6c415b490 con 0x7fd6c40d0cd0 2024-06-02T22:53:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 -- 172.21.15.82:0/2803074690 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd6a406be30 msgr2=0x7fd6a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd6a406be30 0x7fd6a406e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4006fd0 tx=0x7fd6b4008040 comp rx=0 tx=0).stop 2024-06-02T22:53:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 -- 172.21.15.82:0/2803074690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c40d0cd0 msgr2=0x7fd6c415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c40d0cd0 0x7fd6c415bcf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009eb0 tx=0x7fd6bc004a40 comp rx=0 tx=0).stop 2024-06-02T22:53:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 -- 172.21.15.82:0/2803074690 shutdown_connections 2024-06-02T22:53:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd6a406be30 0x7fd6a406e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6c40d0cd0 0x7fd6c415bcf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6c40d08f0 0x7fd6c415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 --2- 172.21.15.82:0/2803074690 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6c40cf360 0x7fd6c40cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 -- 172.21.15.82:0/2803074690 >> 172.21.15.82:0/2803074690 conn(0x7fd6c409d3c0 msgr2=0x7fd6c40b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 -- 172.21.15.82:0/2803074690 shutdown_connections 2024-06-02T22:53:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.499+0000 7fd6c88bd640 1 -- 172.21.15.82:0/2803074690 wait complete. 2024-06-02T22:53:01.512 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-02T22:53:01.512 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:53:01.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.617+0000 7f2500aa5640 1 Processor -- start 2024-06-02T22:53:01.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.617+0000 7f2500aa5640 1 -- start start 2024-06-02T22:53:01.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f2500aa5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f24fc0ae910 0x7f24fc06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f2500aa5640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f24fc06ea20 0x7f24fc0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f2500aa5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24fc06d130 con 0x7f24fc0cf190 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f2500aa5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f24fc06ee90 con 0x7f24fc0ae910 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f2500aa5640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f24fc06d410 con 0x7f24fc06ea20 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f24fa59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f24fc0ae910 0x7f24fc06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f24fad9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f24fc0cf190 0x7f24fc15ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39386/0 (socket says 172.21.15.82:39386) 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f24fad9d640 1 -- 172.21.15.82:0/1224225193 learned_addr learned my addr 172.21.15.82:0/1224225193 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f24f3fff640 1 --2- 172.21.15.82:0/1224225193 >> v2:172.21.15.184:3300/0 conn(0x7f24fc06ea20 0x7f24fc0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f24fa59c640 1 -- 172.21.15.82:0/1224225193 >> v2:172.21.15.184:3300/0 conn(0x7f24fc06ea20 msgr2=0x7f24fc0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f24fa59c640 1 --2- 172.21.15.82:0/1224225193 >> v2:172.21.15.184:3300/0 conn(0x7f24fc06ea20 0x7f24fc0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f24fa59c640 1 -- 172.21.15.82:0/1224225193 >> v1:172.21.15.82:6789/0 conn(0x7f24fc0cf190 legacy=0x7f24fc15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f24fa59c640 1 -- 172.21.15.82:0/1224225193 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc06d6f0 con 0x7f24fc0ae910 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f24f9d9b640 1 -- 172.21.15.82:0/1224225193 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286551807 0 0) 0x7f24fc06d130 con 0x7f24fc0cf190 2024-06-02T22:53:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.618+0000 7f24f3fff640 1 --2- 172.21.15.82:0/1224225193 >> v2:172.21.15.184:3300/0 conn(0x7f24fc06ea20 0x7f24fc0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.619+0000 7f24fa59c640 1 --2- 172.21.15.82:0/1224225193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc0ae910 0x7f24fc06e4e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f24fc070c80 tx=0x7f24ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e387f71558c0e698 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.619+0000 7f24f9d9b640 1 -- 172.21.15.82:0/1224225193 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec037070 con 0x7f24fc0ae910 2024-06-02T22:53:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.619+0000 7f24f9d9b640 1 -- 172.21.15.82:0/1224225193 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec032440 con 0x7f24fc0ae910 2024-06-02T22:53:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.619+0000 7f24f9d9b640 1 -- 172.21.15.82:0/1224225193 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec02ae60 con 0x7f24fc0ae910 2024-06-02T22:53:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.620+0000 7f2500aa5640 1 -- 172.21.15.82:0/1224225193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc0ae910 msgr2=0x7f24fc06e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.620+0000 7f2500aa5640 1 --2- 172.21.15.82:0/1224225193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc0ae910 0x7f24fc06e4e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f24fc070c80 tx=0x7f24ec02a110 comp rx=0 tx=0).stop 2024-06-02T22:53:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.620+0000 7f2500aa5640 1 -- 172.21.15.82:0/1224225193 shutdown_connections 2024-06-02T22:53:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.620+0000 7f2500aa5640 1 --2- 172.21.15.82:0/1224225193 >> v2:172.21.15.184:3300/0 conn(0x7f24fc06ea20 0x7f24fc0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.620+0000 7f2500aa5640 1 --2- 172.21.15.82:0/1224225193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc0ae910 0x7f24fc06e4e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.620+0000 7f2500aa5640 1 -- 172.21.15.82:0/1224225193 >> 172.21.15.82:0/1224225193 conn(0x7f24fc0b19f0 msgr2=0x7f24fc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:01.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.620+0000 7f2500aa5640 1 -- 172.21.15.82:0/1224225193 shutdown_connections 2024-06-02T22:53:01.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.620+0000 7f2500aa5640 1 -- 172.21.15.82:0/1224225193 wait complete. 2024-06-02T22:53:01.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.621+0000 7f2500aa5640 1 Processor -- start 2024-06-02T22:53:01.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.621+0000 7f2500aa5640 1 -- start start 2024-06-02T22:53:01.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f2500aa5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc06ea20 0x7f24fc14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f2500aa5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24fc0ae910 0x7f24fc15d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f2500aa5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24fc0cf190 0x7f24fc15dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f2500aa5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc0aecf0 con 0x7f24fc06ea20 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f2500aa5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc0cf5e0 con 0x7f24fc0ae910 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f2500aa5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f24fc0add50 con 0x7f24fc0cf190 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24fa59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc06ea20 0x7f24fc14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24fa59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc06ea20 0x7f24fc14c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49484/0 (socket says 172.21.15.82:49484) 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24fa59c640 1 -- 172.21.15.82:0/1099989339 learned_addr learned my addr 172.21.15.82:0/1099989339 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24fad9d640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24fc0cf190 0x7f24fc15dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24f3fff640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24fc0ae910 0x7f24fc15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24fa59c640 1 -- 172.21.15.82:0/1099989339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24fc0cf190 msgr2=0x7f24fc15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24fa59c640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24fc0cf190 0x7f24fc15dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24fa59c640 1 -- 172.21.15.82:0/1099989339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24fc0ae910 msgr2=0x7f24fc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24fa59c640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24fc0ae910 0x7f24fc15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24fa59c640 1 -- 172.21.15.82:0/1099989339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc151360 con 0x7f24fc06ea20 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24fad9d640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24fc0cf190 0x7f24fc15dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24f3fff640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24fc0ae910 0x7f24fc15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24fa59c640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc06ea20 0x7f24fc14c8b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f24ec000c00 tx=0x7f24ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.622+0000 7f24f2ffd640 1 -- 172.21.15.82:0/1099989339 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec037050 con 0x7f24fc06ea20 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.623+0000 7f24f2ffd640 1 -- 172.21.15.82:0/1099989339 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec038040 con 0x7f24fc06ea20 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.623+0000 7f2500aa5640 1 -- 172.21.15.82:0/1099989339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24fc151640 con 0x7f24fc06ea20 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.623+0000 7f24f2ffd640 1 -- 172.21.15.82:0/1099989339 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec004450 con 0x7f24fc06ea20 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.623+0000 7f2500aa5640 1 -- 172.21.15.82:0/1099989339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24fc15b4c0 con 0x7f24fc06ea20 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.624+0000 7f2500aa5640 1 -- 172.21.15.82:0/1099989339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24fc068430 con 0x7f24fc06ea20 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.624+0000 7f24f2ffd640 1 -- 172.21.15.82:0/1099989339 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24ec030980 con 0x7f24fc06ea20 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.624+0000 7f24f2ffd640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24e006be30 0x7f24e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.625+0000 7f24f2ffd640 1 -- 172.21.15.82:0/1099989339 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f24ec0abcc0 con 0x7f24fc06ea20 2024-06-02T22:53:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.625+0000 7f24f3fff640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24e006be30 0x7f24e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.625+0000 7f24f3fff640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24e006be30 0x7f24e006e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f24e4006fd0 tx=0x7f24e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:01.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.629+0000 7f24f2ffd640 1 -- 172.21.15.82:0/1099989339 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f24ec07a600 con 0x7f24fc06ea20 2024-06-02T22:53:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.838+0000 7f2500aa5640 1 -- 172.21.15.82:0/1099989339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24fc072c20 con 0x7f24fc06ea20 2024-06-02T22:53:01.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.838+0000 7f24f2ffd640 1 -- 172.21.15.82:0/1099989339 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5187 (secure 0 0 0) 0x7f24ec079f00 con 0x7f24fc06ea20 2024-06-02T22:53:01.838 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:01.838 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2802926071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2802926071},{"type":"v1","addr":"172.21.15.184:6834","nonce":2802926071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4908,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2538474234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2538474234},{"type":"v1","addr":"172.21.15.82:6836","nonce":2538474234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1604488280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1604488280},{"type":"v1","addr":"172.21.15.82:6837","nonce":1604488280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:58.170722+0000","modified":"2024-06-02T22:53:00.841866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3297362995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":3297362995},{"type":"v1","addr":"172.21.15.184:6835","nonce":3297362995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4929,"qdb_cluster":[4929]},"id":2}]} 2024-06-02T22:53:01.839 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2024-06-02T22:53:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 -- 172.21.15.82:0/1099989339 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24e006be30 msgr2=0x7f24e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24e006be30 0x7f24e006e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f24e4006fd0 tx=0x7f24e4008040 comp rx=0 tx=0).stop 2024-06-02T22:53:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 -- 172.21.15.82:0/1099989339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc06ea20 msgr2=0x7f24fc14c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc06ea20 0x7f24fc14c8b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f24ec000c00 tx=0x7f24ec0046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 -- 172.21.15.82:0/1099989339 shutdown_connections 2024-06-02T22:53:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f24e006be30 0x7f24e006e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24fc0cf190 0x7f24fc15dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24fc0ae910 0x7f24fc15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 --2- 172.21.15.82:0/1099989339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc06ea20 0x7f24fc14c8b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 -- 172.21.15.82:0/1099989339 >> 172.21.15.82:0/1099989339 conn(0x7f24fc0b19f0 msgr2=0x7f24fc0748f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 -- 172.21.15.82:0/1099989339 shutdown_connections 2024-06-02T22:53:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.840+0000 7f2500aa5640 1 -- 172.21.15.82:0/1099989339 wait complete. 2024-06-02T22:53:01.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:53:01.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.950+0000 7efd84770640 1 Processor -- start 2024-06-02T22:53:01.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.950+0000 7efd84770640 1 -- start start 2024-06-02T22:53:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.951+0000 7efd84770640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efd7c0b46d0 0x7efd7c071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.951+0000 7efd84770640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd7c072820 con 0x7efd7c0721a0 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.951+0000 7efd84770640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd7c072b00 con 0x7efd7c0cc6d0 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.951+0000 7efd84770640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7efd7c0725d0 con 0x7efd7c0b46d0 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.951+0000 7efd82d0d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efd7c0721a0 0x7efd7c165c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39392/0 (socket says 172.21.15.82:39392) 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.951+0000 7efd82d0d640 1 -- 172.21.15.82:0/188289063 learned_addr learned my addr 172.21.15.82:0/188289063 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd81d0b640 1 --2- 172.21.15.82:0/188289063 >> v2:172.21.15.184:3300/0 conn(0x7efd7c0b46d0 0x7efd7c071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036559738 0 0) 0x7efd7c072820 con 0x7efd7c0721a0 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd68003520 con 0x7efd7c0721a0 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 342796557 0 0) 0x7efd68003520 con 0x7efd7c0721a0 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 >> v2:172.21.15.184:3300/0 conn(0x7efd7c0b46d0 msgr2=0x7efd7c071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 --2- 172.21.15.82:0/188289063 >> v2:172.21.15.184:3300/0 conn(0x7efd7c0b46d0 0x7efd7c071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 >> v1:172.21.15.184:6789/0 conn(0x7efd7c0cc6d0 legacy=0x7efd7c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c072de0 con 0x7efd7c0721a0 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7efd740019f0 con 0x7efd7c0721a0 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 >> v1:172.21.15.82:6789/0 conn(0x7efd7c0721a0 legacy=0x7efd7c165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd680039b0 0x7efd68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd68004800 0x7efd68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd680051c0 0x7efd6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c0725d0 con 0x7efd680051c0 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efd6800c060 con 0x7efd680039b0 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7efd6800c260 con 0x7efd68004800 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd82d0d640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd680051c0 0x7efd6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd8250c640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd680039b0 0x7efd68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd81d0b640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd68004800 0x7efd68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd82d0d640 1 -- 172.21.15.82:0/188289063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd68004800 msgr2=0x7efd68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd82d0d640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd68004800 0x7efd68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd82d0d640 1 -- 172.21.15.82:0/188289063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd680039b0 msgr2=0x7efd68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd82d0d640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd680039b0 0x7efd68003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd82d0d640 1 -- 172.21.15.82:0/188289063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd68003520 con 0x7efd680051c0 2024-06-02T22:53:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.952+0000 7efd81d0b640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd68004800 0x7efd68004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.953+0000 7efd82d0d640 1 -- 172.21.15.82:0/188289063 reap_dead start 2024-06-02T22:53:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.953+0000 7efd82d0d640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd680051c0 0x7efd6800b9c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efd7400a850 tx=0x7efd68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6a11f91bdda990 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.953+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7400a4a0 con 0x7efd680051c0 2024-06-02T22:53:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.953+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7402f070 con 0x7efd680051c0 2024-06-02T22:53:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.953+0000 7efd8150a640 1 -- 172.21.15.82:0/188289063 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7402bce0 con 0x7efd680051c0 2024-06-02T22:53:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.954+0000 7efd84770640 1 -- 172.21.15.82:0/188289063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd680051c0 msgr2=0x7efd6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.954+0000 7efd84770640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd680051c0 0x7efd6800b9c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efd7400a850 tx=0x7efd68005830 comp rx=0 tx=0).stop 2024-06-02T22:53:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.954+0000 7efd84770640 1 -- 172.21.15.82:0/188289063 shutdown_connections 2024-06-02T22:53:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.954+0000 7efd84770640 1 --2- 172.21.15.82:0/188289063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd680051c0 0x7efd6800b9c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.954+0000 7efd84770640 1 -- 172.21.15.82:0/188289063 >> 172.21.15.82:0/188289063 conn(0x7efd7c0b19f0 msgr2=0x7efd7c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.954+0000 7efd84770640 1 -- 172.21.15.82:0/188289063 shutdown_connections 2024-06-02T22:53:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.954+0000 7efd84770640 1 -- 172.21.15.82:0/188289063 wait complete. 2024-06-02T22:53:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.955+0000 7efd84770640 1 Processor -- start 2024-06-02T22:53:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.955+0000 7efd84770640 1 -- start start 2024-06-02T22:53:01.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd84770640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd680051c0 0x7efd7c1507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd84770640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd7c1563b0 0x7efd7c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd84770640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd7c06cdb0 0x7efd7c0ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd84770640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c159f60 con 0x7efd7c1563b0 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd84770640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c15c890 con 0x7efd7c06cdb0 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd84770640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c071c60 con 0x7efd680051c0 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd81d0b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd7c1563b0 0x7efd7c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd81d0b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd7c1563b0 0x7efd7c0cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49502/0 (socket says 172.21.15.82:49502) 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd81d0b640 1 -- 172.21.15.82:0/2916949785 learned_addr learned my addr 172.21.15.82:0/2916949785 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd82d0d640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd7c06cdb0 0x7efd7c0ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd81d0b640 1 -- 172.21.15.82:0/2916949785 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd680051c0 msgr2=0x7efd7c1507f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd81d0b640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd680051c0 0x7efd7c1507f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd81d0b640 1 -- 172.21.15.82:0/2916949785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd7c06cdb0 msgr2=0x7efd7c0ad320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd81d0b640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd7c06cdb0 0x7efd7c0ad320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd81d0b640 1 -- 172.21.15.82:0/2916949785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c150d30 con 0x7efd7c1563b0 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd81d0b640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd7c1563b0 0x7efd7c0cdc80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd6c010880 tx=0x7efd6c010d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd72ffd640 1 -- 172.21.15.82:0/2916949785 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c00f040 con 0x7efd7c1563b0 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd72ffd640 1 -- 172.21.15.82:0/2916949785 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6c00eb60 con 0x7efd7c1563b0 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd84770640 1 -- 172.21.15.82:0/2916949785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7c06d370 con 0x7efd7c1563b0 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd72ffd640 1 -- 172.21.15.82:0/2916949785 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c01c400 con 0x7efd7c1563b0 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.956+0000 7efd84770640 1 -- 172.21.15.82:0/2916949785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd7c06d930 con 0x7efd7c1563b0 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.957+0000 7efd84770640 1 -- 172.21.15.82:0/2916949785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd7c068430 con 0x7efd7c1563b0 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.958+0000 7efd72ffd640 1 -- 172.21.15.82:0/2916949785 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd6c01c5a0 con 0x7efd7c1563b0 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.958+0000 7efd72ffd640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd6006be30 0x7efd6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.958+0000 7efd72ffd640 1 -- 172.21.15.82:0/2916949785 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7efd6c08b660 con 0x7efd7c1563b0 2024-06-02T22:53:01.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.958+0000 7efd8250c640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd6006be30 0x7efd6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:01.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.959+0000 7efd8250c640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd6006be30 0x7efd6006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efd78000c00 tx=0x7efd78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:01.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:01.962+0000 7efd72ffd640 1 -- 172.21.15.82:0/2916949785 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efd6c018030 con 0x7efd7c1563b0 2024-06-02T22:53:02.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.135+0000 7efd84770640 1 -- 172.21.15.82:0/2916949785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd7c075430 con 0x7efd7c1563b0 2024-06-02T22:53:02.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.136+0000 7efd72ffd640 1 -- 172.21.15.82:0/2916949785 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16942 (secure 0 0 0) 0x7efd6c089e20 con 0x7efd7c1563b0 2024-06-02T22:53:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":38,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:52:59.843709+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:56.075878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:57.154913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:53:02.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 -- 172.21.15.82:0/2916949785 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd6006be30 msgr2=0x7efd6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd6006be30 0x7efd6006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efd78000c00 tx=0x7efd78009040 comp rx=0 tx=0).stop 2024-06-02T22:53:02.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 -- 172.21.15.82:0/2916949785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd7c1563b0 msgr2=0x7efd7c0cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd7c1563b0 0x7efd7c0cdc80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd6c010880 tx=0x7efd6c010d40 comp rx=0 tx=0).stop 2024-06-02T22:53:02.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 -- 172.21.15.82:0/2916949785 shutdown_connections 2024-06-02T22:53:02.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efd6006be30 0x7efd6006e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd7c06cdb0 0x7efd7c0ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd7c1563b0 0x7efd7c0cdc80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 --2- 172.21.15.82:0/2916949785 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd680051c0 0x7efd7c1507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 -- 172.21.15.82:0/2916949785 >> 172.21.15.82:0/2916949785 conn(0x7efd7c0b19f0 msgr2=0x7efd7c15ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:02.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 -- 172.21.15.82:0/2916949785 shutdown_connections 2024-06-02T22:53:02.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.138+0000 7efd84770640 1 -- 172.21.15.82:0/2916949785 wait complete. 2024-06-02T22:53:02.149 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T22:53:02.149 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:53:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.248+0000 7f058c109640 1 Processor -- start 2024-06-02T22:53:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.249+0000 7f058c109640 1 -- start start 2024-06-02T22:53:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.249+0000 7f058c109640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f05841553c0 0x7f05840cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f058c109640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f05840b2cf0 0x7f058415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f058c109640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05840cec50 0x7f05840cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f058c109640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f05840b31a0 con 0x7f05840b2cf0 2024-06-02T22:53:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f058c109640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f058415c3f0 con 0x7f05841553c0 2024-06-02T22:53:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f058c109640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f05840b3420 con 0x7f05840cec50 2024-06-02T22:53:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f05896a4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f05840b2cf0 0x7f058415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f05896a4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f05840b2cf0 0x7f058415beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49506/0 (socket says 172.21.15.82:49506) 2024-06-02T22:53:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f05896a4640 1 -- 172.21.15.82:0/1378835796 learned_addr learned my addr 172.21.15.82:0/1378835796 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f058a6a6640 1 --2- 172.21.15.82:0/1378835796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05840cec50 0x7f05840cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f0589ea5640 1 --2- 172.21.15.82:0/1378835796 >> v2:172.21.15.184:3300/0 conn(0x7f05841553c0 0x7f05840cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f05896a4640 1 -- 172.21.15.82:0/1378835796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05840cec50 msgr2=0x7f05840cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f05896a4640 1 --2- 172.21.15.82:0/1378835796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05840cec50 0x7f05840cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f05896a4640 1 -- 172.21.15.82:0/1378835796 >> v2:172.21.15.184:3300/0 conn(0x7f05841553c0 msgr2=0x7f05840cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f05896a4640 1 --2- 172.21.15.82:0/1378835796 >> v2:172.21.15.184:3300/0 conn(0x7f05841553c0 0x7f05840cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.250+0000 7f05896a4640 1 -- 172.21.15.82:0/1378835796 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05840cc750 con 0x7f05840b2cf0 2024-06-02T22:53:02.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.251+0000 7f05896a4640 1 --2- 172.21.15.82:0/1378835796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05840b2cf0 0x7f058415beb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f05840cd990 tx=0x7f057802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659fdaacad1d2bd9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:02.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.251+0000 7f0588ea3640 1 -- 172.21.15.82:0/1378835796 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578037070 con 0x7f05840b2cf0 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.251+0000 7f0588ea3640 1 -- 172.21.15.82:0/1378835796 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0578032440 con 0x7f05840b2cf0 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.251+0000 7f0588ea3640 1 -- 172.21.15.82:0/1378835796 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578032810 con 0x7f05840b2cf0 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.251+0000 7f058c109640 1 -- 172.21.15.82:0/1378835796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05840b2cf0 msgr2=0x7f058415beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.251+0000 7f058c109640 1 --2- 172.21.15.82:0/1378835796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05840b2cf0 0x7f058415beb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f05840cd990 tx=0x7f057802a1e0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.251+0000 7f058c109640 1 -- 172.21.15.82:0/1378835796 shutdown_connections 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.251+0000 7f058c109640 1 --2- 172.21.15.82:0/1378835796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05840cec50 0x7f05840cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.251+0000 7f058c109640 1 --2- 172.21.15.82:0/1378835796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05840b2cf0 0x7f058415beb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.251+0000 7f058c109640 1 --2- 172.21.15.82:0/1378835796 >> v2:172.21.15.184:3300/0 conn(0x7f05841553c0 0x7f05840cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.251+0000 7f058c109640 1 -- 172.21.15.82:0/1378835796 >> 172.21.15.82:0/1378835796 conn(0x7f05840b19f0 msgr2=0x7f05840b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.252+0000 7f058c109640 1 -- 172.21.15.82:0/1378835796 shutdown_connections 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.252+0000 7f058c109640 1 -- 172.21.15.82:0/1378835796 wait complete. 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.253+0000 7f058c109640 1 Processor -- start 2024-06-02T22:53:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.253+0000 7f058c109640 1 -- start start 2024-06-02T22:53:02.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.253+0000 7f058c109640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05840b2cf0 0x7f058415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.253+0000 7f058c109640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05840cec50 0x7f0584143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.253+0000 7f058c109640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05841553c0 0x7f0584150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.253+0000 7f058c109640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05840b3700 con 0x7f05841553c0 2024-06-02T22:53:02.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.253+0000 7f058c109640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f05840ccd10 con 0x7f05840cec50 2024-06-02T22:53:02.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.253+0000 7f058c109640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f05841557a0 con 0x7f05840b2cf0 2024-06-02T22:53:02.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.253+0000 7f058a6a6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05841553c0 0x7f0584150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.253+0000 7f058a6a6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05841553c0 0x7f0584150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49508/0 (socket says 172.21.15.82:49508) 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.253+0000 7f058a6a6640 1 -- 172.21.15.82:0/2914120662 learned_addr learned my addr 172.21.15.82:0/2914120662 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f0589ea5640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05840b2cf0 0x7f058415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f058a6a6640 1 -- 172.21.15.82:0/2914120662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05840b2cf0 msgr2=0x7f058415ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f058a6a6640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05840b2cf0 0x7f058415ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f05896a4640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05840cec50 0x7f0584143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f058a6a6640 1 -- 172.21.15.82:0/2914120662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05840cec50 msgr2=0x7f0584143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f058a6a6640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05840cec50 0x7f0584143540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f058a6a6640 1 -- 172.21.15.82:0/2914120662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058409aed0 con 0x7f05841553c0 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f058a6a6640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05841553c0 0x7f0584150250 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0574007e60 tx=0x7f057400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f05827fc640 1 -- 172.21.15.82:0/2914120662 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0574014620 con 0x7f05841553c0 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f05827fc640 1 -- 172.21.15.82:0/2914120662 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0574019070 con 0x7f05841553c0 2024-06-02T22:53:02.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f058c109640 1 -- 172.21.15.82:0/2914120662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058409b1b0 con 0x7f05841553c0 2024-06-02T22:53:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f05827fc640 1 -- 172.21.15.82:0/2914120662 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0574014a20 con 0x7f05841553c0 2024-06-02T22:53:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.254+0000 7f058c109640 1 -- 172.21.15.82:0/2914120662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058409b770 con 0x7f05841553c0 2024-06-02T22:53:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.255+0000 7f058c109640 1 -- 172.21.15.82:0/2914120662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0584068430 con 0x7f05841553c0 2024-06-02T22:53:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.256+0000 7f05827fc640 1 -- 172.21.15.82:0/2914120662 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0574014bc0 con 0x7f05841553c0 2024-06-02T22:53:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.256+0000 7f05827fc640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f057006be30 0x7f057006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.256+0000 7f05827fc640 1 -- 172.21.15.82:0/2914120662 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f057408b8a0 con 0x7f05841553c0 2024-06-02T22:53:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.256+0000 7f0589ea5640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f057006be30 0x7f057006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.257+0000 7f0589ea5640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f057006be30 0x7f057006e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f057c006fd0 tx=0x7f057c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:02.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.260+0000 7f05827fc640 1 -- 172.21.15.82:0/2914120662 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f057405a150 con 0x7f05841553c0 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.434+0000 7f058c109640 1 -- 172.21.15.82:0/2914120662 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f05840732d0 con 0x7f057006be30 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.440+0000 7f05827fc640 1 -- 172.21.15.82:0/2914120662 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240063 (secure 0 0 0) 0x7f05840732d0 con 0x7f057006be30 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 -- 172.21.15.82:0/2914120662 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f057006be30 msgr2=0x7f057006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f057006be30 0x7f057006e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f057c006fd0 tx=0x7f057c008040 comp rx=0 tx=0).stop 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 -- 172.21.15.82:0/2914120662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05841553c0 msgr2=0x7f0584150250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05841553c0 0x7f0584150250 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0574007e60 tx=0x7f057400e4b0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 -- 172.21.15.82:0/2914120662 shutdown_connections 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f057006be30 0x7f057006e2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05841553c0 0x7f0584150250 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05840cec50 0x7f0584143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 --2- 172.21.15.82:0/2914120662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05840b2cf0 0x7f058415ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 -- 172.21.15.82:0/2914120662 >> 172.21.15.82:0/2914120662 conn(0x7f05840b19f0 msgr2=0x7f05840cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 -- 172.21.15.82:0/2914120662 shutdown_connections 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.443+0000 7f058c109640 1 -- 172.21.15.82:0/2914120662 wait complete. 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-06-02T22:53:01.834116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220420,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754300,"statfs":{"total":773094113280,"available":772868403200,"internally_reserved":0,"allocated":4300800,"data_stored":2488376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.016013"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821026+0000","last_change":"2024-06-02T22:52:56.821026+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821026+0000","last_undegraded":"2024-06-02T22:52:56.821026+0000","last_fullsized":"2024-06-02T22:52:56.821026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823559+0000","last_change":"2024-06-02T22:52:56.823559+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823559+0000","last_undegraded":"2024-06-02T22:52:56.823559+0000","last_fullsized":"2024-06-02T22:52:56.823559+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821759+0000","last_change":"2024-06-02T22:52:56.821759+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821759+0000","last_undegraded":"2024-06-02T22:52:56.821759+0000","last_fullsized":"2024-06-02T22:52:56.821759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822715+0000","last_change":"2024-06-02T22:52:56.822715+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822715+0000","last_undegraded":"2024-06-02T22:52:56.822715+0000","last_fullsized":"2024-06-02T22:52:56.822715+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825054+0000","last_change":"2024-06-02T22:52:56.825054+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825054+0000","last_undegraded":"2024-06-02T22:52:56.825054+0000","last_fullsized":"2024-06-02T22:52:56.825054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825805+0000","last_change":"2024-06-02T22:52:56.825805+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825805+0000","last_undegraded":"2024-06-02T22:52:56.825805+0000","last_fullsized":"2024-06-02T22:52:56.825805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821782+0000","last_change":"2024-06-02T22:52:56.821782+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821782+0000","last_undegraded":"2024-06-02T22:52:56.821782+0000","last_fullsized":"2024-06-02T22:52:56.821782+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822293+0000","last_change":"2024-06-02T22:52:56.822293+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822293+0000","last_undegraded":"2024-06-02T22:52:56.822293+0000","last_fullsized":"2024-06-02T22:52:56.822293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824628+0000","last_change":"2024-06-02T22:52:56.824628+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824628+0000","last_undegraded":"2024-06-02T22:52:56.824628+0000","last_fullsized":"2024-06-02T22:52:56.824628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825031+0000","last_change":"2024-06-02T22:52:56.825031+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825031+0000","last_undegraded":"2024-06-02T22:52:56.825031+0000","last_fullsized":"2024-06-02T22:52:56.825031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825111+0000","last_change":"2024-06-02T22:52:56.825111+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825111+0000","last_undegraded":"2024-06-02T22:52:56.825111+0000","last_fullsized":"2024-06-02T22:52:56.825111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824663+0000","last_change":"2024-06-02T22:52:56.824663+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824663+0000","last_undegraded":"2024-06-02T22:52:56.824663+0000","last_fullsized":"2024-06-02T22:52:56.824663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824675+0000","last_change":"2024-06-02T22:52:56.824675+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824675+0000","last_undegraded":"2024-06-02T22:52:56.824675+0000","last_fullsized":"2024-06-02T22:52:56.824675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821588+0000","last_change":"2024-06-02T22:52:56.821588+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821588+0000","last_undegraded":"2024-06-02T22:52:56.821588+0000","last_fullsized":"2024-06-02T22:52:56.821588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821120+0000","last_change":"2024-06-02T22:52:56.821120+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821120+0000","last_undegraded":"2024-06-02T22:52:56.821120+0000","last_fullsized":"2024-06-02T22:52:56.821120+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825373+0000","last_change":"2024-06-02T22:52:56.825373+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825373+0000","last_undegraded":"2024-06-02T22:52:56.825373+0000","last_fullsized":"2024-06-02T22:52:56.825373+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825761+0000","last_change":"2024-06-02T22:52:56.825761+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825761+0000","last_undegraded":"2024-06-02T22:52:56.825761+0000","last_fullsized":"2024-06-02T22:52:56.825761+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822349+0000","last_change":"2024-06-02T22:52:56.822349+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822349+0000","last_undegraded":"2024-06-02T22:52:56.822349+0000","last_fullsized":"2024-06-02T22:52:56.822349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827606+0000","last_change":"2024-06-02T22:52:56.827606+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827606+0000","last_undegraded":"2024-06-02T22:52:56.827606+0000","last_fullsized":"2024-06-02T22:52:56.827606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821588+0000","last_change":"2024-06-02T22:52:56.821588+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821588+0000","last_undegraded":"2024-06-02T22:52:56.821588+0000","last_fullsized":"2024-06-02T22:52:56.821588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827574+0000","last_change":"2024-06-02T22:52:56.827574+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827574+0000","last_undegraded":"2024-06-02T22:52:56.827574+0000","last_fullsized":"2024-06-02T22:52:56.827574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827597+0000","last_change":"2024-06-02T22:52:56.827597+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827597+0000","last_undegraded":"2024-06-02T22:52:56.827597+0000","last_fullsized":"2024-06-02T22:52:56.827597+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825415+0000","last_change":"2024-06-02T22:52:56.825415+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825415+0000","last_undegraded":"2024-06-02T22:52:56.825415+0000","last_fullsized":"2024-06-02T22:52:56.825415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827570+0000","last_change":"2024-06-02T22:52:56.827570+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827570+0000","last_undegraded":"2024-06-02T22:52:56.827570+0000","last_fullsized":"2024-06-02T22:52:56.827570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825322+0000","last_change":"2024-06-02T22:52:56.825322+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825322+0000","last_undegraded":"2024-06-02T22:52:56.825322+0000","last_fullsized":"2024-06-02T22:52:56.825322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827580+0000","last_change":"2024-06-02T22:52:56.827580+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827580+0000","last_undegraded":"2024-06-02T22:52:56.827580+0000","last_fullsized":"2024-06-02T22:52:56.827580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823404+0000","last_change":"2024-06-02T22:52:56.823404+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823404+0000","last_undegraded":"2024-06-02T22:52:56.823404+0000","last_fullsized":"2024-06-02T22:52:56.823404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823220+0000","last_change":"2024-06-02T22:52:56.823220+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823220+0000","last_undegraded":"2024-06-02T22:52:56.823220+0000","last_fullsized":"2024-06-02T22:52:56.823220+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821021+0000","last_change":"2024-06-02T22:52:56.821021+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821021+0000","last_undegraded":"2024-06-02T22:52:56.821021+0000","last_fullsized":"2024-06-02T22:52:56.821021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822287+0000","last_change":"2024-06-02T22:52:56.822287+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822287+0000","last_undegraded":"2024-06-02T22:52:56.822287+0000","last_fullsized":"2024-06-02T22:52:56.822287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824675+0000","last_change":"2024-06-02T22:52:56.824675+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824675+0000","last_undegraded":"2024-06-02T22:52:56.824675+0000","last_fullsized":"2024-06-02T22:52:56.824675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825370+0000","last_change":"2024-06-02T22:52:56.825370+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825370+0000","last_undegraded":"2024-06-02T22:52:56.825370+0000","last_fullsized":"2024-06-02T22:52:56.825370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T22:52:56.826275+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:52:56.826275+0000","last_peered":"2024-06-02T22:52:56.826275+0000","last_clean":"2024-06-02T22:52:56.826275+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:52:56.826275+0000","last_undegraded":"2024-06-02T22:52:56.826275+0000","last_fullsized":"2024-06-02T22:52:56.826275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":753823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:53:02.457 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:53:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.594+0000 7f7caa7f9640 1 Processor -- start 2024-06-02T22:53:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.594+0000 7f7caa7f9640 1 -- start start 2024-06-02T22:53:02.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7caa7f9640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7ca40cd230 0x7f7ca40b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7caa7f9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7ca40cec50 0x7f7ca40cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7caa7f9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca40b3420 con 0x7f7ca41553c0 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7caa7f9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f7ca40cc750 con 0x7f7ca40cec50 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7caa7f9640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f7ca40cca30 con 0x7f7ca40cd230 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7ca8d96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7ca40cec50 0x7f7ca40cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7ca3fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7ca41553c0 0x7f7ca415beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39406/0 (socket says 172.21.15.82:39406) 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7ca3fff640 1 -- 172.21.15.82:0/3157241768 learned_addr learned my addr 172.21.15.82:0/3157241768 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7ca8d96640 1 -- 172.21.15.82:0/3157241768 >> v2:172.21.15.184:3300/0 conn(0x7f7ca40cd230 msgr2=0x7f7ca40b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7ca8d96640 1 --2- 172.21.15.82:0/3157241768 >> v2:172.21.15.184:3300/0 conn(0x7f7ca40cd230 0x7f7ca40b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7ca8d96640 1 -- 172.21.15.82:0/3157241768 >> v1:172.21.15.82:6789/0 conn(0x7f7ca41553c0 legacy=0x7f7ca415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7ca8d96640 1 -- 172.21.15.82:0/3157241768 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca40ccd10 con 0x7f7ca40cec50 2024-06-02T22:53:02.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.595+0000 7f7ca2ffd640 1 -- 172.21.15.82:0/3157241768 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3245653290 0 0) 0x7f7ca40b3420 con 0x7f7ca41553c0 2024-06-02T22:53:02.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.596+0000 7f7ca8d96640 1 --2- 172.21.15.82:0/3157241768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca40cec50 0x7f7ca40cf0e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4075150 tx=0x7f7c9c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d340851294c25807 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:02.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.596+0000 7f7ca2ffd640 1 -- 172.21.15.82:0/3157241768 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c032790 con 0x7f7ca40cec50 2024-06-02T22:53:02.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.596+0000 7f7ca2ffd640 1 -- 172.21.15.82:0/3157241768 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9c038070 con 0x7f7ca40cec50 2024-06-02T22:53:02.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.596+0000 7f7ca2ffd640 1 -- 172.21.15.82:0/3157241768 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c032b50 con 0x7f7ca40cec50 2024-06-02T22:53:02.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.596+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3157241768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca40cec50 msgr2=0x7f7ca40cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.596+0000 7f7caa7f9640 1 --2- 172.21.15.82:0/3157241768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca40cec50 0x7f7ca40cf0e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4075150 tx=0x7f7c9c02c890 comp rx=0 tx=0).stop 2024-06-02T22:53:02.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.596+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3157241768 shutdown_connections 2024-06-02T22:53:02.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.596+0000 7f7caa7f9640 1 --2- 172.21.15.82:0/3157241768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca40cec50 0x7f7ca40cf0e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.596+0000 7f7caa7f9640 1 --2- 172.21.15.82:0/3157241768 >> v2:172.21.15.184:3300/0 conn(0x7f7ca40cd230 0x7f7ca40b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.596+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3157241768 >> 172.21.15.82:0/3157241768 conn(0x7f7ca40b19f0 msgr2=0x7f7ca40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:02.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.596+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3157241768 shutdown_connections 2024-06-02T22:53:02.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.597+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3157241768 wait complete. 2024-06-02T22:53:02.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.598+0000 7f7caa7f9640 1 Processor -- start 2024-06-02T22:53:02.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.598+0000 7f7caa7f9640 1 -- start start 2024-06-02T22:53:02.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7caa7f9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ca40cd230 0x7f7ca4154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7caa7f9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ca40cec50 0x7f7ca409aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7caa7f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41553c0 0x7f7ca415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7caa7f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca4155920 con 0x7f7ca41553c0 2024-06-02T22:53:02.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7caa7f9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca41557a0 con 0x7f7ca40cd230 2024-06-02T22:53:02.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7caa7f9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca4071030 con 0x7f7ca40cec50 2024-06-02T22:53:02.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca8d96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41553c0 0x7f7ca415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca8d96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41553c0 0x7f7ca415cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49522/0 (socket says 172.21.15.82:49522) 2024-06-02T22:53:02.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca8d96640 1 -- 172.21.15.82:0/3916203622 learned_addr learned my addr 172.21.15.82:0/3916203622 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:02.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca3fff640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ca40cd230 0x7f7ca4154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca37fe640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ca40cec50 0x7f7ca409aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca8d96640 1 -- 172.21.15.82:0/3916203622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ca40cec50 msgr2=0x7f7ca409aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca8d96640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ca40cec50 0x7f7ca409aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca8d96640 1 -- 172.21.15.82:0/3916203622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ca40cd230 msgr2=0x7f7ca4154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca8d96640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ca40cd230 0x7f7ca4154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca8d96640 1 -- 172.21.15.82:0/3916203622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca415bf50 con 0x7f7ca41553c0 2024-06-02T22:53:02.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca8d96640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41553c0 0x7f7ca415cff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009e80 tx=0x7f7c9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:02.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca0ff9640 1 -- 172.21.15.82:0/3916203622 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c003b90 con 0x7f7ca41553c0 2024-06-02T22:53:02.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca0ff9640 1 -- 172.21.15.82:0/3916203622 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9c003d30 con 0x7f7ca41553c0 2024-06-02T22:53:02.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7ca0ff9640 1 -- 172.21.15.82:0/3916203622 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c004240 con 0x7f7ca41553c0 2024-06-02T22:53:02.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.599+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3916203622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca415c230 con 0x7f7ca41553c0 2024-06-02T22:53:02.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.600+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3916203622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca415c7f0 con 0x7f7ca41553c0 2024-06-02T22:53:02.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.601+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3916203622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca4068430 con 0x7f7ca41553c0 2024-06-02T22:53:02.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.601+0000 7f7ca0ff9640 1 -- 172.21.15.82:0/3916203622 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c9c0043e0 con 0x7f7ca41553c0 2024-06-02T22:53:02.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.601+0000 7f7ca0ff9640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f7c9006be30 0x7f7c9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.601+0000 7f7ca0ff9640 1 -- 172.21.15.82:0/3916203622 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f7c9c0adf30 con 0x7f7ca41553c0 2024-06-02T22:53:02.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.602+0000 7f7ca3fff640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f7c9006be30 0x7f7c9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.602+0000 7f7ca3fff640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f7c9006be30 0x7f7c9006e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7c94000f60 tx=0x7f7c94007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:02.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.606+0000 7f7ca0ff9640 1 -- 172.21.15.82:0/3916203622 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7c9c042070 con 0x7f7ca41553c0 2024-06-02T22:53:02.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.778+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3916203622 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ca40b2f00 con 0x7f7c9006be30 2024-06-02T22:53:02.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.783+0000 7f7ca0ff9640 1 -- 172.21.15.82:0/3916203622 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240063 (secure 0 0 0) 0x7f7ca40b2f00 con 0x7f7c9006be30 2024-06-02T22:53:02.785 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:02.786 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:53:02.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.786+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3916203622 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f7c9006be30 msgr2=0x7f7c9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.786+0000 7f7caa7f9640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f7c9006be30 0x7f7c9006e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7c94000f60 tx=0x7f7c94007c00 comp rx=0 tx=0).stop 2024-06-02T22:53:02.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.786+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3916203622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41553c0 msgr2=0x7f7ca415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.786+0000 7f7caa7f9640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41553c0 0x7f7ca415cff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009e80 tx=0x7f7c9c004a40 comp rx=0 tx=0).stop 2024-06-02T22:53:02.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.786+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3916203622 shutdown_connections 2024-06-02T22:53:02.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.786+0000 7f7caa7f9640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f7c9006be30 0x7f7c9006e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.786+0000 7f7caa7f9640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca41553c0 0x7f7ca415cff0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.786+0000 7f7caa7f9640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ca40cec50 0x7f7ca409aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.786+0000 7f7caa7f9640 1 --2- 172.21.15.82:0/3916203622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ca40cd230 0x7f7ca4154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.786+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3916203622 >> 172.21.15.82:0/3916203622 conn(0x7f7ca40b19f0 msgr2=0x7f7ca40ae5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:02.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.787+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3916203622 shutdown_connections 2024-06-02T22:53:02.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.787+0000 7f7caa7f9640 1 -- 172.21.15.82:0/3916203622 wait complete. 2024-06-02T22:53:02.797 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-06-02T22:53:01.834116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220420,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754300,"statfs":{"total":773094113280,"available":772868403200,"internally_reserved":0,"allocated":4300800,"data_stored":2488376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.016013"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821026+0000","last_change":"2024-06-02T22:52:56.821026+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821026+0000","last_undegraded":"2024-06-02T22:52:56.821026+0000","last_fullsized":"2024-06-02T22:52:56.821026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823559+0000","last_change":"2024-06-02T22:52:56.823559+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823559+0000","last_undegraded":"2024-06-02T22:52:56.823559+0000","last_fullsized":"2024-06-02T22:52:56.823559+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821759+0000","last_change":"2024-06-02T22:52:56.821759+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821759+0000","last_undegraded":"2024-06-02T22:52:56.821759+0000","last_fullsized":"2024-06-02T22:52:56.821759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822715+0000","last_change":"2024-06-02T22:52:56.822715+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822715+0000","last_undegraded":"2024-06-02T22:52:56.822715+0000","last_fullsized":"2024-06-02T22:52:56.822715+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825054+0000","last_change":"2024-06-02T22:52:56.825054+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825054+0000","last_undegraded":"2024-06-02T22:52:56.825054+0000","last_fullsized":"2024-06-02T22:52:56.825054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825805+0000","last_change":"2024-06-02T22:52:56.825805+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825805+0000","last_undegraded":"2024-06-02T22:52:56.825805+0000","last_fullsized":"2024-06-02T22:52:56.825805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821782+0000","last_change":"2024-06-02T22:52:56.821782+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821782+0000","last_undegraded":"2024-06-02T22:52:56.821782+0000","last_fullsized":"2024-06-02T22:52:56.821782+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822293+0000","last_change":"2024-06-02T22:52:56.822293+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822293+0000","last_undegraded":"2024-06-02T22:52:56.822293+0000","last_fullsized":"2024-06-02T22:52:56.822293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824628+0000","last_change":"2024-06-02T22:52:56.824628+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824628+0000","last_undegraded":"2024-06-02T22:52:56.824628+0000","last_fullsized":"2024-06-02T22:52:56.824628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825031+0000","last_change":"2024-06-02T22:52:56.825031+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825031+0000","last_undegraded":"2024-06-02T22:52:56.825031+0000","last_fullsized":"2024-06-02T22:52:56.825031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825111+0000","last_change":"2024-06-02T22:52:56.825111+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825111+0000","last_undegraded":"2024-06-02T22:52:56.825111+0000","last_fullsized":"2024-06-02T22:52:56.825111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824663+0000","last_change":"2024-06-02T22:52:56.824663+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824663+0000","last_undegraded":"2024-06-02T22:52:56.824663+0000","last_fullsized":"2024-06-02T22:52:56.824663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824675+0000","last_change":"2024-06-02T22:52:56.824675+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824675+0000","last_undegraded":"2024-06-02T22:52:56.824675+0000","last_fullsized":"2024-06-02T22:52:56.824675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821588+0000","last_change":"2024-06-02T22:52:56.821588+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821588+0000","last_undegraded":"2024-06-02T22:52:56.821588+0000","last_fullsized":"2024-06-02T22:52:56.821588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821120+0000","last_change":"2024-06-02T22:52:56.821120+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821120+0000","last_undegraded":"2024-06-02T22:52:56.821120+0000","last_fullsized":"2024-06-02T22:52:56.821120+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825373+0000","last_change":"2024-06-02T22:52:56.825373+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825373+0000","last_undegraded":"2024-06-02T22:52:56.825373+0000","last_fullsized":"2024-06-02T22:52:56.825373+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825761+0000","last_change":"2024-06-02T22:52:56.825761+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825761+0000","last_undegraded":"2024-06-02T22:52:56.825761+0000","last_fullsized":"2024-06-02T22:52:56.825761+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822349+0000","last_change":"2024-06-02T22:52:56.822349+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822349+0000","last_undegraded":"2024-06-02T22:52:56.822349+0000","last_fullsized":"2024-06-02T22:52:56.822349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827606+0000","last_change":"2024-06-02T22:52:56.827606+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827606+0000","last_undegraded":"2024-06-02T22:52:56.827606+0000","last_fullsized":"2024-06-02T22:52:56.827606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821588+0000","last_change":"2024-06-02T22:52:56.821588+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821588+0000","last_undegraded":"2024-06-02T22:52:56.821588+0000","last_fullsized":"2024-06-02T22:52:56.821588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827574+0000","last_change":"2024-06-02T22:52:56.827574+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827574+0000","last_undegraded":"2024-06-02T22:52:56.827574+0000","last_fullsized":"2024-06-02T22:52:56.827574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827597+0000","last_change":"2024-06-02T22:52:56.827597+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827597+0000","last_undegraded":"2024-06-02T22:52:56.827597+0000","last_fullsized":"2024-06-02T22:52:56.827597+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825415+0000","last_change":"2024-06-02T22:52:56.825415+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825415+0000","last_undegraded":"2024-06-02T22:52:56.825415+0000","last_fullsized":"2024-06-02T22:52:56.825415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827570+0000","last_change":"2024-06-02T22:52:56.827570+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827570+0000","last_undegraded":"2024-06-02T22:52:56.827570+0000","last_fullsized":"2024-06-02T22:52:56.827570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825322+0000","last_change":"2024-06-02T22:52:56.825322+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825322+0000","last_undegraded":"2024-06-02T22:52:56.825322+0000","last_fullsized":"2024-06-02T22:52:56.825322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827580+0000","last_change":"2024-06-02T22:52:56.827580+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827580+0000","last_undegraded":"2024-06-02T22:52:56.827580+0000","last_fullsized":"2024-06-02T22:52:56.827580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823404+0000","last_change":"2024-06-02T22:52:56.823404+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823404+0000","last_undegraded":"2024-06-02T22:52:56.823404+0000","last_fullsized":"2024-06-02T22:52:56.823404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823220+0000","last_change":"2024-06-02T22:52:56.823220+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823220+0000","last_undegraded":"2024-06-02T22:52:56.823220+0000","last_fullsized":"2024-06-02T22:52:56.823220+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821021+0000","last_change":"2024-06-02T22:52:56.821021+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821021+0000","last_undegraded":"2024-06-02T22:52:56.821021+0000","last_fullsized":"2024-06-02T22:52:56.821021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822287+0000","last_change":"2024-06-02T22:52:56.822287+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822287+0000","last_undegraded":"2024-06-02T22:52:56.822287+0000","last_fullsized":"2024-06-02T22:52:56.822287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824675+0000","last_change":"2024-06-02T22:52:56.824675+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824675+0000","last_undegraded":"2024-06-02T22:52:56.824675+0000","last_fullsized":"2024-06-02T22:52:56.824675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825370+0000","last_change":"2024-06-02T22:52:56.825370+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825370+0000","last_undegraded":"2024-06-02T22:52:56.825370+0000","last_fullsized":"2024-06-02T22:52:56.825370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T22:52:56.826275+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:52:56.826275+0000","last_peered":"2024-06-02T22:52:56.826275+0000","last_clean":"2024-06-02T22:52:56.826275+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:52:56.826275+0000","last_undegraded":"2024-06-02T22:52:56.826275+0000","last_fullsized":"2024-06-02T22:52:56.826275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":753823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:53:02.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:53:02.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.938+0000 7f088cfd5640 1 Processor -- start 2024-06-02T22:53:02.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.938+0000 7f088cfd5640 1 -- start start 2024-06-02T22:53:02.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088cfd5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08880b7940 0x7f08880d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088cfd5640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f08880b4c80 0x7f08880ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088cfd5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08880cec10 0x7f088806c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088cfd5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f08880b7d20 con 0x7f08880b7940 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088cfd5640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f08880cc620 con 0x7f08880b4c80 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088cfd5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f08880cc900 con 0x7f08880cec10 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08880b7940 0x7f08880d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08880b7940 0x7f08880d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49536/0 (socket says 172.21.15.82:49536) 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088659c640 1 -- 172.21.15.82:0/3501011533 learned_addr learned my addr 172.21.15.82:0/3501011533 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f087ffff640 1 --2- 172.21.15.82:0/3501011533 >> v2:172.21.15.184:3300/0 conn(0x7f08880b4c80 0x7f08880ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088659c640 1 -- 172.21.15.82:0/3501011533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08880cec10 msgr2=0x7f088806c6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088659c640 1 --2- 172.21.15.82:0/3501011533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08880cec10 0x7f088806c6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088659c640 1 -- 172.21.15.82:0/3501011533 >> v2:172.21.15.184:3300/0 conn(0x7f08880b4c80 msgr2=0x7f08880ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088659c640 1 --2- 172.21.15.82:0/3501011533 >> v2:172.21.15.184:3300/0 conn(0x7f08880b4c80 0x7f08880ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.939+0000 7f088659c640 1 -- 172.21.15.82:0/3501011533 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08880ccbe0 con 0x7f08880b7940 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.940+0000 7f088659c640 1 --2- 172.21.15.82:0/3501011533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08880b7940 0x7f08880d0af0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f08880d1e20 tx=0x7f087802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bf4270d24a152f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.940+0000 7f0885d9b640 1 -- 172.21.15.82:0/3501011533 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878037070 con 0x7f08880b7940 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.940+0000 7f0885d9b640 1 -- 172.21.15.82:0/3501011533 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0878032440 con 0x7f08880b7940 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.940+0000 7f0885d9b640 1 -- 172.21.15.82:0/3501011533 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878032810 con 0x7f08880b7940 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.940+0000 7f088cfd5640 1 -- 172.21.15.82:0/3501011533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08880b7940 msgr2=0x7f08880d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.940+0000 7f088cfd5640 1 --2- 172.21.15.82:0/3501011533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08880b7940 0x7f08880d0af0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f08880d1e20 tx=0x7f087802a200 comp rx=0 tx=0).stop 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.941+0000 7f088cfd5640 1 -- 172.21.15.82:0/3501011533 shutdown_connections 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.941+0000 7f088cfd5640 1 --2- 172.21.15.82:0/3501011533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08880cec10 0x7f088806c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.941+0000 7f088cfd5640 1 --2- 172.21.15.82:0/3501011533 >> v2:172.21.15.184:3300/0 conn(0x7f08880b4c80 0x7f08880ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.941+0000 7f088cfd5640 1 --2- 172.21.15.82:0/3501011533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08880b7940 0x7f08880d0af0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.941+0000 7f088cfd5640 1 -- 172.21.15.82:0/3501011533 >> 172.21.15.82:0/3501011533 conn(0x7f08880d1e50 msgr2=0x7f08880d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.941+0000 7f088cfd5640 1 -- 172.21.15.82:0/3501011533 shutdown_connections 2024-06-02T22:53:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.941+0000 7f088cfd5640 1 -- 172.21.15.82:0/3501011533 wait complete. 2024-06-02T22:53:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.942+0000 7f088cfd5640 1 Processor -- start 2024-06-02T22:53:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.942+0000 7f088cfd5640 1 -- start start 2024-06-02T22:53:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f088cfd5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08880b4c80 0x7f088815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f088cfd5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08880b7940 0x7f08880c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f088cfd5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08880cec10 0x7f08880c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f088cfd5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f08880d2c10 con 0x7f08880cec10 2024-06-02T22:53:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f088cfd5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f08880d2a90 con 0x7f08880b4c80 2024-06-02T22:53:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f088cfd5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f08880d1030 con 0x7f08880b7940 2024-06-02T22:53:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f0886d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08880cec10 0x7f08880c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f0886d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08880cec10 0x7f08880c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49550/0 (socket says 172.21.15.82:49550) 2024-06-02T22:53:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f0886d9d640 1 -- 172.21.15.82:0/239991933 learned_addr learned my addr 172.21.15.82:0/239991933 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f087ffff640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08880b7940 0x7f08880c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f088659c640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08880b4c80 0x7f088815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f0886d9d640 1 -- 172.21.15.82:0/239991933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08880b7940 msgr2=0x7f08880c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f0886d9d640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08880b7940 0x7f08880c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f0886d9d640 1 -- 172.21.15.82:0/239991933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08880b4c80 msgr2=0x7f088815b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f0886d9d640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08880b4c80 0x7f088815b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f0886d9d640 1 -- 172.21.15.82:0/239991933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08881f4180 con 0x7f08880cec10 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f088659c640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08880b4c80 0x7f088815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f0886d9d640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08880cec10 0x7f08880c86a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f088000b990 tx=0x7f088000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f087effd640 1 -- 172.21.15.82:0/239991933 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880019070 con 0x7f08880cec10 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f087effd640 1 -- 172.21.15.82:0/239991933 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f088000cba0 con 0x7f08880cec10 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f087effd640 1 -- 172.21.15.82:0/239991933 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880014440 con 0x7f08880cec10 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f088cfd5640 1 -- 172.21.15.82:0/239991933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08881f4460 con 0x7f08880cec10 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.943+0000 7f088cfd5640 1 -- 172.21.15.82:0/239991933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08881f4a20 con 0x7f08880cec10 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.944+0000 7f088cfd5640 1 -- 172.21.15.82:0/239991933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0888068430 con 0x7f08880cec10 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.945+0000 7f087effd640 1 -- 172.21.15.82:0/239991933 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f088001c070 con 0x7f08880cec10 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.945+0000 7f087effd640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f086806be30 0x7f086806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.945+0000 7f088659c640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f086806be30 0x7f086806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.945+0000 7f087effd640 1 -- 172.21.15.82:0/239991933 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f088008ad10 con 0x7f08880cec10 2024-06-02T22:53:02.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.946+0000 7f088659c640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f086806be30 0x7f086806e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0878034000 tx=0x7f087802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:02.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:02.950+0000 7f087effd640 1 -- 172.21.15.82:0/239991933 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f08800595c0 con 0x7f08880cec10 2024-06-02T22:53:03.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.121+0000 7f088cfd5640 1 -- 172.21.15.82:0/239991933 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08881614c0 con 0x7f086806be30 2024-06-02T22:53:03.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.126+0000 7f087effd640 1 -- 172.21.15.82:0/239991933 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240063 (secure 0 0 0) 0x7f08881614c0 con 0x7f086806be30 2024-06-02T22:53:03.128 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:03.129 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:53:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 -- 172.21.15.82:0/239991933 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f086806be30 msgr2=0x7f086806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f086806be30 0x7f086806e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0878034000 tx=0x7f087802e000 comp rx=0 tx=0).stop 2024-06-02T22:53:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 -- 172.21.15.82:0/239991933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08880cec10 msgr2=0x7f08880c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08880cec10 0x7f08880c86a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f088000b990 tx=0x7f088000be50 comp rx=0 tx=0).stop 2024-06-02T22:53:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 -- 172.21.15.82:0/239991933 shutdown_connections 2024-06-02T22:53:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f086806be30 0x7f086806e2f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08880cec10 0x7f08880c86a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08880b7940 0x7f08880c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 --2- 172.21.15.82:0/239991933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08880b4c80 0x7f088815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 -- 172.21.15.82:0/239991933 >> 172.21.15.82:0/239991933 conn(0x7f08880d1e50 msgr2=0x7f088806d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 -- 172.21.15.82:0/239991933 shutdown_connections 2024-06-02T22:53:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.129+0000 7f088cfd5640 1 -- 172.21.15.82:0/239991933 wait complete. 2024-06-02T22:53:03.139 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-06-02T22:53:01.834116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220420,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754300,"statfs":{"total":773094113280,"available":772868403200,"internally_reserved":0,"allocated":4300800,"data_stored":2488376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.016013"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821026+0000","last_change":"2024-06-02T22:52:56.821026+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821026+0000","last_undegraded":"2024-06-02T22:52:56.821026+0000","last_fullsized":"2024-06-02T22:52:56.821026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823559+0000","last_change":"2024-06-02T22:52:56.823559+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823559+0000","last_undegraded":"2024-06-02T22:52:56.823559+0000","last_fullsized":"2024-06-02T22:52:56.823559+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821759+0000","last_change":"2024-06-02T22:52:56.821759+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821759+0000","last_undegraded":"2024-06-02T22:52:56.821759+0000","last_fullsized":"2024-06-02T22:52:56.821759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822715+0000","last_change":"2024-06-02T22:52:56.822715+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822715+0000","last_undegraded":"2024-06-02T22:52:56.822715+0000","last_fullsized":"2024-06-02T22:52:56.822715+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825054+0000","last_change":"2024-06-02T22:52:56.825054+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825054+0000","last_undegraded":"2024-06-02T22:52:56.825054+0000","last_fullsized":"2024-06-02T22:52:56.825054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825805+0000","last_change":"2024-06-02T22:52:56.825805+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825805+0000","last_undegraded":"2024-06-02T22:52:56.825805+0000","last_fullsized":"2024-06-02T22:52:56.825805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821782+0000","last_change":"2024-06-02T22:52:56.821782+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821782+0000","last_undegraded":"2024-06-02T22:52:56.821782+0000","last_fullsized":"2024-06-02T22:52:56.821782+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822293+0000","last_change":"2024-06-02T22:52:56.822293+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822293+0000","last_undegraded":"2024-06-02T22:52:56.822293+0000","last_fullsized":"2024-06-02T22:52:56.822293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824628+0000","last_change":"2024-06-02T22:52:56.824628+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824628+0000","last_undegraded":"2024-06-02T22:52:56.824628+0000","last_fullsized":"2024-06-02T22:52:56.824628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825031+0000","last_change":"2024-06-02T22:52:56.825031+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825031+0000","last_undegraded":"2024-06-02T22:52:56.825031+0000","last_fullsized":"2024-06-02T22:52:56.825031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825111+0000","last_change":"2024-06-02T22:52:56.825111+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825111+0000","last_undegraded":"2024-06-02T22:52:56.825111+0000","last_fullsized":"2024-06-02T22:52:56.825111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824663+0000","last_change":"2024-06-02T22:52:56.824663+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824663+0000","last_undegraded":"2024-06-02T22:52:56.824663+0000","last_fullsized":"2024-06-02T22:52:56.824663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824675+0000","last_change":"2024-06-02T22:52:56.824675+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824675+0000","last_undegraded":"2024-06-02T22:52:56.824675+0000","last_fullsized":"2024-06-02T22:52:56.824675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821588+0000","last_change":"2024-06-02T22:52:56.821588+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821588+0000","last_undegraded":"2024-06-02T22:52:56.821588+0000","last_fullsized":"2024-06-02T22:52:56.821588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821120+0000","last_change":"2024-06-02T22:52:56.821120+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821120+0000","last_undegraded":"2024-06-02T22:52:56.821120+0000","last_fullsized":"2024-06-02T22:52:56.821120+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825373+0000","last_change":"2024-06-02T22:52:56.825373+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825373+0000","last_undegraded":"2024-06-02T22:52:56.825373+0000","last_fullsized":"2024-06-02T22:52:56.825373+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825761+0000","last_change":"2024-06-02T22:52:56.825761+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825761+0000","last_undegraded":"2024-06-02T22:52:56.825761+0000","last_fullsized":"2024-06-02T22:52:56.825761+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822349+0000","last_change":"2024-06-02T22:52:56.822349+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822349+0000","last_undegraded":"2024-06-02T22:52:56.822349+0000","last_fullsized":"2024-06-02T22:52:56.822349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827606+0000","last_change":"2024-06-02T22:52:56.827606+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827606+0000","last_undegraded":"2024-06-02T22:52:56.827606+0000","last_fullsized":"2024-06-02T22:52:56.827606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821588+0000","last_change":"2024-06-02T22:52:56.821588+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821588+0000","last_undegraded":"2024-06-02T22:52:56.821588+0000","last_fullsized":"2024-06-02T22:52:56.821588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827574+0000","last_change":"2024-06-02T22:52:56.827574+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827574+0000","last_undegraded":"2024-06-02T22:52:56.827574+0000","last_fullsized":"2024-06-02T22:52:56.827574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827597+0000","last_change":"2024-06-02T22:52:56.827597+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827597+0000","last_undegraded":"2024-06-02T22:52:56.827597+0000","last_fullsized":"2024-06-02T22:52:56.827597+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825415+0000","last_change":"2024-06-02T22:52:56.825415+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825415+0000","last_undegraded":"2024-06-02T22:52:56.825415+0000","last_fullsized":"2024-06-02T22:52:56.825415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827570+0000","last_change":"2024-06-02T22:52:56.827570+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827570+0000","last_undegraded":"2024-06-02T22:52:56.827570+0000","last_fullsized":"2024-06-02T22:52:56.827570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825322+0000","last_change":"2024-06-02T22:52:56.825322+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825322+0000","last_undegraded":"2024-06-02T22:52:56.825322+0000","last_fullsized":"2024-06-02T22:52:56.825322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827580+0000","last_change":"2024-06-02T22:52:56.827580+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827580+0000","last_undegraded":"2024-06-02T22:52:56.827580+0000","last_fullsized":"2024-06-02T22:52:56.827580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823404+0000","last_change":"2024-06-02T22:52:56.823404+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823404+0000","last_undegraded":"2024-06-02T22:52:56.823404+0000","last_fullsized":"2024-06-02T22:52:56.823404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823220+0000","last_change":"2024-06-02T22:52:56.823220+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823220+0000","last_undegraded":"2024-06-02T22:52:56.823220+0000","last_fullsized":"2024-06-02T22:52:56.823220+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821021+0000","last_change":"2024-06-02T22:52:56.821021+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821021+0000","last_undegraded":"2024-06-02T22:52:56.821021+0000","last_fullsized":"2024-06-02T22:52:56.821021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822287+0000","last_change":"2024-06-02T22:52:56.822287+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822287+0000","last_undegraded":"2024-06-02T22:52:56.822287+0000","last_fullsized":"2024-06-02T22:52:56.822287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824675+0000","last_change":"2024-06-02T22:52:56.824675+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824675+0000","last_undegraded":"2024-06-02T22:52:56.824675+0000","last_fullsized":"2024-06-02T22:52:56.824675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825370+0000","last_change":"2024-06-02T22:52:56.825370+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825370+0000","last_undegraded":"2024-06-02T22:52:56.825370+0000","last_fullsized":"2024-06-02T22:52:56.825370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T22:52:56.826275+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:52:56.826275+0000","last_peered":"2024-06-02T22:52:56.826275+0000","last_clean":"2024-06-02T22:52:56.826275+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:52:56.826275+0000","last_undegraded":"2024-06-02T22:52:56.826275+0000","last_fullsized":"2024-06-02T22:52:56.826275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":753823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:53:03.143 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-06-02T22:53:03.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.143 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-06-02T22:53:03.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3a is not active+clean 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:PG 6.39 is not active+clean 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-06-02T22:53:03.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.145 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-06-02T22:53:03.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.145 INFO:tasks.ceph.ceph_manager.ceph:PG 6.36 is not active+clean 2024-06-02T22:53:03.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.145 INFO:tasks.ceph.ceph_manager.ceph:PG 6.35 is not active+clean 2024-06-02T22:53:03.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.145 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-06-02T22:53:03.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.145 INFO:tasks.ceph.ceph_manager.ceph:PG 6.33 is not active+clean 2024-06-02T22:53:03.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.145 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-06-02T22:53:03.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.146 INFO:tasks.ceph.ceph_manager.ceph:PG 6.31 is not active+clean 2024-06-02T22:53:03.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.146 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-06-02T22:53:03.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.146 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-06-02T22:53:03.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.146 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-06-02T22:53:03.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.146 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-06-02T22:53:03.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2b is not active+clean 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-06-02T22:53:03.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:PG 6.26 is not active+clean 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:PG 6.24 is not active+clean 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-06-02T22:53:03.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:PG 6.20 is not active+clean 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.821026+0000', 'last_change': '2024-06-02T22:52:56.821026+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.821026+0000', 'last_undegraded': '2024-06-02T22:52:56.821026+0000', 'last_fullsized': '2024-06-02T22:52:56.821026+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.823559+0000', 'last_change': '2024-06-02T22:52:56.823559+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.823559+0000', 'last_undegraded': '2024-06-02T22:52:56.823559+0000', 'last_fullsized': '2024-06-02T22:52:56.823559+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-06-02T22:53:03.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.150 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-06-02T22:53:03.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.821759+0000', 'last_change': '2024-06-02T22:52:56.821759+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.821759+0000', 'last_undegraded': '2024-06-02T22:52:56.821759+0000', 'last_fullsized': '2024-06-02T22:52:56.821759+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T22:53:03.150 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-06-02T22:53:03.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.150 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-06-02T22:53:03.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.822715+0000', 'last_change': '2024-06-02T22:52:56.822715+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.822715+0000', 'last_undegraded': '2024-06-02T22:52:56.822715+0000', 'last_fullsized': '2024-06-02T22:52:56.822715+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-02T22:53:03.150 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-06-02T22:53:03.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.150 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-06-02T22:53:03.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.825054+0000', 'last_change': '2024-06-02T22:52:56.825054+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.825054+0000', 'last_undegraded': '2024-06-02T22:52:56.825054+0000', 'last_fullsized': '2024-06-02T22:52:56.825054+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-02T22:53:03.150 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-06-02T22:53:03.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.151 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-06-02T22:53:03.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.825805+0000', 'last_change': '2024-06-02T22:52:56.825805+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.825805+0000', 'last_undegraded': '2024-06-02T22:52:56.825805+0000', 'last_fullsized': '2024-06-02T22:52:56.825805+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-02T22:53:03.151 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-06-02T22:53:03.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.151 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-06-02T22:53:03.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.821782+0000', 'last_change': '2024-06-02T22:52:56.821782+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.821782+0000', 'last_undegraded': '2024-06-02T22:52:56.821782+0000', 'last_fullsized': '2024-06-02T22:52:56.821782+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T22:53:03.151 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-06-02T22:53:03.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.151 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-06-02T22:53:03.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.822293+0000', 'last_change': '2024-06-02T22:52:56.822293+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.822293+0000', 'last_undegraded': '2024-06-02T22:52:56.822293+0000', 'last_fullsized': '2024-06-02T22:52:56.822293+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-02T22:53:03.152 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-06-02T22:53:03.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.152 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-06-02T22:53:03.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.824628+0000', 'last_change': '2024-06-02T22:52:56.824628+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.824628+0000', 'last_undegraded': '2024-06-02T22:52:56.824628+0000', 'last_fullsized': '2024-06-02T22:52:56.824628+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-02T22:53:03.152 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-06-02T22:53:03.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.152 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-06-02T22:53:03.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.825031+0000', 'last_change': '2024-06-02T22:52:56.825031+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.825031+0000', 'last_undegraded': '2024-06-02T22:52:56.825031+0000', 'last_fullsized': '2024-06-02T22:52:56.825031+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-02T22:53:03.152 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-06-02T22:53:03.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.152 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-06-02T22:53:03.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.825111+0000', 'last_change': '2024-06-02T22:52:56.825111+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.825111+0000', 'last_undegraded': '2024-06-02T22:52:56.825111+0000', 'last_fullsized': '2024-06-02T22:52:56.825111+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-02T22:53:03.153 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-06-02T22:53:03.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.153 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-06-02T22:53:03.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.824663+0000', 'last_change': '2024-06-02T22:52:56.824663+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.824663+0000', 'last_undegraded': '2024-06-02T22:52:56.824663+0000', 'last_fullsized': '2024-06-02T22:52:56.824663+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-02T22:53:03.153 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-06-02T22:53:03.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.153 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-06-02T22:53:03.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.824675+0000', 'last_change': '2024-06-02T22:52:56.824675+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.824675+0000', 'last_undegraded': '2024-06-02T22:52:56.824675+0000', 'last_fullsized': '2024-06-02T22:52:56.824675+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-02T22:53:03.153 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-06-02T22:53:03.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.821588+0000', 'last_change': '2024-06-02T22:52:56.821588+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.821588+0000', 'last_undegraded': '2024-06-02T22:52:56.821588+0000', 'last_fullsized': '2024-06-02T22:52:56.821588+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.821120+0000', 'last_change': '2024-06-02T22:52:56.821120+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.821120+0000', 'last_undegraded': '2024-06-02T22:52:56.821120+0000', 'last_fullsized': '2024-06-02T22:52:56.821120+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.825373+0000', 'last_change': '2024-06-02T22:52:56.825373+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.825373+0000', 'last_undegraded': '2024-06-02T22:52:56.825373+0000', 'last_fullsized': '2024-06-02T22:52:56.825373+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-06-02T22:53:03.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.155 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-06-02T22:53:03.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.825761+0000', 'last_change': '2024-06-02T22:52:56.825761+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.825761+0000', 'last_undegraded': '2024-06-02T22:52:56.825761+0000', 'last_fullsized': '2024-06-02T22:52:56.825761+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-02T22:53:03.155 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-06-02T22:53:03.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.155 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-06-02T22:53:03.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.822349+0000', 'last_change': '2024-06-02T22:52:56.822349+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.822349+0000', 'last_undegraded': '2024-06-02T22:52:56.822349+0000', 'last_fullsized': '2024-06-02T22:52:56.822349+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-02T22:53:03.155 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-06-02T22:53:03.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.155 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-06-02T22:53:03.155 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.827606+0000', 'last_change': '2024-06-02T22:52:56.827606+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.827606+0000', 'last_undegraded': '2024-06-02T22:52:56.827606+0000', 'last_fullsized': '2024-06-02T22:52:56.827606+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-02T22:53:03.155 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.821588+0000', 'last_change': '2024-06-02T22:52:56.821588+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.821588+0000', 'last_undegraded': '2024-06-02T22:52:56.821588+0000', 'last_fullsized': '2024-06-02T22:52:56.821588+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.827574+0000', 'last_change': '2024-06-02T22:52:56.827574+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.827574+0000', 'last_undegraded': '2024-06-02T22:52:56.827574+0000', 'last_fullsized': '2024-06-02T22:52:56.827574+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.827597+0000', 'last_change': '2024-06-02T22:52:56.827597+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.827597+0000', 'last_undegraded': '2024-06-02T22:52:56.827597+0000', 'last_fullsized': '2024-06-02T22:52:56.827597+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-02T22:53:03.156 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-06-02T22:53:03.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.157 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-06-02T22:53:03.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.825415+0000', 'last_change': '2024-06-02T22:52:56.825415+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.825415+0000', 'last_undegraded': '2024-06-02T22:52:56.825415+0000', 'last_fullsized': '2024-06-02T22:52:56.825415+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-02T22:53:03.157 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-06-02T22:53:03.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.157 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-06-02T22:53:03.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.827570+0000', 'last_change': '2024-06-02T22:52:56.827570+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.827570+0000', 'last_undegraded': '2024-06-02T22:52:56.827570+0000', 'last_fullsized': '2024-06-02T22:52:56.827570+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-02T22:53:03.157 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-06-02T22:53:03.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.157 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-06-02T22:53:03.157 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.825322+0000', 'last_change': '2024-06-02T22:52:56.825322+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.825322+0000', 'last_undegraded': '2024-06-02T22:52:56.825322+0000', 'last_fullsized': '2024-06-02T22:52:56.825322+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.827580+0000', 'last_change': '2024-06-02T22:52:56.827580+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.827580+0000', 'last_undegraded': '2024-06-02T22:52:56.827580+0000', 'last_fullsized': '2024-06-02T22:52:56.827580+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.823404+0000', 'last_change': '2024-06-02T22:52:56.823404+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.823404+0000', 'last_undegraded': '2024-06-02T22:52:56.823404+0000', 'last_fullsized': '2024-06-02T22:52:56.823404+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-06-02T22:53:03.158 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.823220+0000', 'last_change': '2024-06-02T22:52:56.823220+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.823220+0000', 'last_undegraded': '2024-06-02T22:52:56.823220+0000', 'last_fullsized': '2024-06-02T22:52:56.823220+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-02T22:53:03.159 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-06-02T22:53:03.159 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.159 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-06-02T22:53:03.159 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.821021+0000', 'last_change': '2024-06-02T22:52:56.821021+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.821021+0000', 'last_undegraded': '2024-06-02T22:52:56.821021+0000', 'last_fullsized': '2024-06-02T22:52:56.821021+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-02T22:53:03.159 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-06-02T22:53:03.159 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.159 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-06-02T22:53:03.159 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.822287+0000', 'last_change': '2024-06-02T22:52:56.822287+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.822287+0000', 'last_undegraded': '2024-06-02T22:52:56.822287+0000', 'last_fullsized': '2024-06-02T22:52:56.822287+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-02T22:53:03.159 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-06-02T22:53:03.159 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.159 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-06-02T22:53:03.160 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.824675+0000', 'last_change': '2024-06-02T22:52:56.824675+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.824675+0000', 'last_undegraded': '2024-06-02T22:52:56.824675+0000', 'last_fullsized': '2024-06-02T22:52:56.824675+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-02T22:53:03.160 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-06-02T22:53:03.160 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:52:57.817554+0000', 'last_change': '2024-06-02T22:52:57.817554+0000', 'last_active': '2024-06-02T22:52:57.817554+0000', 'last_peered': '2024-06-02T22:52:57.817554+0000', 'last_clean': '2024-06-02T22:52:57.817554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:57.817554+0000', 'last_undegraded': '2024-06-02T22:52:57.817554+0000', 'last_fullsized': '2024-06-02T22:52:57.817554+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:57.817554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:03.160 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-06-02T22:53:03.160 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-06-02T22:52:56.825370+0000', 'last_change': '2024-06-02T22:52:56.825370+0000', 'last_active': '2024-06-02T22:52:56.812867+0000', 'last_peered': '2024-06-02T22:52:56.812867+0000', 'last_clean': '2024-06-02T22:52:56.812867+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:52:56.825370+0000', 'last_undegraded': '2024-06-02T22:52:56.825370+0000', 'last_fullsized': '2024-06-02T22:52:56.825370+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'last_clean_scrub_stamp': '2024-06-02T22:52:56.812867+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-02T22:53:03.160 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-02T22:53:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.277+0000 7fe3c647b640 1 Processor -- start 2024-06-02T22:53:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.278+0000 7fe3c647b640 1 -- start start 2024-06-02T22:53:03.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.278+0000 7fe3c647b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00d2680 0x7fe3c015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.278+0000 7fe3c647b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3c00d0ad0 con 0x7fe3c00cef70 2024-06-02T22:53:03.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.278+0000 7fe3c647b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3c015f890 con 0x7fe3c00d1fc0 2024-06-02T22:53:03.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.278+0000 7fe3c647b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe3c00d13e0 con 0x7fe3c00d2680 2024-06-02T22:53:03.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.278+0000 7fe3c4a18640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe3c00cef70 0x7fe3c00cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39414/0 (socket says 172.21.15.82:39414) 2024-06-02T22:53:03.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.278+0000 7fe3c4a18640 1 -- 172.21.15.82:0/1108470999 learned_addr learned my addr 172.21.15.82:0/1108470999 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:03.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3bffff640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00d2680 0x7fe3c015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344608359 0 0) 0x7fe3c00d0ad0 con 0x7fe3c00cef70 2024-06-02T22:53:03.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a8003520 con 0x7fe3c00cef70 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3470414298 0 0) 0x7fe3a8003520 con 0x7fe3c00cef70 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00d2680 msgr2=0x7fe3c015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00d2680 0x7fe3c015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 >> v1:172.21.15.184:6789/0 conn(0x7fe3c00d1fc0 legacy=0x7fe3c00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c00d0d90 con 0x7fe3c00cef70 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fe3b80019f0 con 0x7fe3c00cef70 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 >> v1:172.21.15.82:6789/0 conn(0x7fe3c00cef70 legacy=0x7fe3c00cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00d2680 0x7fe3a80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3a8003f60 0x7fe3a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a8004d40 0x7fe3a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c00d13e0 con 0x7fe3a8004d40 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a800baa0 con 0x7fe3a8003f60 2024-06-02T22:53:03.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a800bca0 con 0x7fe3c00d2680 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3c4a18640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a8004d40 0x7fe3a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3bffff640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00d2680 0x7fe3a80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3bf7fe640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3a8003f60 0x7fe3a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3c4a18640 1 -- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00d2680 msgr2=0x7fe3a80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3c4a18640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00d2680 0x7fe3a80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3c4a18640 1 -- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3a8003f60 msgr2=0x7fe3a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3c4a18640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3a8003f60 0x7fe3a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3c4a18640 1 -- 172.21.15.82:0/1108470999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a8003520 con 0x7fe3a8004d40 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.279+0000 7fe3bf7fe640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3a8003f60 0x7fe3a8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.280+0000 7fe3c4a18640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a8004d40 0x7fe3a80051c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800a850 tx=0x7fe3a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e23a634b473c6b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.280+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800a4a0 con 0x7fe3a8004d40 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.280+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b802f070 con 0x7fe3a8004d40 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.280+0000 7fe3beffd640 1 -- 172.21.15.82:0/1108470999 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b802bd20 con 0x7fe3a8004d40 2024-06-02T22:53:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.281+0000 7fe3c647b640 1 -- 172.21.15.82:0/1108470999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a8004d40 msgr2=0x7fe3a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.281+0000 7fe3c647b640 1 --2- 172.21.15.82:0/1108470999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a8004d40 0x7fe3a80051c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800a850 tx=0x7fe3a8005830 comp rx=0 tx=0).stop 2024-06-02T22:53:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.281+0000 7fe3c4a18640 1 -- 172.21.15.82:0/1108470999 reap_dead start 2024-06-02T22:53:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.281+0000 7fe3c647b640 1 -- 172.21.15.82:0/1108470999 shutdown_connections 2024-06-02T22:53:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.281+0000 7fe3c647b640 1 -- 172.21.15.82:0/1108470999 >> 172.21.15.82:0/1108470999 conn(0x7fe3c009d3f0 msgr2=0x7fe3c00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.281+0000 7fe3c647b640 1 -- 172.21.15.82:0/1108470999 shutdown_connections 2024-06-02T22:53:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.281+0000 7fe3c647b640 1 -- 172.21.15.82:0/1108470999 wait complete. 2024-06-02T22:53:03.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.282+0000 7fe3c647b640 1 Processor -- start 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.282+0000 7fe3c647b640 1 -- start start 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3c647b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3c015a530 0x7fe3c00a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3c647b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3c009de60 0x7fe3c00cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3c647b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00a1a60 0x7fe3c00cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3c647b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c00d4f00 con 0x7fe3c015a530 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3c647b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c00d2400 con 0x7fe3c009de60 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3c647b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe3c00d1870 con 0x7fe3c00a1a60 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3bffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3c015a530 0x7fe3c00a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3bffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3c015a530 0x7fe3c00a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49558/0 (socket says 172.21.15.82:49558) 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3bffff640 1 -- 172.21.15.82:0/1690482241 learned_addr learned my addr 172.21.15.82:0/1690482241 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3c4a18640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00a1a60 0x7fe3c00cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3bf7fe640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3c009de60 0x7fe3c00cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3bffff640 1 -- 172.21.15.82:0/1690482241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00a1a60 msgr2=0x7fe3c00cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3bffff640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00a1a60 0x7fe3c00cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3bffff640 1 -- 172.21.15.82:0/1690482241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3c009de60 msgr2=0x7fe3c00cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3bffff640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3c009de60 0x7fe3c00cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.283+0000 7fe3bffff640 1 -- 172.21.15.82:0/1690482241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c009e2f0 con 0x7fe3c015a530 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.284+0000 7fe3bffff640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3c015a530 0x7fe3c00a1520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00119d0 tx=0x7fe3b0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.284+0000 7fe3bcff9640 1 -- 172.21.15.82:0/1690482241 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b000fb50 con 0x7fe3c015a530 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.284+0000 7fe3bcff9640 1 -- 172.21.15.82:0/1690482241 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b000fcf0 con 0x7fe3c015a530 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.284+0000 7fe3bcff9640 1 -- 172.21.15.82:0/1690482241 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b000fea0 con 0x7fe3c015a530 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.284+0000 7fe3c647b640 1 -- 172.21.15.82:0/1690482241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c009e5d0 con 0x7fe3c015a530 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.284+0000 7fe3c647b640 1 -- 172.21.15.82:0/1690482241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c009eb90 con 0x7fe3c015a530 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.285+0000 7fe3c647b640 1 -- 172.21.15.82:0/1690482241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c00d2e20 con 0x7fe3c015a530 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.285+0000 7fe3bcff9640 1 -- 172.21.15.82:0/1690482241 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3b0012040 con 0x7fe3c015a530 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.286+0000 7fe3bcff9640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe3ac06be30 0x7fe3ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.286+0000 7fe3bcff9640 1 -- 172.21.15.82:0/1690482241 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe3b008b6c0 con 0x7fe3c015a530 2024-06-02T22:53:03.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.286+0000 7fe3bf7fe640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe3ac06be30 0x7fe3ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.286+0000 7fe3bf7fe640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe3ac06be30 0x7fe3ac06e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe3c01e9950 tx=0x7fe3b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.290+0000 7fe3bcff9640 1 -- 172.21.15.82:0/1690482241 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe3c00d2e20 con 0x7fe3c015a530 2024-06-02T22:53:03.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.531+0000 7fe3c647b640 1 -- 172.21.15.82:0/1690482241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe3c00b5ad0 con 0x7fe3c015a530 2024-06-02T22:53:03.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.531+0000 7fe3bcff9640 1 -- 172.21.15.82:0/1690482241 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1656 (secure 0 0 0) 0x7fe3b0019030 con 0x7fe3c015a530 2024-06-02T22:53:03.531 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:03.531 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1717368710,"num_in_osds":8,"osd_in_since":1717368701,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225710080,"bytes_avail":772868403200,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4929}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-06-02T22:52:53.832860+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-06-02T22:53:03.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 -- 172.21.15.82:0/1690482241 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe3ac06be30 msgr2=0x7fe3ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe3ac06be30 0x7fe3ac06e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe3c01e9950 tx=0x7fe3b4009040 comp rx=0 tx=0).stop 2024-06-02T22:53:03.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 -- 172.21.15.82:0/1690482241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3c015a530 msgr2=0x7fe3c00a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3c015a530 0x7fe3c00a1520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00119d0 tx=0x7fe3b0011e90 comp rx=0 tx=0).stop 2024-06-02T22:53:03.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 -- 172.21.15.82:0/1690482241 shutdown_connections 2024-06-02T22:53:03.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe3ac06be30 0x7fe3ac06e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3c00a1a60 0x7fe3c00cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3c009de60 0x7fe3c00cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 --2- 172.21.15.82:0/1690482241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3c015a530 0x7fe3c00a1520 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 -- 172.21.15.82:0/1690482241 >> 172.21.15.82:0/1690482241 conn(0x7fe3c009d3f0 msgr2=0x7fe3c00cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:03.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 -- 172.21.15.82:0/1690482241 shutdown_connections 2024-06-02T22:53:03.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.533+0000 7fe3c647b640 1 -- 172.21.15.82:0/1690482241 wait complete. 2024-06-02T22:53:03.544 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-06-02T22:53:03.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:53:03.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.644+0000 7fbb6779b640 1 Processor -- start 2024-06-02T22:53:03.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.644+0000 7fbb6779b640 1 -- start start 2024-06-02T22:53:03.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.645+0000 7fbb6779b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb6006ebf0 0x7fbb600cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.645+0000 7fbb6779b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb600cf600 con 0x7fbb600cf190 2024-06-02T22:53:03.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.645+0000 7fbb6779b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb6006d130 con 0x7fbb600ae910 2024-06-02T22:53:03.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.645+0000 7fbb6779b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbb6006d410 con 0x7fbb6006ebf0 2024-06-02T22:53:03.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.645+0000 7fbb64d36640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb6006ebf0 0x7fbb600cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.645+0000 7fbb64d36640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb6006ebf0 0x7fbb600cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49564/0 (socket says 172.21.15.82:49564) 2024-06-02T22:53:03.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.645+0000 7fbb64d36640 1 -- 172.21.15.82:0/797831591 learned_addr learned my addr 172.21.15.82:0/797831591 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:03.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.645+0000 7fbb65d38640 1 --1- 172.21.15.82:0/797831591 >> v1:172.21.15.82:6789/0 conn(0x7fbb600cf190 0x7fbb600acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39418/0 (socket says 172.21.15.82:39418) 2024-06-02T22:53:03.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.646+0000 7fbb64d36640 1 -- 172.21.15.82:0/797831591 >> v1:172.21.15.184:6789/0 conn(0x7fbb600ae910 legacy=0x7fbb6006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:03.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.646+0000 7fbb64d36640 1 -- 172.21.15.82:0/797831591 >> v1:172.21.15.82:6789/0 conn(0x7fbb600cf190 legacy=0x7fbb600acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.646+0000 7fbb64d36640 1 -- 172.21.15.82:0/797831591 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6006d6f0 con 0x7fbb6006ebf0 2024-06-02T22:53:03.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.646+0000 7fbb64d36640 1 --2- 172.21.15.82:0/797831591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb6006ebf0 0x7fbb600cec50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009870 tx=0x7fbb5002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b26d3bb37bbcda server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:03.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.646+0000 7fbb57fff640 1 -- 172.21.15.82:0/797831591 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50037070 con 0x7fbb6006ebf0 2024-06-02T22:53:03.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.646+0000 7fbb57fff640 1 -- 172.21.15.82:0/797831591 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb50032440 con 0x7fbb6006ebf0 2024-06-02T22:53:03.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.646+0000 7fbb57fff640 1 -- 172.21.15.82:0/797831591 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50032810 con 0x7fbb6006ebf0 2024-06-02T22:53:03.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.647+0000 7fbb6779b640 1 -- 172.21.15.82:0/797831591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb6006ebf0 msgr2=0x7fbb600cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.647+0000 7fbb6779b640 1 --2- 172.21.15.82:0/797831591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb6006ebf0 0x7fbb600cec50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009870 tx=0x7fbb5002a210 comp rx=0 tx=0).stop 2024-06-02T22:53:03.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.647+0000 7fbb6779b640 1 -- 172.21.15.82:0/797831591 shutdown_connections 2024-06-02T22:53:03.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.647+0000 7fbb6779b640 1 --2- 172.21.15.82:0/797831591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb6006ebf0 0x7fbb600cec50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.647+0000 7fbb6779b640 1 -- 172.21.15.82:0/797831591 >> 172.21.15.82:0/797831591 conn(0x7fbb600b19f0 msgr2=0x7fbb600b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:03.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.647+0000 7fbb6779b640 1 -- 172.21.15.82:0/797831591 shutdown_connections 2024-06-02T22:53:03.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.647+0000 7fbb6779b640 1 -- 172.21.15.82:0/797831591 wait complete. 2024-06-02T22:53:03.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.648+0000 7fbb6779b640 1 Processor -- start 2024-06-02T22:53:03.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.648+0000 7fbb6779b640 1 -- start start 2024-06-02T22:53:03.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb6779b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb6006ebf0 0x7fbb6015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb6779b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb600ae910 0x7fbb6014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb6779b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb600cf190 0x7fbb6014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb6779b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb600ad450 con 0x7fbb600cf190 2024-06-02T22:53:03.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb6779b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb600aecf0 con 0x7fbb6006ebf0 2024-06-02T22:53:03.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb6779b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbb600ad5d0 con 0x7fbb600ae910 2024-06-02T22:53:03.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb65d38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb600cf190 0x7fbb6014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb65d38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb600cf190 0x7fbb6014f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49576/0 (socket says 172.21.15.82:49576) 2024-06-02T22:53:03.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb65d38640 1 -- 172.21.15.82:0/232175221 learned_addr learned my addr 172.21.15.82:0/232175221 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:03.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb64d36640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb600ae910 0x7fbb6014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb65537640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb6006ebf0 0x7fbb6015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb65d38640 1 -- 172.21.15.82:0/232175221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb600ae910 msgr2=0x7fbb6014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb65d38640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb600ae910 0x7fbb6014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb65d38640 1 -- 172.21.15.82:0/232175221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb6006ebf0 msgr2=0x7fbb6015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb65d38640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb6006ebf0 0x7fbb6015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb65d38640 1 -- 172.21.15.82:0/232175221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6015ba00 con 0x7fbb600cf190 2024-06-02T22:53:03.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.649+0000 7fbb65d38640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb600cf190 0x7fbb6014f3a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800c710 tx=0x7fbb5800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:03.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.650+0000 7fbb55ffb640 1 -- 172.21.15.82:0/232175221 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58017070 con 0x7fbb600cf190 2024-06-02T22:53:03.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.650+0000 7fbb55ffb640 1 -- 172.21.15.82:0/232175221 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb5800ce20 con 0x7fbb600cf190 2024-06-02T22:53:03.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.650+0000 7fbb6779b640 1 -- 172.21.15.82:0/232175221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb60154750 con 0x7fbb600cf190 2024-06-02T22:53:03.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.650+0000 7fbb55ffb640 1 -- 172.21.15.82:0/232175221 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800a860 con 0x7fbb600cf190 2024-06-02T22:53:03.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.650+0000 7fbb6779b640 1 -- 172.21.15.82:0/232175221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb60155490 con 0x7fbb600cf190 2024-06-02T22:53:03.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.651+0000 7fbb6779b640 1 -- 172.21.15.82:0/232175221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb60068430 con 0x7fbb600cf190 2024-06-02T22:53:03.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.651+0000 7fbb55ffb640 1 -- 172.21.15.82:0/232175221 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb5801a070 con 0x7fbb600cf190 2024-06-02T22:53:03.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.652+0000 7fbb55ffb640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb4406be30 0x7fbb4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:03.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.652+0000 7fbb55ffb640 1 -- 172.21.15.82:0/232175221 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fbb5808a5b0 con 0x7fbb600cf190 2024-06-02T22:53:03.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.652+0000 7fbb65537640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb4406be30 0x7fbb4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:03.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.652+0000 7fbb65537640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb4406be30 0x7fbb4406e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c004ea0 tx=0x7fbb5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:03.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.656+0000 7fbb55ffb640 1 -- 172.21.15.82:0/232175221 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbb58058e60 con 0x7fbb600cf190 2024-06-02T22:53:03.811 INFO:tasks.ceph.mds.b.smithi184.stderr:2024-06-02T22:53:03.810+0000 7f52a0c05640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T22:53:03.819 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:53:03.821 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:53:03.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.828+0000 7fbb6779b640 1 -- 172.21.15.82:0/232175221 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb600b16a0 con 0x7fbb4406be30 2024-06-02T22:53:03.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.835+0000 7fbb55ffb640 1 -- 172.21.15.82:0/232175221 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240063 (secure 0 0 0) 0x7fbb600b16a0 con 0x7fbb4406be30 2024-06-02T22:53:03.838 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:03.839 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:53:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 -- 172.21.15.82:0/232175221 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb4406be30 msgr2=0x7fbb4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb4406be30 0x7fbb4406e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c004ea0 tx=0x7fbb5c009040 comp rx=0 tx=0).stop 2024-06-02T22:53:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 -- 172.21.15.82:0/232175221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb600cf190 msgr2=0x7fbb6014f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb600cf190 0x7fbb6014f3a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800c710 tx=0x7fbb5800cbd0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 -- 172.21.15.82:0/232175221 shutdown_connections 2024-06-02T22:53:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb4406be30 0x7fbb4406e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb600cf190 0x7fbb6014f3a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb600ae910 0x7fbb6014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 --2- 172.21.15.82:0/232175221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb6006ebf0 0x7fbb6015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 -- 172.21.15.82:0/232175221 >> 172.21.15.82:0/232175221 conn(0x7fbb600b19f0 msgr2=0x7fbb600af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 -- 172.21.15.82:0/232175221 shutdown_connections 2024-06-02T22:53:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:03.838+0000 7fbb6779b640 1 -- 172.21.15.82:0/232175221 wait complete. 2024-06-02T22:53:03.851 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-06-02T22:53:01.834116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220420,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754300,"statfs":{"total":773094113280,"available":772868403200,"internally_reserved":0,"allocated":4300800,"data_stored":2488376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.016013"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821026+0000","last_change":"2024-06-02T22:52:56.821026+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821026+0000","last_undegraded":"2024-06-02T22:52:56.821026+0000","last_fullsized":"2024-06-02T22:52:56.821026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823559+0000","last_change":"2024-06-02T22:52:56.823559+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823559+0000","last_undegraded":"2024-06-02T22:52:56.823559+0000","last_fullsized":"2024-06-02T22:52:56.823559+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821759+0000","last_change":"2024-06-02T22:52:56.821759+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821759+0000","last_undegraded":"2024-06-02T22:52:56.821759+0000","last_fullsized":"2024-06-02T22:52:56.821759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822715+0000","last_change":"2024-06-02T22:52:56.822715+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822715+0000","last_undegraded":"2024-06-02T22:52:56.822715+0000","last_fullsized":"2024-06-02T22:52:56.822715+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825054+0000","last_change":"2024-06-02T22:52:56.825054+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825054+0000","last_undegraded":"2024-06-02T22:52:56.825054+0000","last_fullsized":"2024-06-02T22:52:56.825054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825805+0000","last_change":"2024-06-02T22:52:56.825805+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825805+0000","last_undegraded":"2024-06-02T22:52:56.825805+0000","last_fullsized":"2024-06-02T22:52:56.825805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821782+0000","last_change":"2024-06-02T22:52:56.821782+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821782+0000","last_undegraded":"2024-06-02T22:52:56.821782+0000","last_fullsized":"2024-06-02T22:52:56.821782+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822293+0000","last_change":"2024-06-02T22:52:56.822293+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822293+0000","last_undegraded":"2024-06-02T22:52:56.822293+0000","last_fullsized":"2024-06-02T22:52:56.822293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824628+0000","last_change":"2024-06-02T22:52:56.824628+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824628+0000","last_undegraded":"2024-06-02T22:52:56.824628+0000","last_fullsized":"2024-06-02T22:52:56.824628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825031+0000","last_change":"2024-06-02T22:52:56.825031+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825031+0000","last_undegraded":"2024-06-02T22:52:56.825031+0000","last_fullsized":"2024-06-02T22:52:56.825031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825111+0000","last_change":"2024-06-02T22:52:56.825111+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825111+0000","last_undegraded":"2024-06-02T22:52:56.825111+0000","last_fullsized":"2024-06-02T22:52:56.825111+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824663+0000","last_change":"2024-06-02T22:52:56.824663+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824663+0000","last_undegraded":"2024-06-02T22:52:56.824663+0000","last_fullsized":"2024-06-02T22:52:56.824663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824675+0000","last_change":"2024-06-02T22:52:56.824675+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824675+0000","last_undegraded":"2024-06-02T22:52:56.824675+0000","last_fullsized":"2024-06-02T22:52:56.824675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821588+0000","last_change":"2024-06-02T22:52:56.821588+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821588+0000","last_undegraded":"2024-06-02T22:52:56.821588+0000","last_fullsized":"2024-06-02T22:52:56.821588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821120+0000","last_change":"2024-06-02T22:52:56.821120+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821120+0000","last_undegraded":"2024-06-02T22:52:56.821120+0000","last_fullsized":"2024-06-02T22:52:56.821120+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825373+0000","last_change":"2024-06-02T22:52:56.825373+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825373+0000","last_undegraded":"2024-06-02T22:52:56.825373+0000","last_fullsized":"2024-06-02T22:52:56.825373+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825761+0000","last_change":"2024-06-02T22:52:56.825761+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825761+0000","last_undegraded":"2024-06-02T22:52:56.825761+0000","last_fullsized":"2024-06-02T22:52:56.825761+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822349+0000","last_change":"2024-06-02T22:52:56.822349+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822349+0000","last_undegraded":"2024-06-02T22:52:56.822349+0000","last_fullsized":"2024-06-02T22:52:56.822349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827606+0000","last_change":"2024-06-02T22:52:56.827606+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827606+0000","last_undegraded":"2024-06-02T22:52:56.827606+0000","last_fullsized":"2024-06-02T22:52:56.827606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821588+0000","last_change":"2024-06-02T22:52:56.821588+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821588+0000","last_undegraded":"2024-06-02T22:52:56.821588+0000","last_fullsized":"2024-06-02T22:52:56.821588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827574+0000","last_change":"2024-06-02T22:52:56.827574+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827574+0000","last_undegraded":"2024-06-02T22:52:56.827574+0000","last_fullsized":"2024-06-02T22:52:56.827574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827597+0000","last_change":"2024-06-02T22:52:56.827597+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827597+0000","last_undegraded":"2024-06-02T22:52:56.827597+0000","last_fullsized":"2024-06-02T22:52:56.827597+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825415+0000","last_change":"2024-06-02T22:52:56.825415+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825415+0000","last_undegraded":"2024-06-02T22:52:56.825415+0000","last_fullsized":"2024-06-02T22:52:56.825415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827570+0000","last_change":"2024-06-02T22:52:56.827570+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827570+0000","last_undegraded":"2024-06-02T22:52:56.827570+0000","last_fullsized":"2024-06-02T22:52:56.827570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825322+0000","last_change":"2024-06-02T22:52:56.825322+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825322+0000","last_undegraded":"2024-06-02T22:52:56.825322+0000","last_fullsized":"2024-06-02T22:52:56.825322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.827580+0000","last_change":"2024-06-02T22:52:56.827580+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.827580+0000","last_undegraded":"2024-06-02T22:52:56.827580+0000","last_fullsized":"2024-06-02T22:52:56.827580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823404+0000","last_change":"2024-06-02T22:52:56.823404+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823404+0000","last_undegraded":"2024-06-02T22:52:56.823404+0000","last_fullsized":"2024-06-02T22:52:56.823404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.823220+0000","last_change":"2024-06-02T22:52:56.823220+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.823220+0000","last_undegraded":"2024-06-02T22:52:56.823220+0000","last_fullsized":"2024-06-02T22:52:56.823220+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.821021+0000","last_change":"2024-06-02T22:52:56.821021+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.821021+0000","last_undegraded":"2024-06-02T22:52:56.821021+0000","last_fullsized":"2024-06-02T22:52:56.821021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.822287+0000","last_change":"2024-06-02T22:52:56.822287+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.822287+0000","last_undegraded":"2024-06-02T22:52:56.822287+0000","last_fullsized":"2024-06-02T22:52:56.822287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.824675+0000","last_change":"2024-06-02T22:52:56.824675+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.824675+0000","last_undegraded":"2024-06-02T22:52:56.824675+0000","last_fullsized":"2024-06-02T22:52:56.824675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:52:57.817554+0000","last_change":"2024-06-02T22:52:57.817554+0000","last_active":"2024-06-02T22:52:57.817554+0000","last_peered":"2024-06-02T22:52:57.817554+0000","last_clean":"2024-06-02T22:52:57.817554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:57.817554+0000","last_undegraded":"2024-06-02T22:52:57.817554+0000","last_fullsized":"2024-06-02T22:52:57.817554+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-06-02T22:52:56.825370+0000","last_change":"2024-06-02T22:52:56.825370+0000","last_active":"2024-06-02T22:52:56.812867+0000","last_peered":"2024-06-02T22:52:56.812867+0000","last_clean":"2024-06-02T22:52:56.812867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:52:56.825370+0000","last_undegraded":"2024-06-02T22:52:56.825370+0000","last_fullsized":"2024-06-02T22:52:56.825370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-06-02T22:52:56.826275+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:52:56.826275+0000","last_peered":"2024-06-02T22:52:56.826275+0000","last_clean":"2024-06-02T22:52:56.826275+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:52:56.826275+0000","last_undegraded":"2024-06-02T22:52:56.826275+0000","last_fullsized":"2024-06-02T22:52:56.826275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":163455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":753823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:53:06.856 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:53:06.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.966+0000 7fa4a11c1640 1 Processor -- start 2024-06-02T22:53:06.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.966+0000 7fa4a11c1640 1 -- start start 2024-06-02T22:53:06.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa4a11c1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa49c06ebf0 0x7fa49c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:06.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa4a11c1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa49c0cf190 0x7fa49c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:06.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa4a11c1640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49c0cf620 con 0x7fa49c0ae910 2024-06-02T22:53:06.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa4a11c1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa49c06d130 con 0x7fa49c06ebf0 2024-06-02T22:53:06.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa4a11c1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c06d410 con 0x7fa49c0cf190 2024-06-02T22:53:06.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa49a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa49c06ebf0 0x7fa49c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:06.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa49a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa49c06ebf0 0x7fa49c0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49578/0 (socket says 172.21.15.82:49578) 2024-06-02T22:53:06.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa49a59c640 1 -- 172.21.15.82:0/330412601 learned_addr learned my addr 172.21.15.82:0/330412601 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:06.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa49b59e640 1 --2- 172.21.15.82:0/330412601 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa49c0cf190 0x7fa49c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:06.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa49a59c640 1 -- 172.21.15.82:0/330412601 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa49c0cf190 msgr2=0x7fa49c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:06.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa49a59c640 1 --2- 172.21.15.82:0/330412601 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa49c0cf190 0x7fa49c0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:06.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa49a59c640 1 -- 172.21.15.82:0/330412601 >> v1:172.21.15.184:6789/0 conn(0x7fa49c0ae910 legacy=0x7fa49c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:06.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.967+0000 7fa49a59c640 1 -- 172.21.15.82:0/330412601 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c06d6f0 con 0x7fa49c06ebf0 2024-06-02T22:53:06.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.968+0000 7fa49a59c640 1 --2- 172.21.15.82:0/330412601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c06ebf0 0x7fa49c0cec50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa490009870 tx=0x7fa49002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5770246da93c4da server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:06.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.968+0000 7fa499d9b640 1 -- 172.21.15.82:0/330412601 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490037070 con 0x7fa49c06ebf0 2024-06-02T22:53:06.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.968+0000 7fa499d9b640 1 -- 172.21.15.82:0/330412601 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490032440 con 0x7fa49c06ebf0 2024-06-02T22:53:06.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.968+0000 7fa499d9b640 1 -- 172.21.15.82:0/330412601 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490032810 con 0x7fa49c06ebf0 2024-06-02T22:53:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.969+0000 7fa4a11c1640 1 -- 172.21.15.82:0/330412601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c06ebf0 msgr2=0x7fa49c0cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.969+0000 7fa4a11c1640 1 --2- 172.21.15.82:0/330412601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c06ebf0 0x7fa49c0cec50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa490009870 tx=0x7fa49002a180 comp rx=0 tx=0).stop 2024-06-02T22:53:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.969+0000 7fa4a11c1640 1 -- 172.21.15.82:0/330412601 shutdown_connections 2024-06-02T22:53:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.969+0000 7fa4a11c1640 1 --2- 172.21.15.82:0/330412601 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa49c0cf190 0x7fa49c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.969+0000 7fa4a11c1640 1 --2- 172.21.15.82:0/330412601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c06ebf0 0x7fa49c0cec50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.969+0000 7fa4a11c1640 1 -- 172.21.15.82:0/330412601 >> 172.21.15.82:0/330412601 conn(0x7fa49c0b19f0 msgr2=0x7fa49c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:06.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.969+0000 7fa4a11c1640 1 -- 172.21.15.82:0/330412601 shutdown_connections 2024-06-02T22:53:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.969+0000 7fa4a11c1640 1 -- 172.21.15.82:0/330412601 wait complete. 2024-06-02T22:53:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.970+0000 7fa4a11c1640 1 Processor -- start 2024-06-02T22:53:06.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.970+0000 7fa4a11c1640 1 -- start start 2024-06-02T22:53:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa4a11c1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa49c06ebf0 0x7fa49c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa4a11c1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa49c0ae910 0x7fa49c1f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa4a11c1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0cf190 0x7fa49c1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa4a11c1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c0ad280 con 0x7fa49c0cf190 2024-06-02T22:53:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa4a11c1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c0aecf0 con 0x7fa49c06ebf0 2024-06-02T22:53:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa4a11c1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c0ad400 con 0x7fa49c0ae910 2024-06-02T22:53:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa49b59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0cf190 0x7fa49c1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa49b59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0cf190 0x7fa49c1572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49582/0 (socket says 172.21.15.82:49582) 2024-06-02T22:53:06.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa49b59e640 1 -- 172.21.15.82:0/2796607888 learned_addr learned my addr 172.21.15.82:0/2796607888 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa49ad9d640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa49c06ebf0 0x7fa49c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa49a59c640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa49c0ae910 0x7fa49c1f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa49b59e640 1 -- 172.21.15.82:0/2796607888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa49c0ae910 msgr2=0x7fa49c1f1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa49b59e640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa49c0ae910 0x7fa49c1f1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa49b59e640 1 -- 172.21.15.82:0/2796607888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa49c06ebf0 msgr2=0x7fa49c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa49b59e640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa49c06ebf0 0x7fa49c154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.971+0000 7fa49b59e640 1 -- 172.21.15.82:0/2796607888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c156aa0 con 0x7fa49c0cf190 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.972+0000 7fa49b59e640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0cf190 0x7fa49c1572d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa494007e40 tx=0x7fa49400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.972+0000 7fa4837fe640 1 -- 172.21.15.82:0/2796607888 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494014620 con 0x7fa49c0cf190 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.972+0000 7fa4837fe640 1 -- 172.21.15.82:0/2796607888 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa494019070 con 0x7fa49c0cf190 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.972+0000 7fa4837fe640 1 -- 172.21.15.82:0/2796607888 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494014a20 con 0x7fa49c0cf190 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.972+0000 7fa4a11c1640 1 -- 172.21.15.82:0/2796607888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c09bb00 con 0x7fa49c0cf190 2024-06-02T22:53:06.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.972+0000 7fa4a11c1640 1 -- 172.21.15.82:0/2796607888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c09c0c0 con 0x7fa49c0cf190 2024-06-02T22:53:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.973+0000 7fa4a11c1640 1 -- 172.21.15.82:0/2796607888 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c068430 con 0x7fa49c0cf190 2024-06-02T22:53:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.973+0000 7fa4837fe640 1 -- 172.21.15.82:0/2796607888 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa494014bc0 con 0x7fa49c0cf190 2024-06-02T22:53:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.974+0000 7fa4837fe640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa48806be30 0x7fa48806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.974+0000 7fa4837fe640 1 -- 172.21.15.82:0/2796607888 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fa49408b7b0 con 0x7fa49c0cf190 2024-06-02T22:53:06.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.974+0000 7fa49ad9d640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa48806be30 0x7fa48806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:06.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.974+0000 7fa49ad9d640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa48806be30 0x7fa48806e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa48c004f60 tx=0x7fa48c007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:06.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:06.978+0000 7fa4837fe640 1 -- 172.21.15.82:0/2796607888 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa494059980 con 0x7fa49c0cf190 2024-06-02T22:53:07.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.152+0000 7fa4a11c1640 1 -- 172.21.15.82:0/2796607888 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa49c06e5a0 con 0x7fa48806be30 2024-06-02T22:53:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.158+0000 7fa4837fe640 1 -- 172.21.15.82:0/2796607888 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7fa49c06e5a0 con 0x7fa48806be30 2024-06-02T22:53:07.160 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:07.161 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:53:07.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 -- 172.21.15.82:0/2796607888 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa48806be30 msgr2=0x7fa48806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa48806be30 0x7fa48806e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa48c004f60 tx=0x7fa48c007e30 comp rx=0 tx=0).stop 2024-06-02T22:53:07.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 -- 172.21.15.82:0/2796607888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0cf190 msgr2=0x7fa49c1572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0cf190 0x7fa49c1572d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa494007e40 tx=0x7fa49400e4b0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 -- 172.21.15.82:0/2796607888 shutdown_connections 2024-06-02T22:53:07.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa48806be30 0x7fa48806e2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0cf190 0x7fa49c1572d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa49c0ae910 0x7fa49c1f1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 --2- 172.21.15.82:0/2796607888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa49c06ebf0 0x7fa49c154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 -- 172.21.15.82:0/2796607888 >> 172.21.15.82:0/2796607888 conn(0x7fa49c0b19f0 msgr2=0x7fa49c15d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:07.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 -- 172.21.15.82:0/2796607888 shutdown_connections 2024-06-02T22:53:07.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.161+0000 7fa4a11c1640 1 -- 172.21.15.82:0/2796607888 wait complete. 2024-06-02T22:53:07.172 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-06-02T22:53:05.836463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220832,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753888,"statfs":{"total":773094113280,"available":772867981312,"internally_reserved":0,"allocated":4759552,"data_stored":2707076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003012"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383354+0000","last_change":"2024-06-02T22:52:58.848089+0000","last_active":"2024-06-02T22:53:00.383354+0000","last_peered":"2024-06-02T22:53:00.383354+0000","last_clean":"2024-06-02T22:53:00.383354+0000","last_became_active":"2024-06-02T22:52:58.847812+0000","last_became_peered":"2024-06-02T22:52:58.847812+0000","last_unstale":"2024-06-02T22:53:00.383354+0000","last_undegraded":"2024-06-02T22:53:00.383354+0000","last_fullsized":"2024-06-02T22:53:00.383354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:41:48.757934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383632+0000","last_change":"2024-06-02T22:52:58.847174+0000","last_active":"2024-06-02T22:53:00.383632+0000","last_peered":"2024-06-02T22:53:00.383632+0000","last_clean":"2024-06-02T22:53:00.383632+0000","last_became_active":"2024-06-02T22:52:58.846893+0000","last_became_peered":"2024-06-02T22:52:58.846893+0000","last_unstale":"2024-06-02T22:53:00.383632+0000","last_undegraded":"2024-06-02T22:53:00.383632+0000","last_fullsized":"2024-06-02T22:53:00.383632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:47:21.281752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383817+0000","last_change":"2024-06-02T22:52:58.862938+0000","last_active":"2024-06-02T22:53:00.383817+0000","last_peered":"2024-06-02T22:53:00.383817+0000","last_clean":"2024-06-02T22:53:00.383817+0000","last_became_active":"2024-06-02T22:52:58.862624+0000","last_became_peered":"2024-06-02T22:52:58.862624+0000","last_unstale":"2024-06-02T22:53:00.383817+0000","last_undegraded":"2024-06-02T22:53:00.383817+0000","last_fullsized":"2024-06-02T22:53:00.383817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:18:19.969269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.849908+0000","last_change":"2024-06-02T22:52:58.845958+0000","last_active":"2024-06-02T22:52:59.849908+0000","last_peered":"2024-06-02T22:52:59.849908+0000","last_clean":"2024-06-02T22:52:59.849908+0000","last_became_active":"2024-06-02T22:52:58.845011+0000","last_became_peered":"2024-06-02T22:52:58.845011+0000","last_unstale":"2024-06-02T22:52:59.849908+0000","last_undegraded":"2024-06-02T22:52:59.849908+0000","last_fullsized":"2024-06-02T22:52:59.849908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:43.154234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.849732+0000","last_change":"2024-06-02T22:52:58.844504+0000","last_active":"2024-06-02T22:52:59.849732+0000","last_peered":"2024-06-02T22:52:59.849732+0000","last_clean":"2024-06-02T22:52:59.849732+0000","last_became_active":"2024-06-02T22:52:58.844238+0000","last_became_peered":"2024-06-02T22:52:58.844238+0000","last_unstale":"2024-06-02T22:52:59.849732+0000","last_undegraded":"2024-06-02T22:52:59.849732+0000","last_fullsized":"2024-06-02T22:52:59.849732+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:00:43.028626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.382988+0000","last_change":"2024-06-02T22:52:58.850763+0000","last_active":"2024-06-02T22:53:00.382988+0000","last_peered":"2024-06-02T22:53:00.382988+0000","last_clean":"2024-06-02T22:53:00.382988+0000","last_became_active":"2024-06-02T22:52:58.850356+0000","last_became_peered":"2024-06-02T22:52:58.850356+0000","last_unstale":"2024-06-02T22:53:00.382988+0000","last_undegraded":"2024-06-02T22:53:00.382988+0000","last_fullsized":"2024-06-02T22:53:00.382988+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:29.034841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.851653+0000","last_change":"2024-06-02T22:52:58.856515+0000","last_active":"2024-06-02T22:52:59.851653+0000","last_peered":"2024-06-02T22:52:59.851653+0000","last_clean":"2024-06-02T22:52:59.851653+0000","last_became_active":"2024-06-02T22:52:58.856241+0000","last_became_peered":"2024-06-02T22:52:58.856241+0000","last_unstale":"2024-06-02T22:52:59.851653+0000","last_undegraded":"2024-06-02T22:52:59.851653+0000","last_fullsized":"2024-06-02T22:52:59.851653+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:21.211165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.382660+0000","last_change":"2024-06-02T22:52:58.860781+0000","last_active":"2024-06-02T22:53:00.382660+0000","last_peered":"2024-06-02T22:53:00.382660+0000","last_clean":"2024-06-02T22:53:00.382660+0000","last_became_active":"2024-06-02T22:52:58.860511+0000","last_became_peered":"2024-06-02T22:52:58.860511+0000","last_unstale":"2024-06-02T22:53:00.382660+0000","last_undegraded":"2024-06-02T22:53:00.382660+0000","last_fullsized":"2024-06-02T22:53:00.382660+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:42:54.049240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383473+0000","last_change":"2024-06-02T22:52:58.863884+0000","last_active":"2024-06-02T22:53:00.383473+0000","last_peered":"2024-06-02T22:53:00.383473+0000","last_clean":"2024-06-02T22:53:00.383473+0000","last_became_active":"2024-06-02T22:52:58.863619+0000","last_became_peered":"2024-06-02T22:52:58.863619+0000","last_unstale":"2024-06-02T22:53:00.383473+0000","last_undegraded":"2024-06-02T22:53:00.383473+0000","last_fullsized":"2024-06-02T22:53:00.383473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:34:54.172246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.852211+0000","last_change":"2024-06-02T22:52:58.861516+0000","last_active":"2024-06-02T22:52:59.852211+0000","last_peered":"2024-06-02T22:52:59.852211+0000","last_clean":"2024-06-02T22:52:59.852211+0000","last_became_active":"2024-06-02T22:52:58.861227+0000","last_became_peered":"2024-06-02T22:52:58.861227+0000","last_unstale":"2024-06-02T22:52:59.852211+0000","last_undegraded":"2024-06-02T22:52:59.852211+0000","last_fullsized":"2024-06-02T22:52:59.852211+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:15:17.064184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.852118+0000","last_change":"2024-06-02T22:52:58.867378+0000","last_active":"2024-06-02T22:52:59.852118+0000","last_peered":"2024-06-02T22:52:59.852118+0000","last_clean":"2024-06-02T22:52:59.852118+0000","last_became_active":"2024-06-02T22:52:58.866805+0000","last_became_peered":"2024-06-02T22:52:58.866805+0000","last_unstale":"2024-06-02T22:52:59.852118+0000","last_undegraded":"2024-06-02T22:52:59.852118+0000","last_fullsized":"2024-06-02T22:52:59.852118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:01.699783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383159+0000","last_change":"2024-06-02T22:52:58.848367+0000","last_active":"2024-06-02T22:53:00.383159+0000","last_peered":"2024-06-02T22:53:00.383159+0000","last_clean":"2024-06-02T22:53:00.383159+0000","last_became_active":"2024-06-02T22:52:58.848097+0000","last_became_peered":"2024-06-02T22:52:58.848097+0000","last_unstale":"2024-06-02T22:53:00.383159+0000","last_undegraded":"2024-06-02T22:53:00.383159+0000","last_fullsized":"2024-06-02T22:53:00.383159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:17:11.872685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.851797+0000","last_change":"2024-06-02T22:52:58.860769+0000","last_active":"2024-06-02T22:52:59.851797+0000","last_peered":"2024-06-02T22:52:59.851797+0000","last_clean":"2024-06-02T22:52:59.851797+0000","last_became_active":"2024-06-02T22:52:58.860300+0000","last_became_peered":"2024-06-02T22:52:58.860300+0000","last_unstale":"2024-06-02T22:52:59.851797+0000","last_undegraded":"2024-06-02T22:52:59.851797+0000","last_fullsized":"2024-06-02T22:52:59.851797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:06.422238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848030+0000","last_change":"2024-06-02T22:52:58.843503+0000","last_active":"2024-06-02T22:52:59.848030+0000","last_peered":"2024-06-02T22:52:59.848030+0000","last_clean":"2024-06-02T22:52:59.848030+0000","last_became_active":"2024-06-02T22:52:58.843224+0000","last_became_peered":"2024-06-02T22:52:58.843224+0000","last_unstale":"2024-06-02T22:52:59.848030+0000","last_undegraded":"2024-06-02T22:52:59.848030+0000","last_fullsized":"2024-06-02T22:52:59.848030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:24:16.200433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.851731+0000","last_change":"2024-06-02T22:52:58.858088+0000","last_active":"2024-06-02T22:52:59.851731+0000","last_peered":"2024-06-02T22:52:59.851731+0000","last_clean":"2024-06-02T22:52:59.851731+0000","last_became_active":"2024-06-02T22:52:58.857778+0000","last_became_peered":"2024-06-02T22:52:58.857778+0000","last_unstale":"2024-06-02T22:52:59.851731+0000","last_undegraded":"2024-06-02T22:52:59.851731+0000","last_fullsized":"2024-06-02T22:52:59.851731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:00.553027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383076+0000","last_change":"2024-06-02T22:52:58.862226+0000","last_active":"2024-06-02T22:53:00.383076+0000","last_peered":"2024-06-02T22:53:00.383076+0000","last_clean":"2024-06-02T22:53:00.383076+0000","last_became_active":"2024-06-02T22:52:58.861957+0000","last_became_peered":"2024-06-02T22:52:58.861957+0000","last_unstale":"2024-06-02T22:53:00.383076+0000","last_undegraded":"2024-06-02T22:53:00.383076+0000","last_fullsized":"2024-06-02T22:53:00.383076+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:00.553027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383557+0000","last_change":"2024-06-02T22:52:58.863381+0000","last_active":"2024-06-02T22:53:00.383557+0000","last_peered":"2024-06-02T22:53:00.383557+0000","last_clean":"2024-06-02T22:53:00.383557+0000","last_became_active":"2024-06-02T22:52:58.862848+0000","last_became_peered":"2024-06-02T22:52:58.862848+0000","last_unstale":"2024-06-02T22:53:00.383557+0000","last_undegraded":"2024-06-02T22:53:00.383557+0000","last_fullsized":"2024-06-02T22:53:00.383557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:47:21.281752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848855+0000","last_change":"2024-06-02T22:52:58.854140+0000","last_active":"2024-06-02T22:52:59.848855+0000","last_peered":"2024-06-02T22:52:59.848855+0000","last_clean":"2024-06-02T22:52:59.848855+0000","last_became_active":"2024-06-02T22:52:58.853541+0000","last_became_peered":"2024-06-02T22:52:58.853541+0000","last_unstale":"2024-06-02T22:52:59.848855+0000","last_undegraded":"2024-06-02T22:52:59.848855+0000","last_fullsized":"2024-06-02T22:52:59.848855+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:08:26.755388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.849873+0000","last_change":"2024-06-02T22:52:58.845439+0000","last_active":"2024-06-02T22:52:59.849873+0000","last_peered":"2024-06-02T22:52:59.849873+0000","last_clean":"2024-06-02T22:52:59.849873+0000","last_became_active":"2024-06-02T22:52:58.845036+0000","last_became_peered":"2024-06-02T22:52:58.845036+0000","last_unstale":"2024-06-02T22:52:59.849873+0000","last_undegraded":"2024-06-02T22:52:59.849873+0000","last_fullsized":"2024-06-02T22:52:59.849873+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:13:28.088641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848131+0000","last_change":"2024-06-02T22:52:58.845820+0000","last_active":"2024-06-02T22:52:59.848131+0000","last_peered":"2024-06-02T22:52:59.848131+0000","last_clean":"2024-06-02T22:52:59.848131+0000","last_became_active":"2024-06-02T22:52:58.845557+0000","last_became_peered":"2024-06-02T22:52:58.845557+0000","last_unstale":"2024-06-02T22:52:59.848131+0000","last_undegraded":"2024-06-02T22:52:59.848131+0000","last_fullsized":"2024-06-02T22:52:59.848131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:48:22.246288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.851889+0000","last_change":"2024-06-02T22:52:58.860560+0000","last_active":"2024-06-02T22:52:59.851889+0000","last_peered":"2024-06-02T22:52:59.851889+0000","last_clean":"2024-06-02T22:52:59.851889+0000","last_became_active":"2024-06-02T22:52:58.859987+0000","last_became_peered":"2024-06-02T22:52:58.859987+0000","last_unstale":"2024-06-02T22:52:59.851889+0000","last_undegraded":"2024-06-02T22:52:59.851889+0000","last_fullsized":"2024-06-02T22:52:59.851889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:24:46.378503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848355+0000","last_change":"2024-06-02T22:52:58.847732+0000","last_active":"2024-06-02T22:52:59.848355+0000","last_peered":"2024-06-02T22:52:59.848355+0000","last_clean":"2024-06-02T22:52:59.848355+0000","last_became_active":"2024-06-02T22:52:58.844183+0000","last_became_peered":"2024-06-02T22:52:58.844183+0000","last_unstale":"2024-06-02T22:52:59.848355+0000","last_undegraded":"2024-06-02T22:52:59.848355+0000","last_fullsized":"2024-06-02T22:52:59.848355+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:29.034841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383146+0000","last_change":"2024-06-02T22:52:58.855866+0000","last_active":"2024-06-02T22:53:00.383146+0000","last_peered":"2024-06-02T22:53:00.383146+0000","last_clean":"2024-06-02T22:53:00.383146+0000","last_became_active":"2024-06-02T22:52:58.855329+0000","last_became_peered":"2024-06-02T22:52:58.855329+0000","last_unstale":"2024-06-02T22:53:00.383146+0000","last_undegraded":"2024-06-02T22:53:00.383146+0000","last_fullsized":"2024-06-02T22:53:00.383146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:42:54.049240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.849751+0000","last_change":"2024-06-02T22:52:58.859706+0000","last_active":"2024-06-02T22:52:59.849751+0000","last_peered":"2024-06-02T22:52:59.849751+0000","last_clean":"2024-06-02T22:52:59.849751+0000","last_became_active":"2024-06-02T22:52:58.859478+0000","last_became_peered":"2024-06-02T22:52:58.859478+0000","last_unstale":"2024-06-02T22:52:59.849751+0000","last_undegraded":"2024-06-02T22:52:59.849751+0000","last_fullsized":"2024-06-02T22:52:59.849751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:16:13.627651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848927+0000","last_change":"2024-06-02T22:52:58.854474+0000","last_active":"2024-06-02T22:52:59.848927+0000","last_peered":"2024-06-02T22:52:59.848927+0000","last_clean":"2024-06-02T22:52:59.848927+0000","last_became_active":"2024-06-02T22:52:58.854019+0000","last_became_peered":"2024-06-02T22:52:58.854019+0000","last_unstale":"2024-06-02T22:52:59.848927+0000","last_undegraded":"2024-06-02T22:52:59.848927+0000","last_fullsized":"2024-06-02T22:52:59.848927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:49:56.745878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383339+0000","last_change":"2024-06-02T22:52:58.863115+0000","last_active":"2024-06-02T22:53:00.383339+0000","last_peered":"2024-06-02T22:53:00.383339+0000","last_clean":"2024-06-02T22:53:00.383339+0000","last_became_active":"2024-06-02T22:52:58.862807+0000","last_became_peered":"2024-06-02T22:52:58.862807+0000","last_unstale":"2024-06-02T22:53:00.383339+0000","last_undegraded":"2024-06-02T22:53:00.383339+0000","last_fullsized":"2024-06-02T22:53:00.383339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:17:11.872685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848938+0000","last_change":"2024-06-02T22:52:58.847831+0000","last_active":"2024-06-02T22:52:59.848938+0000","last_peered":"2024-06-02T22:52:59.848938+0000","last_clean":"2024-06-02T22:52:59.848938+0000","last_became_active":"2024-06-02T22:52:58.847554+0000","last_became_peered":"2024-06-02T22:52:58.847554+0000","last_unstale":"2024-06-02T22:52:59.848938+0000","last_undegraded":"2024-06-02T22:52:59.848938+0000","last_fullsized":"2024-06-02T22:52:59.848938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:29.034841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.852023+0000","last_change":"2024-06-02T22:52:58.861184+0000","last_active":"2024-06-02T22:52:59.852023+0000","last_peered":"2024-06-02T22:52:59.852023+0000","last_clean":"2024-06-02T22:52:59.852023+0000","last_became_active":"2024-06-02T22:52:58.859620+0000","last_became_peered":"2024-06-02T22:52:58.859620+0000","last_unstale":"2024-06-02T22:52:59.852023+0000","last_undegraded":"2024-06-02T22:52:59.852023+0000","last_fullsized":"2024-06-02T22:52:59.852023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:40:36.693324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848605+0000","last_change":"2024-06-02T22:52:58.845650+0000","last_active":"2024-06-02T22:52:59.848605+0000","last_peered":"2024-06-02T22:52:59.848605+0000","last_clean":"2024-06-02T22:52:59.848605+0000","last_became_active":"2024-06-02T22:52:58.845363+0000","last_became_peered":"2024-06-02T22:52:58.845363+0000","last_unstale":"2024-06-02T22:52:59.848605+0000","last_undegraded":"2024-06-02T22:52:59.848605+0000","last_fullsized":"2024-06-02T22:52:59.848605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:24:16.200433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848181+0000","last_change":"2024-06-02T22:52:58.848869+0000","last_active":"2024-06-02T22:52:59.848181+0000","last_peered":"2024-06-02T22:52:59.848181+0000","last_clean":"2024-06-02T22:52:59.848181+0000","last_became_active":"2024-06-02T22:52:58.848608+0000","last_became_peered":"2024-06-02T22:52:58.848608+0000","last_unstale":"2024-06-02T22:52:59.848181+0000","last_undegraded":"2024-06-02T22:52:59.848181+0000","last_fullsized":"2024-06-02T22:52:59.848181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:34:21.585140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383264+0000","last_change":"2024-06-02T22:52:58.856075+0000","last_active":"2024-06-02T22:53:00.383264+0000","last_peered":"2024-06-02T22:53:00.383264+0000","last_clean":"2024-06-02T22:53:00.383264+0000","last_became_active":"2024-06-02T22:52:58.855699+0000","last_became_peered":"2024-06-02T22:52:58.855699+0000","last_unstale":"2024-06-02T22:53:00.383264+0000","last_undegraded":"2024-06-02T22:53:00.383264+0000","last_fullsized":"2024-06-02T22:53:00.383264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:15:16.363124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383305+0000","last_change":"2024-06-02T22:52:58.847378+0000","last_active":"2024-06-02T22:53:00.383305+0000","last_peered":"2024-06-02T22:53:00.383305+0000","last_clean":"2024-06-02T22:53:00.383305+0000","last_became_active":"2024-06-02T22:52:58.847122+0000","last_became_peered":"2024-06-02T22:52:58.847122+0000","last_unstale":"2024-06-02T22:53:00.383305+0000","last_undegraded":"2024-06-02T22:53:00.383305+0000","last_fullsized":"2024-06-02T22:53:00.383305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:06:41.498867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383496+0000","last_change":"2024-06-02T22:52:58.862520+0000","last_active":"2024-06-02T22:53:00.383496+0000","last_peered":"2024-06-02T22:53:00.383496+0000","last_clean":"2024-06-02T22:53:00.383496+0000","last_became_active":"2024-06-02T22:52:58.862145+0000","last_became_peered":"2024-06-02T22:52:58.862145+0000","last_unstale":"2024-06-02T22:53:00.383496+0000","last_undegraded":"2024-06-02T22:53:00.383496+0000","last_fullsized":"2024-06-02T22:53:00.383496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:41:48.757934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848834+0000","last_change":"2024-06-02T22:52:57.836151+0000","last_active":"2024-06-02T22:52:59.848834+0000","last_peered":"2024-06-02T22:52:59.848834+0000","last_clean":"2024-06-02T22:52:59.848834+0000","last_became_active":"2024-06-02T22:52:57.835820+0000","last_became_peered":"2024-06-02T22:52:57.835820+0000","last_unstale":"2024-06-02T22:52:59.848834+0000","last_undegraded":"2024-06-02T22:52:59.848834+0000","last_fullsized":"2024-06-02T22:52:59.848834+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:27:37.183727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.384084+0000","last_change":"2024-06-02T22:52:58.863294+0000","last_active":"2024-06-02T22:53:00.384084+0000","last_peered":"2024-06-02T22:53:00.384084+0000","last_clean":"2024-06-02T22:53:00.384084+0000","last_became_active":"2024-06-02T22:52:58.863035+0000","last_became_peered":"2024-06-02T22:52:58.863035+0000","last_unstale":"2024-06-02T22:53:00.384084+0000","last_undegraded":"2024-06-02T22:53:00.384084+0000","last_fullsized":"2024-06-02T22:53:00.384084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:34:54.172246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383522+0000","last_change":"2024-06-02T22:52:57.840551+0000","last_active":"2024-06-02T22:53:00.383522+0000","last_peered":"2024-06-02T22:53:00.383522+0000","last_clean":"2024-06-02T22:53:00.383522+0000","last_became_active":"2024-06-02T22:52:57.840309+0000","last_became_peered":"2024-06-02T22:52:57.840309+0000","last_unstale":"2024-06-02T22:53:00.383522+0000","last_undegraded":"2024-06-02T22:53:00.383522+0000","last_fullsized":"2024-06-02T22:53:00.383522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:21.033797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848712+0000","last_change":"2024-06-02T22:52:58.843997+0000","last_active":"2024-06-02T22:52:59.848712+0000","last_peered":"2024-06-02T22:52:59.848712+0000","last_clean":"2024-06-02T22:52:59.848712+0000","last_became_active":"2024-06-02T22:52:58.843711+0000","last_became_peered":"2024-06-02T22:52:58.843711+0000","last_unstale":"2024-06-02T22:52:59.848712+0000","last_undegraded":"2024-06-02T22:52:59.848712+0000","last_fullsized":"2024-06-02T22:52:59.848712+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:17:11.872685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.384109+0000","last_change":"2024-06-02T22:52:57.839271+0000","last_active":"2024-06-02T22:53:00.384109+0000","last_peered":"2024-06-02T22:53:00.384109+0000","last_clean":"2024-06-02T22:53:00.384109+0000","last_became_active":"2024-06-02T22:52:57.838997+0000","last_became_peered":"2024-06-02T22:52:57.838997+0000","last_unstale":"2024-06-02T22:53:00.384109+0000","last_undegraded":"2024-06-02T22:53:00.384109+0000","last_fullsized":"2024-06-02T22:53:00.384109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:21.033797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383192+0000","last_change":"2024-06-02T22:52:58.849477+0000","last_active":"2024-06-02T22:53:00.383192+0000","last_peered":"2024-06-02T22:53:00.383192+0000","last_clean":"2024-06-02T22:53:00.383192+0000","last_became_active":"2024-06-02T22:52:58.849212+0000","last_became_peered":"2024-06-02T22:52:58.849212+0000","last_unstale":"2024-06-02T22:53:00.383192+0000","last_undegraded":"2024-06-02T22:53:00.383192+0000","last_fullsized":"2024-06-02T22:53:00.383192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:01.699783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848409+0000","last_change":"2024-06-02T22:52:57.838722+0000","last_active":"2024-06-02T22:52:59.848409+0000","last_peered":"2024-06-02T22:52:59.848409+0000","last_clean":"2024-06-02T22:52:59.848409+0000","last_became_active":"2024-06-02T22:52:57.838390+0000","last_became_peered":"2024-06-02T22:52:57.838390+0000","last_unstale":"2024-06-02T22:52:59.848409+0000","last_undegraded":"2024-06-02T22:52:59.848409+0000","last_fullsized":"2024-06-02T22:52:59.848409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:49:16.394836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383960+0000","last_change":"2024-06-02T22:52:58.855083+0000","last_active":"2024-06-02T22:53:00.383960+0000","last_peered":"2024-06-02T22:53:00.383960+0000","last_clean":"2024-06-02T22:53:00.383960+0000","last_became_active":"2024-06-02T22:52:58.854727+0000","last_became_peered":"2024-06-02T22:52:58.854727+0000","last_unstale":"2024-06-02T22:53:00.383960+0000","last_undegraded":"2024-06-02T22:53:00.383960+0000","last_fullsized":"2024-06-02T22:53:00.383960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:07:35.445968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.851862+0000","last_change":"2024-06-02T22:52:57.842649+0000","last_active":"2024-06-02T22:52:59.851862+0000","last_peered":"2024-06-02T22:52:59.851862+0000","last_clean":"2024-06-02T22:52:59.851862+0000","last_became_active":"2024-06-02T22:52:57.842193+0000","last_became_peered":"2024-06-02T22:52:57.842193+0000","last_unstale":"2024-06-02T22:52:59.851862+0000","last_undegraded":"2024-06-02T22:52:59.851862+0000","last_fullsized":"2024-06-02T22:52:59.851862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:52:08.929632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.851813+0000","last_change":"2024-06-02T22:52:58.858332+0000","last_active":"2024-06-02T22:52:59.851813+0000","last_peered":"2024-06-02T22:52:59.851813+0000","last_clean":"2024-06-02T22:52:59.851813+0000","last_became_active":"2024-06-02T22:52:58.857252+0000","last_became_peered":"2024-06-02T22:52:58.857252+0000","last_unstale":"2024-06-02T22:52:59.851813+0000","last_undegraded":"2024-06-02T22:52:59.851813+0000","last_fullsized":"2024-06-02T22:52:59.851813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:15:16.363124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383067+0000","last_change":"2024-06-02T22:52:57.839393+0000","last_active":"2024-06-02T22:53:00.383067+0000","last_peered":"2024-06-02T22:53:00.383067+0000","last_clean":"2024-06-02T22:53:00.383067+0000","last_became_active":"2024-06-02T22:52:57.839119+0000","last_became_peered":"2024-06-02T22:52:57.839119+0000","last_unstale":"2024-06-02T22:53:00.383067+0000","last_undegraded":"2024-06-02T22:53:00.383067+0000","last_fullsized":"2024-06-02T22:53:00.383067+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:28.030154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848191+0000","last_change":"2024-06-02T22:52:58.861064+0000","last_active":"2024-06-02T22:52:59.848191+0000","last_peered":"2024-06-02T22:52:59.848191+0000","last_clean":"2024-06-02T22:52:59.848191+0000","last_became_active":"2024-06-02T22:52:58.860752+0000","last_became_peered":"2024-06-02T22:52:58.860752+0000","last_unstale":"2024-06-02T22:52:59.848191+0000","last_undegraded":"2024-06-02T22:52:59.848191+0000","last_fullsized":"2024-06-02T22:52:59.848191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:49:56.745878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383825+0000","last_change":"2024-06-02T22:52:57.843683+0000","last_active":"2024-06-02T22:53:00.383825+0000","last_peered":"2024-06-02T22:53:00.383825+0000","last_clean":"2024-06-02T22:53:00.383825+0000","last_became_active":"2024-06-02T22:52:57.843471+0000","last_became_peered":"2024-06-02T22:52:57.843471+0000","last_unstale":"2024-06-02T22:53:00.383825+0000","last_undegraded":"2024-06-02T22:53:00.383825+0000","last_fullsized":"2024-06-02T22:53:00.383825+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:39:50.581414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.382835+0000","last_change":"2024-06-02T22:52:58.860221+0000","last_active":"2024-06-02T22:53:00.382835+0000","last_peered":"2024-06-02T22:53:00.382835+0000","last_clean":"2024-06-02T22:53:00.382835+0000","last_became_active":"2024-06-02T22:52:58.859902+0000","last_became_peered":"2024-06-02T22:52:58.859902+0000","last_unstale":"2024-06-02T22:53:00.382835+0000","last_undegraded":"2024-06-02T22:53:00.382835+0000","last_fullsized":"2024-06-02T22:53:00.382835+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:15:16.363124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.847829+0000","last_change":"2024-06-02T22:52:57.832404+0000","last_active":"2024-06-02T22:52:59.847829+0000","last_peered":"2024-06-02T22:52:59.847829+0000","last_clean":"2024-06-02T22:52:59.847829+0000","last_became_active":"2024-06-02T22:52:57.832123+0000","last_became_peered":"2024-06-02T22:52:57.832123+0000","last_unstale":"2024-06-02T22:52:59.847829+0000","last_undegraded":"2024-06-02T22:52:59.847829+0000","last_fullsized":"2024-06-02T22:52:59.847829+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:42.149547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.850003+0000","last_change":"2024-06-02T22:52:58.844533+0000","last_active":"2024-06-02T22:52:59.850003+0000","last_peered":"2024-06-02T22:52:59.850003+0000","last_clean":"2024-06-02T22:52:59.850003+0000","last_became_active":"2024-06-02T22:52:58.844255+0000","last_became_peered":"2024-06-02T22:52:58.844255+0000","last_unstale":"2024-06-02T22:52:59.850003+0000","last_undegraded":"2024-06-02T22:52:59.850003+0000","last_fullsized":"2024-06-02T22:52:59.850003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:10:00.196985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383404+0000","last_change":"2024-06-02T22:52:57.834983+0000","last_active":"2024-06-02T22:53:00.383404+0000","last_peered":"2024-06-02T22:53:00.383404+0000","last_clean":"2024-06-02T22:53:00.383404+0000","last_became_active":"2024-06-02T22:52:57.834687+0000","last_became_peered":"2024-06-02T22:52:57.834687+0000","last_unstale":"2024-06-02T22:53:00.383404+0000","last_undegraded":"2024-06-02T22:53:00.383404+0000","last_fullsized":"2024-06-02T22:53:00.383404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:43:49.230922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383332+0000","last_change":"2024-06-02T22:52:58.856327+0000","last_active":"2024-06-02T22:53:00.383332+0000","last_peered":"2024-06-02T22:53:00.383332+0000","last_clean":"2024-06-02T22:53:00.383332+0000","last_became_active":"2024-06-02T22:52:58.855540+0000","last_became_peered":"2024-06-02T22:52:58.855540+0000","last_unstale":"2024-06-02T22:53:00.383332+0000","last_undegraded":"2024-06-02T22:53:00.383332+0000","last_fullsized":"2024-06-02T22:53:00.383332+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:24:46.378503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.852268+0000","last_change":"2024-06-02T22:52:57.842889+0000","last_active":"2024-06-02T22:52:59.852268+0000","last_peered":"2024-06-02T22:52:59.852268+0000","last_clean":"2024-06-02T22:52:59.852268+0000","last_became_active":"2024-06-02T22:52:57.842243+0000","last_became_peered":"2024-06-02T22:52:57.842243+0000","last_unstale":"2024-06-02T22:52:59.852268+0000","last_undegraded":"2024-06-02T22:52:59.852268+0000","last_fullsized":"2024-06-02T22:52:59.852268+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:34:20.580453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383471+0000","last_change":"2024-06-02T22:52:58.856024+0000","last_active":"2024-06-02T22:53:00.383471+0000","last_peered":"2024-06-02T22:53:00.383471+0000","last_clean":"2024-06-02T22:53:00.383471+0000","last_became_active":"2024-06-02T22:52:58.855730+0000","last_became_peered":"2024-06-02T22:52:58.855730+0000","last_unstale":"2024-06-02T22:53:00.383471+0000","last_undegraded":"2024-06-02T22:53:00.383471+0000","last_fullsized":"2024-06-02T22:53:00.383471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:50:34.742148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.852184+0000","last_change":"2024-06-02T22:52:57.842721+0000","last_active":"2024-06-02T22:52:59.852184+0000","last_peered":"2024-06-02T22:52:59.852184+0000","last_clean":"2024-06-02T22:52:59.852184+0000","last_became_active":"2024-06-02T22:52:57.842219+0000","last_became_peered":"2024-06-02T22:52:57.842219+0000","last_unstale":"2024-06-02T22:52:59.852184+0000","last_undegraded":"2024-06-02T22:52:59.852184+0000","last_fullsized":"2024-06-02T22:52:59.852184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:48:21.241601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848487+0000","last_change":"2024-06-02T22:52:58.848779+0000","last_active":"2024-06-02T22:52:59.848487+0000","last_peered":"2024-06-02T22:52:59.848487+0000","last_clean":"2024-06-02T22:52:59.848487+0000","last_became_active":"2024-06-02T22:52:58.848473+0000","last_became_peered":"2024-06-02T22:52:58.848473+0000","last_unstale":"2024-06-02T22:52:59.848487+0000","last_undegraded":"2024-06-02T22:52:59.848487+0000","last_fullsized":"2024-06-02T22:52:59.848487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:43:50.235609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383653+0000","last_change":"2024-06-02T22:52:57.836716+0000","last_active":"2024-06-02T22:53:00.383653+0000","last_peered":"2024-06-02T22:53:00.383653+0000","last_clean":"2024-06-02T22:53:00.383653+0000","last_became_active":"2024-06-02T22:52:57.836176+0000","last_became_peered":"2024-06-02T22:52:57.836176+0000","last_unstale":"2024-06-02T22:53:00.383653+0000","last_undegraded":"2024-06-02T22:53:00.383653+0000","last_fullsized":"2024-06-02T22:53:00.383653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:08:25.750701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.384089+0000","last_change":"2024-06-02T22:52:58.861069+0000","last_active":"2024-06-02T22:53:00.384089+0000","last_peered":"2024-06-02T22:53:00.384089+0000","last_clean":"2024-06-02T22:53:00.384089+0000","last_became_active":"2024-06-02T22:52:58.860777+0000","last_became_peered":"2024-06-02T22:52:58.860777+0000","last_unstale":"2024-06-02T22:53:00.384089+0000","last_undegraded":"2024-06-02T22:53:00.384089+0000","last_fullsized":"2024-06-02T22:53:00.384089+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:16:29.568178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383051+0000","last_change":"2024-06-02T22:52:57.836339+0000","last_active":"2024-06-02T22:53:00.383051+0000","last_peered":"2024-06-02T22:53:00.383051+0000","last_clean":"2024-06-02T22:53:00.383051+0000","last_became_active":"2024-06-02T22:52:57.836060+0000","last_became_peered":"2024-06-02T22:52:57.836060+0000","last_unstale":"2024-06-02T22:53:00.383051+0000","last_undegraded":"2024-06-02T22:53:00.383051+0000","last_fullsized":"2024-06-02T22:53:00.383051+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:28.030154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.382809+0000","last_change":"2024-06-02T22:52:58.851641+0000","last_active":"2024-06-02T22:53:00.382809+0000","last_peered":"2024-06-02T22:53:00.382809+0000","last_clean":"2024-06-02T22:53:00.382809+0000","last_became_active":"2024-06-02T22:52:58.850647+0000","last_became_peered":"2024-06-02T22:52:58.850647+0000","last_unstale":"2024-06-02T22:53:00.382809+0000","last_undegraded":"2024-06-02T22:53:00.382809+0000","last_fullsized":"2024-06-02T22:53:00.382809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:06.422238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383046+0000","last_change":"2024-06-02T22:52:57.842932+0000","last_active":"2024-06-02T22:53:00.383046+0000","last_peered":"2024-06-02T22:53:00.383046+0000","last_clean":"2024-06-02T22:53:00.383046+0000","last_became_active":"2024-06-02T22:52:57.842592+0000","last_became_peered":"2024-06-02T22:52:57.842592+0000","last_unstale":"2024-06-02T22:53:00.383046+0000","last_undegraded":"2024-06-02T22:53:00.383046+0000","last_fullsized":"2024-06-02T22:53:00.383046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:59:17.691271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383217+0000","last_change":"2024-06-02T22:52:58.857782+0000","last_active":"2024-06-02T22:53:00.383217+0000","last_peered":"2024-06-02T22:53:00.383217+0000","last_clean":"2024-06-02T22:53:00.383217+0000","last_became_active":"2024-06-02T22:52:58.855769+0000","last_became_peered":"2024-06-02T22:52:58.855769+0000","last_unstale":"2024-06-02T22:53:00.383217+0000","last_undegraded":"2024-06-02T22:53:00.383217+0000","last_fullsized":"2024-06-02T22:53:00.383217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:06.422238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.847827+0000","last_change":"2024-06-02T22:52:57.836345+0000","last_active":"2024-06-02T22:52:59.847827+0000","last_peered":"2024-06-02T22:52:59.847827+0000","last_clean":"2024-06-02T22:52:59.847827+0000","last_became_active":"2024-06-02T22:52:57.835925+0000","last_became_peered":"2024-06-02T22:52:57.835925+0000","last_unstale":"2024-06-02T22:52:59.847827+0000","last_undegraded":"2024-06-02T22:52:59.847827+0000","last_fullsized":"2024-06-02T22:52:59.847827+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:42.149547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.382840+0000","last_change":"2024-06-02T22:52:58.854096+0000","last_active":"2024-06-02T22:53:00.382840+0000","last_peered":"2024-06-02T22:53:00.382840+0000","last_clean":"2024-06-02T22:53:00.382840+0000","last_became_active":"2024-06-02T22:52:58.853753+0000","last_became_peered":"2024-06-02T22:52:58.853753+0000","last_unstale":"2024-06-02T22:53:00.382840+0000","last_undegraded":"2024-06-02T22:53:00.382840+0000","last_fullsized":"2024-06-02T22:53:00.382840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:24:46.378503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.382985+0000","last_change":"2024-06-02T22:52:57.838859+0000","last_active":"2024-06-02T22:53:00.382985+0000","last_peered":"2024-06-02T22:53:00.382985+0000","last_clean":"2024-06-02T22:53:00.382985+0000","last_became_active":"2024-06-02T22:52:57.838540+0000","last_became_peered":"2024-06-02T22:52:57.838540+0000","last_unstale":"2024-06-02T22:53:00.382985+0000","last_undegraded":"2024-06-02T22:53:00.382985+0000","last_fullsized":"2024-06-02T22:53:00.382985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:24:15.195746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383606+0000","last_change":"2024-06-02T22:52:58.851311+0000","last_active":"2024-06-02T22:53:00.383606+0000","last_peered":"2024-06-02T22:53:00.383606+0000","last_clean":"2024-06-02T22:53:00.383606+0000","last_became_active":"2024-06-02T22:52:58.850754+0000","last_became_peered":"2024-06-02T22:52:58.850754+0000","last_unstale":"2024-06-02T22:53:00.383606+0000","last_undegraded":"2024-06-02T22:53:00.383606+0000","last_fullsized":"2024-06-02T22:53:00.383606+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:15:17.064184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.852231+0000","last_change":"2024-06-02T22:52:57.842956+0000","last_active":"2024-06-02T22:52:59.852231+0000","last_peered":"2024-06-02T22:52:59.852231+0000","last_clean":"2024-06-02T22:52:59.852231+0000","last_became_active":"2024-06-02T22:52:57.842338+0000","last_became_peered":"2024-06-02T22:52:57.842338+0000","last_unstale":"2024-06-02T22:52:59.852231+0000","last_undegraded":"2024-06-02T22:52:59.852231+0000","last_fullsized":"2024-06-02T22:52:59.852231+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:24:15.195746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.852219+0000","last_change":"2024-06-02T22:52:58.861453+0000","last_active":"2024-06-02T22:52:59.852219+0000","last_peered":"2024-06-02T22:52:59.852219+0000","last_clean":"2024-06-02T22:52:59.852219+0000","last_became_active":"2024-06-02T22:52:58.860817+0000","last_became_peered":"2024-06-02T22:52:58.860817+0000","last_unstale":"2024-06-02T22:52:59.852219+0000","last_undegraded":"2024-06-02T22:52:59.852219+0000","last_fullsized":"2024-06-02T22:52:59.852219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:47:21.281752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848694+0000","last_change":"2024-06-02T22:52:57.843423+0000","last_active":"2024-06-02T22:52:59.848694+0000","last_peered":"2024-06-02T22:52:59.848694+0000","last_clean":"2024-06-02T22:52:59.848694+0000","last_became_active":"2024-06-02T22:52:57.843176+0000","last_became_peered":"2024-06-02T22:52:57.843176+0000","last_unstale":"2024-06-02T22:52:59.848694+0000","last_undegraded":"2024-06-02T22:52:59.848694+0000","last_fullsized":"2024-06-02T22:52:59.848694+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:27:37.183727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848634+0000","last_change":"2024-06-02T22:52:58.847006+0000","last_active":"2024-06-02T22:52:59.848634+0000","last_peered":"2024-06-02T22:52:59.848634+0000","last_clean":"2024-06-02T22:52:59.848634+0000","last_became_active":"2024-06-02T22:52:58.846732+0000","last_became_peered":"2024-06-02T22:52:58.846732+0000","last_unstale":"2024-06-02T22:52:59.848634+0000","last_undegraded":"2024-06-02T22:52:59.848634+0000","last_fullsized":"2024-06-02T22:52:59.848634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:06:41.498867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.849856+0000","last_change":"2024-06-02T22:52:57.836556+0000","last_active":"2024-06-02T22:52:59.849856+0000","last_peered":"2024-06-02T22:52:59.849856+0000","last_clean":"2024-06-02T22:52:59.849856+0000","last_became_active":"2024-06-02T22:52:57.836278+0000","last_became_peered":"2024-06-02T22:52:57.836278+0000","last_unstale":"2024-06-02T22:52:59.849856+0000","last_undegraded":"2024-06-02T22:52:59.849856+0000","last_fullsized":"2024-06-02T22:52:59.849856+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:59:41.319385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.849814+0000","last_change":"2024-06-02T22:52:58.848480+0000","last_active":"2024-06-02T22:52:59.849814+0000","last_peered":"2024-06-02T22:52:59.849814+0000","last_clean":"2024-06-02T22:52:59.849814+0000","last_became_active":"2024-06-02T22:52:58.848211+0000","last_became_peered":"2024-06-02T22:52:58.848211+0000","last_unstale":"2024-06-02T22:52:59.849814+0000","last_undegraded":"2024-06-02T22:52:59.849814+0000","last_fullsized":"2024-06-02T22:52:59.849814+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:34:50.146817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383254+0000","last_change":"2024-06-02T22:52:57.839927+0000","last_active":"2024-06-02T22:53:00.383254+0000","last_peered":"2024-06-02T22:53:00.383254+0000","last_clean":"2024-06-02T22:53:00.383254+0000","last_became_active":"2024-06-02T22:52:57.839060+0000","last_became_peered":"2024-06-02T22:52:57.839060+0000","last_unstale":"2024-06-02T22:53:00.383254+0000","last_undegraded":"2024-06-02T22:53:00.383254+0000","last_fullsized":"2024-06-02T22:53:00.383254+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:04:50.886183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383463+0000","last_change":"2024-06-02T22:52:58.858981+0000","last_active":"2024-06-02T22:53:00.383463+0000","last_peered":"2024-06-02T22:53:00.383463+0000","last_clean":"2024-06-02T22:53:00.383463+0000","last_became_active":"2024-06-02T22:52:58.858690+0000","last_became_peered":"2024-06-02T22:52:58.858690+0000","last_unstale":"2024-06-02T22:53:00.383463+0000","last_undegraded":"2024-06-02T22:53:00.383463+0000","last_fullsized":"2024-06-02T22:53:00.383463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:40:36.693324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.849955+0000","last_change":"2024-06-02T22:52:57.835832+0000","last_active":"2024-06-02T22:52:59.849955+0000","last_peered":"2024-06-02T22:52:59.849955+0000","last_clean":"2024-06-02T22:52:59.849955+0000","last_became_active":"2024-06-02T22:52:57.835558+0000","last_became_peered":"2024-06-02T22:52:57.835558+0000","last_unstale":"2024-06-02T22:52:59.849955+0000","last_undegraded":"2024-06-02T22:52:59.849955+0000","last_fullsized":"2024-06-02T22:52:59.849955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:21:09.486245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383700+0000","last_change":"2024-06-02T22:52:58.856954+0000","last_active":"2024-06-02T22:53:00.383700+0000","last_peered":"2024-06-02T22:53:00.383700+0000","last_clean":"2024-06-02T22:53:00.383700+0000","last_became_active":"2024-06-02T22:52:58.856672+0000","last_became_peered":"2024-06-02T22:52:58.856672+0000","last_unstale":"2024-06-02T22:53:00.383700+0000","last_undegraded":"2024-06-02T22:53:00.383700+0000","last_fullsized":"2024-06-02T22:53:00.383700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:45:13.989888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.849693+0000","last_change":"2024-06-02T22:52:57.827388+0000","last_active":"2024-06-02T22:52:59.849693+0000","last_peered":"2024-06-02T22:52:59.849693+0000","last_clean":"2024-06-02T22:52:59.849693+0000","last_became_active":"2024-06-02T22:52:57.827125+0000","last_became_peered":"2024-06-02T22:52:57.827125+0000","last_unstale":"2024-06-02T22:52:59.849693+0000","last_undegraded":"2024-06-02T22:52:59.849693+0000","last_fullsized":"2024-06-02T22:52:59.849693+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:09:41.565856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.851759+0000","last_change":"2024-06-02T22:52:58.860479+0000","last_active":"2024-06-02T22:52:59.851759+0000","last_peered":"2024-06-02T22:52:59.851759+0000","last_clean":"2024-06-02T22:52:59.851759+0000","last_became_active":"2024-06-02T22:52:58.860201+0000","last_became_peered":"2024-06-02T22:52:58.860201+0000","last_unstale":"2024-06-02T22:52:59.851759+0000","last_undegraded":"2024-06-02T22:52:59.851759+0000","last_fullsized":"2024-06-02T22:52:59.851759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:42:54.049240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383207+0000","last_change":"2024-06-02T22:52:57.838864+0000","last_active":"2024-06-02T22:53:00.383207+0000","last_peered":"2024-06-02T22:53:00.383207+0000","last_clean":"2024-06-02T22:53:00.383207+0000","last_became_active":"2024-06-02T22:52:57.838567+0000","last_became_peered":"2024-06-02T22:52:57.838567+0000","last_unstale":"2024-06-02T22:53:00.383207+0000","last_undegraded":"2024-06-02T22:53:00.383207+0000","last_fullsized":"2024-06-02T22:53:00.383207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:08:25.750701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.382996+0000","last_change":"2024-06-02T22:52:58.860201+0000","last_active":"2024-06-02T22:53:00.382996+0000","last_peered":"2024-06-02T22:53:00.382996+0000","last_clean":"2024-06-02T22:53:00.382996+0000","last_became_active":"2024-06-02T22:52:58.859898+0000","last_became_peered":"2024-06-02T22:52:58.859898+0000","last_unstale":"2024-06-02T22:53:00.382996+0000","last_undegraded":"2024-06-02T22:53:00.382996+0000","last_fullsized":"2024-06-02T22:53:00.382996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:40:36.693324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.849558+0000","last_change":"2024-06-02T22:52:57.837729+0000","last_active":"2024-06-02T22:52:59.849558+0000","last_peered":"2024-06-02T22:52:59.849558+0000","last_clean":"2024-06-02T22:52:59.849558+0000","last_became_active":"2024-06-02T22:52:57.836986+0000","last_became_peered":"2024-06-02T22:52:57.836986+0000","last_unstale":"2024-06-02T22:52:59.849558+0000","last_undegraded":"2024-06-02T22:52:59.849558+0000","last_fullsized":"2024-06-02T22:52:59.849558+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:28:20.293109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.382994+0000","last_change":"2024-06-02T22:52:58.860309+0000","last_active":"2024-06-02T22:53:00.382994+0000","last_peered":"2024-06-02T22:53:00.382994+0000","last_clean":"2024-06-02T22:53:00.382994+0000","last_became_active":"2024-06-02T22:52:58.860028+0000","last_became_peered":"2024-06-02T22:52:58.860028+0000","last_unstale":"2024-06-02T22:53:00.382994+0000","last_undegraded":"2024-06-02T22:53:00.382994+0000","last_fullsized":"2024-06-02T22:53:00.382994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:43:50.235609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.852311+0000","last_change":"2024-06-02T22:52:57.842540+0000","last_active":"2024-06-02T22:52:59.852311+0000","last_peered":"2024-06-02T22:52:59.852311+0000","last_clean":"2024-06-02T22:52:59.852311+0000","last_became_active":"2024-06-02T22:52:57.842237+0000","last_became_peered":"2024-06-02T22:52:57.842237+0000","last_unstale":"2024-06-02T22:52:59.852311+0000","last_undegraded":"2024-06-02T22:52:59.852311+0000","last_fullsized":"2024-06-02T22:52:59.852311+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:08:25.750701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383474+0000","last_change":"2024-06-02T22:52:58.856570+0000","last_active":"2024-06-02T22:53:00.383474+0000","last_peered":"2024-06-02T22:53:00.383474+0000","last_clean":"2024-06-02T22:53:00.383474+0000","last_became_active":"2024-06-02T22:52:58.855813+0000","last_became_peered":"2024-06-02T22:52:58.855813+0000","last_unstale":"2024-06-02T22:53:00.383474+0000","last_undegraded":"2024-06-02T22:53:00.383474+0000","last_fullsized":"2024-06-02T22:53:00.383474+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:01.699783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.849718+0000","last_change":"2024-06-02T22:52:57.843761+0000","last_active":"2024-06-02T22:52:59.849718+0000","last_peered":"2024-06-02T22:52:59.849718+0000","last_clean":"2024-06-02T22:52:59.849718+0000","last_became_active":"2024-06-02T22:52:57.843501+0000","last_became_peered":"2024-06-02T22:52:57.843501+0000","last_unstale":"2024-06-02T22:52:59.849718+0000","last_undegraded":"2024-06-02T22:52:59.849718+0000","last_fullsized":"2024-06-02T22:52:59.849718+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:34:39.650711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383752+0000","last_change":"2024-06-02T22:52:58.852031+0000","last_active":"2024-06-02T22:53:00.383752+0000","last_peered":"2024-06-02T22:53:00.383752+0000","last_clean":"2024-06-02T22:53:00.383752+0000","last_became_active":"2024-06-02T22:52:58.851741+0000","last_became_peered":"2024-06-02T22:52:58.851741+0000","last_unstale":"2024-06-02T22:53:00.383752+0000","last_undegraded":"2024-06-02T22:53:00.383752+0000","last_fullsized":"2024-06-02T22:53:00.383752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:53:42.831230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383766+0000","last_change":"2024-06-02T22:52:57.836959+0000","last_active":"2024-06-02T22:53:00.383766+0000","last_peered":"2024-06-02T22:53:00.383766+0000","last_clean":"2024-06-02T22:53:00.383766+0000","last_became_active":"2024-06-02T22:52:57.836702+0000","last_became_peered":"2024-06-02T22:52:57.836702+0000","last_unstale":"2024-06-02T22:53:00.383766+0000","last_undegraded":"2024-06-02T22:53:00.383766+0000","last_fullsized":"2024-06-02T22:53:00.383766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:52:08.929632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.384205+0000","last_change":"2024-06-02T22:52:58.849865+0000","last_active":"2024-06-02T22:53:00.384205+0000","last_peered":"2024-06-02T22:53:00.384205+0000","last_clean":"2024-06-02T22:53:00.384205+0000","last_became_active":"2024-06-02T22:52:58.849033+0000","last_became_peered":"2024-06-02T22:52:58.849033+0000","last_unstale":"2024-06-02T22:53:00.384205+0000","last_undegraded":"2024-06-02T22:53:00.384205+0000","last_fullsized":"2024-06-02T22:53:00.384205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:12:21.211165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383746+0000","last_change":"2024-06-02T22:52:57.837892+0000","last_active":"2024-06-02T22:53:00.383746+0000","last_peered":"2024-06-02T22:53:00.383746+0000","last_clean":"2024-06-02T22:53:00.383746+0000","last_became_active":"2024-06-02T22:52:57.837526+0000","last_became_peered":"2024-06-02T22:52:57.837526+0000","last_unstale":"2024-06-02T22:53:00.383746+0000","last_undegraded":"2024-06-02T22:53:00.383746+0000","last_fullsized":"2024-06-02T22:53:00.383746+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:39:50.581414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383769+0000","last_change":"2024-06-02T22:52:58.850382+0000","last_active":"2024-06-02T22:53:00.383769+0000","last_peered":"2024-06-02T22:53:00.383769+0000","last_clean":"2024-06-02T22:53:00.383769+0000","last_became_active":"2024-06-02T22:52:58.850109+0000","last_became_peered":"2024-06-02T22:52:58.850109+0000","last_unstale":"2024-06-02T22:53:00.383769+0000","last_undegraded":"2024-06-02T22:53:00.383769+0000","last_fullsized":"2024-06-02T22:53:00.383769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:50:34.742148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848217+0000","last_change":"2024-06-02T22:52:57.836830+0000","last_active":"2024-06-02T22:52:59.848217+0000","last_peered":"2024-06-02T22:52:59.848217+0000","last_clean":"2024-06-02T22:52:59.848217+0000","last_became_active":"2024-06-02T22:52:57.836577+0000","last_became_peered":"2024-06-02T22:52:57.836577+0000","last_unstale":"2024-06-02T22:52:59.848217+0000","last_undegraded":"2024-06-02T22:52:59.848217+0000","last_fullsized":"2024-06-02T22:52:59.848217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:09:59.192298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.848068+0000","last_change":"2024-06-02T22:52:58.849298+0000","last_active":"2024-06-02T22:52:59.848068+0000","last_peered":"2024-06-02T22:52:59.848068+0000","last_clean":"2024-06-02T22:52:59.848068+0000","last_became_active":"2024-06-02T22:52:58.848980+0000","last_became_peered":"2024-06-02T22:52:58.848980+0000","last_unstale":"2024-06-02T22:52:59.848068+0000","last_undegraded":"2024-06-02T22:52:59.848068+0000","last_fullsized":"2024-06-02T22:52:59.848068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:08:26.755388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.847954+0000","last_change":"2024-06-02T22:52:57.834955+0000","last_active":"2024-06-02T22:52:59.847954+0000","last_peered":"2024-06-02T22:52:59.847954+0000","last_clean":"2024-06-02T22:52:59.847954+0000","last_became_active":"2024-06-02T22:52:57.834670+0000","last_became_peered":"2024-06-02T22:52:57.834670+0000","last_unstale":"2024-06-02T22:52:59.847954+0000","last_undegraded":"2024-06-02T22:52:59.847954+0000","last_fullsized":"2024-06-02T22:52:59.847954+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:09:59.192298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383518+0000","last_change":"2024-06-02T22:52:58.860092+0000","last_active":"2024-06-02T22:53:00.383518+0000","last_peered":"2024-06-02T22:53:00.383518+0000","last_clean":"2024-06-02T22:53:00.383518+0000","last_became_active":"2024-06-02T22:52:58.859820+0000","last_became_peered":"2024-06-02T22:52:58.859820+0000","last_unstale":"2024-06-02T22:53:00.383518+0000","last_undegraded":"2024-06-02T22:53:00.383518+0000","last_fullsized":"2024-06-02T22:53:00.383518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:15:17.064184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.382626+0000","last_change":"2024-06-02T22:52:57.835212+0000","last_active":"2024-06-02T22:53:00.382626+0000","last_peered":"2024-06-02T22:53:00.382626+0000","last_clean":"2024-06-02T22:53:00.382626+0000","last_became_active":"2024-06-02T22:52:57.834942+0000","last_became_peered":"2024-06-02T22:52:57.834942+0000","last_unstale":"2024-06-02T22:53:00.382626+0000","last_undegraded":"2024-06-02T22:53:00.382626+0000","last_fullsized":"2024-06-02T22:53:00.382626+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:49:55.741191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:52:59.852192+0000","last_change":"2024-06-02T22:52:58.861971+0000","last_active":"2024-06-02T22:52:59.852192+0000","last_peered":"2024-06-02T22:52:59.852192+0000","last_clean":"2024-06-02T22:52:59.852192+0000","last_became_active":"2024-06-02T22:52:58.861690+0000","last_became_peered":"2024-06-02T22:52:58.861690+0000","last_unstale":"2024-06-02T22:52:59.852192+0000","last_undegraded":"2024-06-02T22:52:59.852192+0000","last_fullsized":"2024-06-02T22:52:59.852192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:57.817554+0000","last_clean_scrub_stamp":"2024-06-02T22:52:57.817554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:41:48.757934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383230+0000","last_change":"2024-06-02T22:52:57.839079+0000","last_active":"2024-06-02T22:53:00.383230+0000","last_peered":"2024-06-02T22:53:00.383230+0000","last_clean":"2024-06-02T22:53:00.383230+0000","last_became_active":"2024-06-02T22:52:57.838554+0000","last_became_peered":"2024-06-02T22:52:57.838554+0000","last_unstale":"2024-06-02T22:53:00.383230+0000","last_undegraded":"2024-06-02T22:53:00.383230+0000","last_fullsized":"2024-06-02T22:53:00.383230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:52:56.812867+0000","last_clean_scrub_stamp":"2024-06-02T22:52:56.812867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:49:55.741191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":203,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T22:53:00.383262+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:53:00.383262+0000","last_peered":"2024-06-02T22:53:00.383262+0000","last_clean":"2024-06-02T22:53:00.383262+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:53:00.383262+0000","last_undegraded":"2024-06-02T22:53:00.383262+0000","last_fullsized":"2024-06-02T22:53:00.383262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":782240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":190772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":191836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":190260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":190280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":780592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:53:07.176 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T22:53:07.176 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-02T22:53:07.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.319+0000 7f41a96e1640 1 Processor -- start 2024-06-02T22:53:07.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.319+0000 7f41a96e1640 1 -- start start 2024-06-02T22:53:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.319+0000 7f41a96e1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41a40d49e0 0x7f41a40b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.319+0000 7f41a96e1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a40d4f80 con 0x7f41a4161950 2024-06-02T22:53:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.320+0000 7f41a96e1640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a40b1da0 con 0x7f41a40b1400 2024-06-02T22:53:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.320+0000 7f41a96e1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f41a40b26d0 con 0x7f41a40d49e0 2024-06-02T22:53:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.320+0000 7f419a7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41a40d49e0 0x7f41a40b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.320+0000 7f41a2ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f41a4161950 0x7f41a40b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39424/0 (socket says 172.21.15.82:39424) 2024-06-02T22:53:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.320+0000 7f41a2ffd640 1 -- 172.21.15.82:0/4185307727 learned_addr learned my addr 172.21.15.82:0/4185307727 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.320+0000 7f419a7fc640 1 -- 172.21.15.82:0/4185307727 >> v1:172.21.15.184:6789/0 conn(0x7f41a40b1400 legacy=0x7f41a40b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.320+0000 7f419a7fc640 1 -- 172.21.15.82:0/4185307727 >> v1:172.21.15.82:6789/0 conn(0x7f41a4161950 legacy=0x7f41a40b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.320+0000 7f419a7fc640 1 -- 172.21.15.82:0/4185307727 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a40b2080 con 0x7f41a40d49e0 2024-06-02T22:53:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.320+0000 7f41a27fc640 1 -- 172.21.15.82:0/4185307727 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739017327 0 0) 0x7f41a40d4f80 con 0x7f41a4161950 2024-06-02T22:53:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.321+0000 7f419a7fc640 1 --2- 172.21.15.82:0/4185307727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a40d49e0 0x7f41a40b2ea0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f418c0097a0 tx=0x7f418c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36014f0fc7d6c552 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.321+0000 7f41a27fc640 1 -- 172.21.15.82:0/4185307727 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c037070 con 0x7f41a40d49e0 2024-06-02T22:53:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.321+0000 7f41a27fc640 1 -- 172.21.15.82:0/4185307727 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c02ae50 con 0x7f41a40d49e0 2024-06-02T22:53:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.321+0000 7f41a27fc640 1 -- 172.21.15.82:0/4185307727 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c032660 con 0x7f41a40d49e0 2024-06-02T22:53:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.321+0000 7f41a96e1640 1 -- 172.21.15.82:0/4185307727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a40d49e0 msgr2=0x7f41a40b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.321+0000 7f41a96e1640 1 --2- 172.21.15.82:0/4185307727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a40d49e0 0x7f41a40b2ea0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f418c0097a0 tx=0x7f418c02a140 comp rx=0 tx=0).stop 2024-06-02T22:53:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.321+0000 7f41a96e1640 1 -- 172.21.15.82:0/4185307727 shutdown_connections 2024-06-02T22:53:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.321+0000 7f41a96e1640 1 --2- 172.21.15.82:0/4185307727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a40d49e0 0x7f41a40b2ea0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.321+0000 7f41a96e1640 1 -- 172.21.15.82:0/4185307727 >> 172.21.15.82:0/4185307727 conn(0x7f41a409d400 msgr2=0x7f41a40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.321+0000 7f41a96e1640 1 -- 172.21.15.82:0/4185307727 shutdown_connections 2024-06-02T22:53:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.321+0000 7f41a96e1640 1 -- 172.21.15.82:0/4185307727 wait complete. 2024-06-02T22:53:07.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.322+0000 7f41a96e1640 1 Processor -- start 2024-06-02T22:53:07.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.323+0000 7f41a96e1640 1 -- start start 2024-06-02T22:53:07.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.323+0000 7f41a96e1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41a40b1400 0x7f41a40b7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.323+0000 7f41a96e1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a40d49e0 0x7f41a41f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.323+0000 7f41a96e1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41a4161950 0x7f41a40b9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.323+0000 7f41a96e1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41a40b2b60 con 0x7f41a40d49e0 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.323+0000 7f41a96e1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f41a40b58a0 con 0x7f41a40b1400 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.323+0000 7f41a96e1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f41a40b7c80 con 0x7f41a4161950 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a40d49e0 0x7f41a41f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a40d49e0 0x7f41a41f4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49604/0 (socket says 172.21.15.82:49604) 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419a7fc640 1 -- 172.21.15.82:0/2745302726 learned_addr learned my addr 172.21.15.82:0/2745302726 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f41a2ffd640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41a40b1400 0x7f41a40b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f41a37fe640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41a4161950 0x7f41a40b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419a7fc640 1 -- 172.21.15.82:0/2745302726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41a4161950 msgr2=0x7f41a40b9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419a7fc640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41a4161950 0x7f41a40b9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419a7fc640 1 -- 172.21.15.82:0/2745302726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41a40b1400 msgr2=0x7f41a40b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419a7fc640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41a40b1400 0x7f41a40b7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419a7fc640 1 -- 172.21.15.82:0/2745302726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a40b98f0 con 0x7f41a40d49e0 2024-06-02T22:53:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419a7fc640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a40d49e0 0x7f41a41f4530 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f418c0097a0 tx=0x7f418c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:07.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419bfff640 1 -- 172.21.15.82:0/2745302726 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c037040 con 0x7f41a40d49e0 2024-06-02T22:53:07.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419bfff640 1 -- 172.21.15.82:0/2745302726 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c004030 con 0x7f41a40d49e0 2024-06-02T22:53:07.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f41a96e1640 1 -- 172.21.15.82:0/2745302726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a40b9bd0 con 0x7f41a40d49e0 2024-06-02T22:53:07.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f419bfff640 1 -- 172.21.15.82:0/2745302726 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c006e10 con 0x7f41a40d49e0 2024-06-02T22:53:07.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.324+0000 7f41a96e1640 1 -- 172.21.15.82:0/2745302726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a40b95c0 con 0x7f41a40d49e0 2024-06-02T22:53:07.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.325+0000 7f41a96e1640 1 -- 172.21.15.82:0/2745302726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a40743d0 con 0x7f41a40d49e0 2024-06-02T22:53:07.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.326+0000 7f419bfff640 1 -- 172.21.15.82:0/2745302726 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f418c03d650 con 0x7f41a40d49e0 2024-06-02T22:53:07.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.326+0000 7f419bfff640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f418406be30 0x7f418406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.326+0000 7f419bfff640 1 -- 172.21.15.82:0/2745302726 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f418c0ab7d0 con 0x7f41a40d49e0 2024-06-02T22:53:07.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.326+0000 7f41a2ffd640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f418406be30 0x7f418406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.327+0000 7f41a2ffd640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f418406be30 0x7f418406e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4194000f60 tx=0x7f4194007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:07.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.330+0000 7f419bfff640 1 -- 172.21.15.82:0/2745302726 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f418c042020 con 0x7f41a40d49e0 2024-06-02T22:53:07.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.570+0000 7f41a96e1640 1 -- 172.21.15.82:0/2745302726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f41a40683c0 con 0x7f41a40d49e0 2024-06-02T22:53:07.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.572+0000 7f419bfff640 1 -- 172.21.15.82:0/2745302726 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f418c07a080 con 0x7f41a40d49e0 2024-06-02T22:53:07.572 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-06-02T22:53:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g== 2024-06-02T22:53:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2024-06-02T22:53:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2024-06-02T22:53:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-02T22:53:07.572 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2024-06-02T22:53:07.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 -- 172.21.15.82:0/2745302726 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f418406be30 msgr2=0x7f418406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f418406be30 0x7f418406e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4194000f60 tx=0x7f4194007c00 comp rx=0 tx=0).stop 2024-06-02T22:53:07.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 -- 172.21.15.82:0/2745302726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a40d49e0 msgr2=0x7f41a41f4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a40d49e0 0x7f41a41f4530 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f418c0097a0 tx=0x7f418c0046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 -- 172.21.15.82:0/2745302726 shutdown_connections 2024-06-02T22:53:07.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f418406be30 0x7f418406e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41a4161950 0x7f41a40b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a40d49e0 0x7f41a41f4530 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 --2- 172.21.15.82:0/2745302726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41a40b1400 0x7f41a40b7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 -- 172.21.15.82:0/2745302726 >> 172.21.15.82:0/2745302726 conn(0x7f41a409d400 msgr2=0x7f41a415e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:07.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 -- 172.21.15.82:0/2745302726 shutdown_connections 2024-06-02T22:53:07.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.574+0000 7f41a96e1640 1 -- 172.21.15.82:0/2745302726 wait complete. 2024-06-02T22:53:07.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:53:07.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.685+0000 7f015537e640 1 Processor -- start 2024-06-02T22:53:07.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.685+0000 7f015537e640 1 -- start start 2024-06-02T22:53:07.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f015537e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0150161830 0x7f01500b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f015537e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0150161c10 0x7f01500d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f015537e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01500d0a00 0x7f01500d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f015537e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f01500d13b0 con 0x7f0150161830 2024-06-02T22:53:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f015537e640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f01500d4cf0 con 0x7f0150161c10 2024-06-02T22:53:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f015537e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f01500cebb0 con 0x7f01500d0a00 2024-06-02T22:53:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f014effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0150161830 0x7f01500b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f014effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0150161830 0x7f01500b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49618/0 (socket says 172.21.15.82:49618) 2024-06-02T22:53:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f014effd640 1 -- 172.21.15.82:0/3924985421 learned_addr learned my addr 172.21.15.82:0/3924985421 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f014e7fc640 1 --2- 172.21.15.82:0/3924985421 >> v2:172.21.15.184:3300/0 conn(0x7f0150161c10 0x7f01500d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f014f7fe640 1 --2- 172.21.15.82:0/3924985421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01500d0a00 0x7f01500d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f014effd640 1 -- 172.21.15.82:0/3924985421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01500d0a00 msgr2=0x7f01500d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f014effd640 1 --2- 172.21.15.82:0/3924985421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01500d0a00 0x7f01500d0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f014effd640 1 -- 172.21.15.82:0/3924985421 >> v2:172.21.15.184:3300/0 conn(0x7f0150161c10 msgr2=0x7f01500d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f014effd640 1 --2- 172.21.15.82:0/3924985421 >> v2:172.21.15.184:3300/0 conn(0x7f0150161c10 0x7f01500d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.686+0000 7f014effd640 1 -- 172.21.15.82:0/3924985421 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01500d2fc0 con 0x7f0150161830 2024-06-02T22:53:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.687+0000 7f014effd640 1 --2- 172.21.15.82:0/3924985421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150161830 0x7f01500b5270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f015008e890 tx=0x7f014002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75c00aa34f28c1f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.687+0000 7f014dffb640 1 -- 172.21.15.82:0/3924985421 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140037070 con 0x7f0150161830 2024-06-02T22:53:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.687+0000 7f014dffb640 1 -- 172.21.15.82:0/3924985421 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0140032440 con 0x7f0150161830 2024-06-02T22:53:07.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.687+0000 7f014dffb640 1 -- 172.21.15.82:0/3924985421 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140032810 con 0x7f0150161830 2024-06-02T22:53:07.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.688+0000 7f015537e640 1 -- 172.21.15.82:0/3924985421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150161830 msgr2=0x7f01500b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.688+0000 7f015537e640 1 --2- 172.21.15.82:0/3924985421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150161830 0x7f01500b5270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f015008e890 tx=0x7f014002a1e0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.688+0000 7f015537e640 1 -- 172.21.15.82:0/3924985421 shutdown_connections 2024-06-02T22:53:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.688+0000 7f015537e640 1 --2- 172.21.15.82:0/3924985421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01500d0a00 0x7f01500d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.688+0000 7f015537e640 1 --2- 172.21.15.82:0/3924985421 >> v2:172.21.15.184:3300/0 conn(0x7f0150161c10 0x7f01500d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.688+0000 7f015537e640 1 --2- 172.21.15.82:0/3924985421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150161830 0x7f01500b5270 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.688+0000 7f015537e640 1 -- 172.21.15.82:0/3924985421 >> 172.21.15.82:0/3924985421 conn(0x7f015009d3e0 msgr2=0x7f01500d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.688+0000 7f015537e640 1 -- 172.21.15.82:0/3924985421 shutdown_connections 2024-06-02T22:53:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.688+0000 7f015537e640 1 -- 172.21.15.82:0/3924985421 wait complete. 2024-06-02T22:53:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.689+0000 7f015537e640 1 Processor -- start 2024-06-02T22:53:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.689+0000 7f015537e640 1 -- start start 2024-06-02T22:53:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f015537e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01500d0a00 0x7f0150152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f015537e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0150161830 0x7f01500cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f015537e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150161c10 0x7f01500ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f015537e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01500d2a00 con 0x7f0150161c10 2024-06-02T22:53:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f015537e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f01500d2720 con 0x7f01500d0a00 2024-06-02T22:53:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f015537e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f01500d2ce0 con 0x7f0150161830 2024-06-02T22:53:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f014f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150161c10 0x7f01500ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f014f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150161c10 0x7f01500ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49620/0 (socket says 172.21.15.82:49620) 2024-06-02T22:53:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f014f7fe640 1 -- 172.21.15.82:0/765096636 learned_addr learned my addr 172.21.15.82:0/765096636 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f014effd640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01500d0a00 0x7f0150152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f014e7fc640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0150161830 0x7f01500cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f014f7fe640 1 -- 172.21.15.82:0/765096636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0150161830 msgr2=0x7f01500cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f014f7fe640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0150161830 0x7f01500cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f014f7fe640 1 -- 172.21.15.82:0/765096636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01500d0a00 msgr2=0x7f0150152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f014f7fe640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01500d0a00 0x7f0150152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f014f7fe640 1 -- 172.21.15.82:0/765096636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0150152a60 con 0x7f0150161c10 2024-06-02T22:53:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.690+0000 7f014effd640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01500d0a00 0x7f0150152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.691+0000 7f014f7fe640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150161c10 0x7f01500ccb80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f014800eed0 tx=0x7f014800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:07.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.691+0000 7f01377fe640 1 -- 172.21.15.82:0/765096636 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0148018020 con 0x7f0150161c10 2024-06-02T22:53:07.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.691+0000 7f01377fe640 1 -- 172.21.15.82:0/765096636 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0148014400 con 0x7f0150161c10 2024-06-02T22:53:07.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.691+0000 7f015537e640 1 -- 172.21.15.82:0/765096636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01500cbae0 con 0x7f0150161c10 2024-06-02T22:53:07.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.691+0000 7f01377fe640 1 -- 172.21.15.82:0/765096636 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01480147f0 con 0x7f0150161c10 2024-06-02T22:53:07.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.691+0000 7f015537e640 1 -- 172.21.15.82:0/765096636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01500cc0a0 con 0x7f0150161c10 2024-06-02T22:53:07.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.692+0000 7f015537e640 1 -- 172.21.15.82:0/765096636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0150068430 con 0x7f0150161c10 2024-06-02T22:53:07.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.692+0000 7f01377fe640 1 -- 172.21.15.82:0/765096636 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0148005d10 con 0x7f0150161c10 2024-06-02T22:53:07.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.693+0000 7f01377fe640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f013c06be30 0x7f013c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.693+0000 7f01377fe640 1 -- 172.21.15.82:0/765096636 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f014808b770 con 0x7f0150161c10 2024-06-02T22:53:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.693+0000 7f014effd640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f013c06be30 0x7f013c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.693+0000 7f014effd640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f013c06be30 0x7f013c06e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0140034000 tx=0x7f014002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.697+0000 7f01377fe640 1 -- 172.21.15.82:0/765096636 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0148022070 con 0x7f0150161c10 2024-06-02T22:53:07.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.906+0000 7f015537e640 1 -- 172.21.15.82:0/765096636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01500d1650 con 0x7f0150161c10 2024-06-02T22:53:07.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.906+0000 7f01377fe640 1 -- 172.21.15.82:0/765096636 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5187 (secure 0 0 0) 0x7f0148059f00 con 0x7f0150161c10 2024-06-02T22:53:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:07.906 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2802926071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2802926071},{"type":"v1","addr":"172.21.15.184:6834","nonce":2802926071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4908,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2538474234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2538474234},{"type":"v1","addr":"172.21.15.82:6836","nonce":2538474234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1604488280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1604488280},{"type":"v1","addr":"172.21.15.82:6837","nonce":1604488280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:58.170722+0000","modified":"2024-06-02T22:53:00.841866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3297362995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":3297362995},{"type":"v1","addr":"172.21.15.184:6835","nonce":3297362995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4929,"qdb_cluster":[4929]},"id":2}]} 2024-06-02T22:53:07.907 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2024-06-02T22:53:07.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 -- 172.21.15.82:0/765096636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f013c06be30 msgr2=0x7f013c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f013c06be30 0x7f013c06e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0140034000 tx=0x7f014002e000 comp rx=0 tx=0).stop 2024-06-02T22:53:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 -- 172.21.15.82:0/765096636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150161c10 msgr2=0x7f01500ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150161c10 0x7f01500ccb80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f014800eed0 tx=0x7f014800b480 comp rx=0 tx=0).stop 2024-06-02T22:53:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 -- 172.21.15.82:0/765096636 shutdown_connections 2024-06-02T22:53:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f013c06be30 0x7f013c06e2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150161c10 0x7f01500ccb80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0150161830 0x7f01500cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 --2- 172.21.15.82:0/765096636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01500d0a00 0x7f0150152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 -- 172.21.15.82:0/765096636 >> 172.21.15.82:0/765096636 conn(0x7f015009d3e0 msgr2=0x7f01500c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 -- 172.21.15.82:0/765096636 shutdown_connections 2024-06-02T22:53:07.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:07.908+0000 7f015537e640 1 -- 172.21.15.82:0/765096636 wait complete. 2024-06-02T22:53:08.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T22:52:58.170722+0000', 'modified': '2024-06-02T22:53:00.841866+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4929}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4929': {'gid': 4929, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6835/3297362995', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6833', 'nonce': 3297362995}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 3297362995}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4929, 'qdb_cluster': [4929]} 2024-06-02T22:53:08.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T22:53:08.323 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-06-02T22:53:08.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.425+0000 7fa4fc64d640 1 Processor -- start 2024-06-02T22:53:08.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.425+0000 7fa4fc64d640 1 -- start start 2024-06-02T22:53:08.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.426+0000 7fa4fc64d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4f40ae910 0x7fa4f406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.426+0000 7fa4fc64d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f406d130 con 0x7fa4f40cf360 2024-06-02T22:53:08.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.426+0000 7fa4fc64d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f406d410 con 0x7fa4f406ea20 2024-06-02T22:53:08.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.426+0000 7fa4fc64d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f406ee60 con 0x7fa4f40ae910 2024-06-02T22:53:08.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.426+0000 7fa4fabea640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa4f40cf360 0x7fa4f40acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39438/0 (socket says 172.21.15.82:39438) 2024-06-02T22:53:08.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.426+0000 7fa4fabea640 1 -- 172.21.15.82:0/3339703232 learned_addr learned my addr 172.21.15.82:0/3339703232 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:08.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.426+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4f40ae910 0x7fa4f406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270034303 0 0) 0x7fa4f406d130 con 0x7fa4f40cf360 2024-06-02T22:53:08.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4e0003520 con 0x7fa4f40cf360 2024-06-02T22:53:08.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2112367407 0 0) 0x7fa4e0003520 con 0x7fa4f40cf360 2024-06-02T22:53:08.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4f40ae910 msgr2=0x7fa4f406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4f40ae910 0x7fa4f406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 >> v1:172.21.15.184:6789/0 conn(0x7fa4f406ea20 legacy=0x7fa4f40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f406d6f0 con 0x7fa4f40cf360 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fa4ec0019f0 con 0x7fa4f40cf360 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 >> v1:172.21.15.82:6789/0 conn(0x7fa4f40cf360 legacy=0x7fa4f40acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4f40ae910 0x7fa4e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4e0003f60 0x7fa4e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4e0004d40 0x7fa4e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f406ee60 con 0x7fa4e0003f60 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e000bb50 con 0x7fa4e0004d40 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e000bd50 con 0x7fa4f40ae910 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4e0003f60 0x7fa4e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4f40ae910 0x7fa4e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4fabea640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4e0004d40 0x7fa4e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f9be8640 1 -- 172.21.15.82:0/3339703232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4f40ae910 msgr2=0x7fa4e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4f40ae910 0x7fa4e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f9be8640 1 -- 172.21.15.82:0/3339703232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4e0004d40 msgr2=0x7fa4e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4e0004d40 0x7fa4e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.427+0000 7fa4f9be8640 1 -- 172.21.15.82:0/3339703232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e0003520 con 0x7fa4e0003f60 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.428+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4e0003f60 0x7fa4e0004800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4001750 tx=0x7fa4e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d56d14ae83a339 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.428+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4001370 con 0x7fa4e0003f60 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.428+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e40052d0 con 0x7fa4e0003f60 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.428+0000 7fa4f93e7640 1 -- 172.21.15.82:0/3339703232 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e402abe0 con 0x7fa4e0003f60 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.429+0000 7fa4fc64d640 1 -- 172.21.15.82:0/3339703232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4e0003f60 msgr2=0x7fa4e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.429+0000 7fa4fc64d640 1 --2- 172.21.15.82:0/3339703232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4e0003f60 0x7fa4e0004800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4001750 tx=0x7fa4e0005830 comp rx=0 tx=0).stop 2024-06-02T22:53:08.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.429+0000 7fa4fabea640 1 -- 172.21.15.82:0/3339703232 reap_dead start 2024-06-02T22:53:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.429+0000 7fa4fc64d640 1 -- 172.21.15.82:0/3339703232 shutdown_connections 2024-06-02T22:53:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.429+0000 7fa4fc64d640 1 -- 172.21.15.82:0/3339703232 >> 172.21.15.82:0/3339703232 conn(0x7fa4f40b19f0 msgr2=0x7fa4f40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.429+0000 7fa4fc64d640 1 -- 172.21.15.82:0/3339703232 shutdown_connections 2024-06-02T22:53:08.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.429+0000 7fa4fc64d640 1 -- 172.21.15.82:0/3339703232 wait complete. 2024-06-02T22:53:08.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.430+0000 7fa4fc64d640 1 Processor -- start 2024-06-02T22:53:08.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.430+0000 7fa4fc64d640 1 -- start start 2024-06-02T22:53:08.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4fc64d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4e0003f60 0x7fa4f415de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4fc64d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f4143740 0x7fa4f4145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4fc64d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4f4144ce0 0x7fa4f4145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4fc64d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f406e4e0 con 0x7fa4f4143740 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4fc64d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f40aecf0 con 0x7fa4f4144ce0 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4fc64d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f406e660 con 0x7fa4e0003f60 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4f9be8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f4143740 0x7fa4f4145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4f9be8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f4143740 0x7fa4f4145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49642/0 (socket says 172.21.15.82:49642) 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4f9be8640 1 -- 172.21.15.82:0/680911180 learned_addr learned my addr 172.21.15.82:0/680911180 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4e0003f60 0x7fa4f415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4fabea640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4f4144ce0 0x7fa4f4145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4f9be8640 1 -- 172.21.15.82:0/680911180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4e0003f60 msgr2=0x7fa4f415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4e0003f60 0x7fa4f415de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4f9be8640 1 -- 172.21.15.82:0/680911180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4f4144ce0 msgr2=0x7fa4f4145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4f4144ce0 0x7fa4f4145190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4f9be8640 1 -- 172.21.15.82:0/680911180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f415e3d0 con 0x7fa4f4143740 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f4143740 0x7fa4f4145a40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4008fd0 tx=0x7fa4e4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4eaffd640 1 -- 172.21.15.82:0/680911180 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4040020 con 0x7fa4f4143740 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4eaffd640 1 -- 172.21.15.82:0/680911180 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e4007680 con 0x7fa4f4143740 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4fc64d640 1 -- 172.21.15.82:0/680911180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f4143c40 con 0x7fa4f4143740 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.431+0000 7fa4eaffd640 1 -- 172.21.15.82:0/680911180 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4007a30 con 0x7fa4f4143740 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.432+0000 7fa4fc64d640 1 -- 172.21.15.82:0/680911180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f4144200 con 0x7fa4f4143740 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.433+0000 7fa4eaffd640 1 -- 172.21.15.82:0/680911180 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4e4043020 con 0x7fa4f4143740 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.433+0000 7fa4eaffd640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa4d806be60 0x7fa4d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.434+0000 7fa4eaffd640 1 -- 172.21.15.82:0/680911180 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fa4e40aae20 con 0x7fa4f4143740 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.434+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa4d806be60 0x7fa4d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.434+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa4d806be60 0x7fa4d806e320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009bc0 tx=0x7fa4f0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.434+0000 7fa4ff436740 1 Processor -- start 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.435+0000 7fa4ff436740 1 -- start start 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.435+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a3aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.435+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a0a960 0x55b456a10990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.435+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a56ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.435+0000 7fa4ff436740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b456973740 con 0x55b456a56660 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.435+0000 7fa4ff436740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b456911a80 con 0x55b456a3a700 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.435+0000 7fa4ff436740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x55b45696f700 con 0x55b456a0a960 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4fabea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a56ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4fabea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a56ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49644/0 (socket says 172.21.15.82:49644) 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4fabea640 1 -- 172.21.15.82:0/1547129915 learned_addr learned my addr 172.21.15.82:0/1547129915 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:08.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/1547129915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a0a960 0x55b456a10990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/1547129915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a3aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4fabea640 1 -- 172.21.15.82:0/1547129915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a0a960 msgr2=0x55b456a10990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4fabea640 1 --2- 172.21.15.82:0/1547129915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a0a960 0x55b456a10990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4fabea640 1 -- 172.21.15.82:0/1547129915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 msgr2=0x55b456a3aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4fabea640 1 --2- 172.21.15.82:0/1547129915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a3aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4fabea640 1 -- 172.21.15.82:0/1547129915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45693cfb0 con 0x55b456a56660 2024-06-02T22:53:08.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4fabea640 1 --2- 172.21.15.82:0/1547129915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a56ae0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec004c10 tx=0x7fa4ec001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdef4540f7c5acb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:08.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4d7fff640 1 -- 172.21.15.82:0/1547129915 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec01b070 con 0x55b456a56660 2024-06-02T22:53:08.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4d7fff640 1 -- 172.21.15.82:0/1547129915 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ec015440 con 0x55b456a56660 2024-06-02T22:53:08.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.436+0000 7fa4d7fff640 1 -- 172.21.15.82:0/1547129915 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec0157f0 con 0x55b456a56660 2024-06-02T22:53:08.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.437+0000 7fa4ff436740 1 -- 172.21.15.82:0/1547129915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 msgr2=0x55b456a56ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.437+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1547129915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a56ae0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec004c10 tx=0x7fa4ec001250 comp rx=0 tx=0).stop 2024-06-02T22:53:08.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.437+0000 7fa4ff436740 1 -- 172.21.15.82:0/1547129915 shutdown_connections 2024-06-02T22:53:08.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.437+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1547129915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a56ae0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.437+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1547129915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a0a960 0x55b456a10990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.437+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1547129915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a3aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.437+0000 7fa4ff436740 1 -- 172.21.15.82:0/1547129915 >> 172.21.15.82:0/1547129915 conn(0x55b456a0cbd0 msgr2=0x55b456a55510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.437+0000 7fa4ff436740 1 -- 172.21.15.82:0/1547129915 shutdown_connections 2024-06-02T22:53:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.437+0000 7fa4ff436740 1 -- 172.21.15.82:0/1547129915 wait complete. 2024-06-02T22:53:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.437+0000 7fa4ff436740 1 -- start start 2024-06-02T22:53:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.438+0000 7fa4ff436740 1 Processor -- start 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.438+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a3a700 0x55b456a35d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.438+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a39250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.438+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a39790 0x55b456a4c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.438+0000 7fa4ff436740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b456a10ed0 con 0x55b456a56660 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4ff436740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b4568fcc30 con 0x55b456a39790 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4ff436740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x55b456a10500 con 0x55b456a3a700 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4ff436740 10 client.0 _ll_register_callbacks cb 0x55b45692e7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4f9be8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a39250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4f9be8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a39250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49660/0 (socket says 172.21.15.82:49660) 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4f9be8640 1 -- 172.21.15.82:0/3461554915 learned_addr learned my addr 172.21.15.82:0/3461554915 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a3a700 0x55b456a35d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4fabea640 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a39790 0x55b456a4c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4f9be8640 1 -- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a3a700 msgr2=0x55b456a35d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a3a700 0x55b456a35d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4f9be8640 1 -- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a39790 msgr2=0x55b456a4c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a39790 0x55b456a4c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4f9be8640 1 -- 172.21.15.82:0/3461554915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4566872d0 con 0x55b456a56660 2024-06-02T22:53:08.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a39250 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40754f0 tx=0x7fa4e4078b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0781821b745860 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:08.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-02T22:53:08.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4d57fa640 1 -- 172.21.15.82:0/3461554915 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40a6020 con 0x55b456a56660 2024-06-02T22:53:08.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4d57fa640 1 -- 172.21.15.82:0/3461554915 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fa4e407d0f0 con 0x55b456a56660 2024-06-02T22:53:08.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4ff436740 1 -- 172.21.15.82:0/3461554915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4ec015440 con 0x55b456a56660 2024-06-02T22:53:08.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4d57fa640 1 -- 172.21.15.82:0/3461554915 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fa4e4081c70 con 0x55b456a56660 2024-06-02T22:53:08.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4ff436740 10 client.5127 fetch_fsmap learned FSMap version 16 2024-06-02T22:53:08.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4ff436740 1 -- 172.21.15.82:0/3461554915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55b4567516b0 con 0x55b456a56660 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.439+0000 7fa4d57fa640 1 -- 172.21.15.82:0/3461554915 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ec015440 con 0x55b456a56660 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.440+0000 7fa4d57fa640 1 -- 172.21.15.82:0/3461554915 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7fa4e40052d0 con 0x55b456a56660 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.440+0000 7fa4ff436740 10 client.5127 fetch_fsmap finished waiting for FSMap version 16 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.440+0000 7fa4ff436740 10 client.5127 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.440+0000 7fa4ff436740 20 client.5127 populate_metadata read hostname 'smithi082' 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.440+0000 7fa4ff436740 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:6833/3297362995,v1:172.21.15.184:6835/3297362995] conn(0x55b456a75ca0 0x55b456a78090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.440+0000 7fa4ff436740 4 client.5127 mds_command: new command op to 4929 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.440+0000 7fa4ff436740 1 -- 172.21.15.82:0/3461554915 --> [v2:172.21.15.184:6833/3297362995,v1:172.21.15.184:6835/3297362995] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b456980e70 con 0x55b456a75ca0 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.440+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:6833/3297362995,v1:172.21.15.184:6835/3297362995] conn(0x55b456a75ca0 0x55b456a78090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.440+0000 7fa4d57fa640 10 client.5127 ms_handle_connect on v2:172.21.15.184:6833/3297362995 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.440+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:6833/3297362995,v1:172.21.15.184:6835/3297362995] conn(0x55b456a75ca0 0x55b456a78090 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=805911a2adc8965 server_cookie=81aa782eb6c8d97d in_seq=0 out_seq=0 2024-06-02T22:53:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4d57fa640 1 -- 172.21.15.82:0/3461554915 <== mds.0 v2:172.21.15.184:6833/3297362995 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b456980e70 con 0x55b456a75ca0 2024-06-02T22:53:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4d57fa640 10 client.5127 handle_command_reply: tid=0 2024-06-02T22:53:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4ff436740 1 client.5127 shutdown 2024-06-02T22:53:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4ff436740 1 -- 172.21.15.82:0/3461554915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 msgr2=0x55b456a39250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4ff436740 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a39250 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40754f0 tx=0x7fa4e4078b00 comp rx=0 tx=0).stop 2024-06-02T22:53:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4ff436740 1 -- 172.21.15.82:0/3461554915 shutdown_connections 2024-06-02T22:53:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4ff436740 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a39790 0x55b456a4c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4ff436740 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:6833/3297362995,v1:172.21.15.184:6835/3297362995] conn(0x55b456a75ca0 0x55b456a78090 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4ff436740 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a39250 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4ff436740 1 --2- 172.21.15.82:0/3461554915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a3a700 0x55b456a35d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4d57fa640 0 client.5127 ms_handle_reset on v2:172.21.15.184:6833/3297362995 2024-06-02T22:53:08.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4ff436740 1 -- 172.21.15.82:0/3461554915 >> 172.21.15.82:0/3461554915 conn(0x55b456a0a960 msgr2=0x55b456a55290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:08.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4ff436740 1 -- 172.21.15.82:0/3461554915 shutdown_connections 2024-06-02T22:53:08.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.441+0000 7fa4ff436740 1 -- 172.21.15.82:0/3461554915 wait complete. 2024-06-02T22:53:08.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.442+0000 7fa4ff436740 20 client.5127 trim_cache size 0 max 16384 2024-06-02T22:53:08.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.460+0000 7fa4ff436740 1 Processor -- start 2024-06-02T22:53:08.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.460+0000 7fa4ff436740 1 -- start start 2024-06-02T22:53:08.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a39790 0x55b456a0b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a37300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a0f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4ff436740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f415b510 con 0x55b456a56660 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4ff436740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f40b0df0 con 0x55b456a3a700 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4ff436740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f40b1440 con 0x55b456a39790 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4fabea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a0f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4fabea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a0f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49662/0 (socket says 172.21.15.82:49662) 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4fabea640 1 -- 172.21.15.82:0/1716984651 learned_addr learned my addr 172.21.15.82:0/1716984651 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4fabea640 1 -- 172.21.15.82:0/1716984651 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a39790 msgr2=0x55b456a0b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4fabea640 1 --2- 172.21.15.82:0/1716984651 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a39790 0x55b456a0b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4fabea640 1 -- 172.21.15.82:0/1716984651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 msgr2=0x55b456a37300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4fabea640 1 --2- 172.21.15.82:0/1716984651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a37300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4fabea640 1 -- 172.21.15.82:0/1716984651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b456a11300 con 0x55b456a56660 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4fabea640 1 --2- 172.21.15.82:0/1716984651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a0f7a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec000f80 tx=0x7fa4ec00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f51322f1a28389a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4d77fe640 1 -- 172.21.15.82:0/1716984651 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec028070 con 0x55b456a56660 2024-06-02T22:53:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4d77fe640 1 -- 172.21.15.82:0/1716984651 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ec0174e0 con 0x55b456a56660 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.461+0000 7fa4d77fe640 1 -- 172.21.15.82:0/1716984651 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec01b040 con 0x55b456a56660 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.462+0000 7fa4ff436740 1 -- 172.21.15.82:0/1716984651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 msgr2=0x55b456a0f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.462+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1716984651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a0f7a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec000f80 tx=0x7fa4ec00f000 comp rx=0 tx=0).stop 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.462+0000 7fa4ff436740 1 -- 172.21.15.82:0/1716984651 shutdown_connections 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.462+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1716984651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a56660 0x55b456a0f7a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.462+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1716984651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a37300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.462+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1716984651 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a39790 0x55b456a0b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.462+0000 7fa4ff436740 1 -- 172.21.15.82:0/1716984651 >> 172.21.15.82:0/1716984651 conn(0x55b456a0a960 msgr2=0x55b456a3b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.462+0000 7fa4ff436740 1 -- 172.21.15.82:0/1716984651 shutdown_connections 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.462+0000 7fa4ff436740 1 -- 172.21.15.82:0/1716984651 wait complete. 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.462+0000 7fa4ff436740 1 -- start start 2024-06-02T22:53:08.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.463+0000 7fa4ff436740 1 Processor -- start 2024-06-02T22:53:08.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.463+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a39790 0x55b456a386d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.463+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a4b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.463+0000 7fa4ff436740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a56660 0x55b456a0e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.463+0000 7fa4ff436740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b456a10ed0 con 0x55b456a39790 2024-06-02T22:53:08.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.463+0000 7fa4ff436740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b4568fcc30 con 0x55b456a3a700 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.463+0000 7fa4ff436740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x55b456a23210 con 0x55b456a56660 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.463+0000 7fa4ff436740 10 client.0 _ll_register_callbacks cb 0x7fa4e4078cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4fa3e9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a39790 0x55b456a386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4fa3e9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a39790 0x55b456a386d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49668/0 (socket says 172.21.15.82:49668) 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4fa3e9640 1 -- 172.21.15.82:0/1861285203 learned_addr learned my addr 172.21.15.82:0/1861285203 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4fabea640 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a56660 0x55b456a0e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a4b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4fa3e9640 1 -- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a56660 msgr2=0x55b456a0e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a56660 0x55b456a0e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4fa3e9640 1 -- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 msgr2=0x55b456a4b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a4b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4fa3e9640 1 -- 172.21.15.82:0/1861285203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b456a09ba0 con 0x55b456a39790 2024-06-02T22:53:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a4b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4fa3e9640 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a39790 0x55b456a386d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55b456a236a0 tx=0x7fa4f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904a9365defe2d09 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4d57fa640 1 -- 172.21.15.82:0/1861285203 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f001b070 con 0x55b456a39790 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4d57fa640 1 -- 172.21.15.82:0/1861285203 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fa4f000f040 con 0x55b456a39790 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4ff436740 1 -- 172.21.15.82:0/1861285203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4ec0174e0 con 0x55b456a39790 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4d57fa640 1 -- 172.21.15.82:0/1861285203 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fa4f003f050 con 0x55b456a39790 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4ff436740 10 client.5133 fetch_fsmap learned FSMap version 16 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4ff436740 1 -- 172.21.15.82:0/1861285203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55b456a38c10 con 0x55b456a39790 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.464+0000 7fa4d57fa640 1 -- 172.21.15.82:0/1861285203 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ec0174e0 con 0x55b456a39790 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4d57fa640 1 -- 172.21.15.82:0/1861285203 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7fa4f0042020 con 0x55b456a39790 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4ff436740 10 client.5133 fetch_fsmap finished waiting for FSMap version 16 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4ff436740 10 client.5133 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T22:53:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4ff436740 20 client.5133 populate_metadata read hostname 'smithi082' 2024-06-02T22:53:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:6833/3297362995,v1:172.21.15.184:6835/3297362995] conn(0x55b456adfbb0 0x55b456adff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4ff436740 4 client.5133 mds_command: new command op to 4929 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:53:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4ff436740 1 -- 172.21.15.82:0/1861285203 --> [v2:172.21.15.184:6833/3297362995,v1:172.21.15.184:6835/3297362995] -- command(tid 0: {"prefix": "status"}) -- 0x55b45697b1c0 con 0x55b456adfbb0 2024-06-02T22:53:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:6833/3297362995,v1:172.21.15.184:6835/3297362995] conn(0x55b456adfbb0 0x55b456adff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4d57fa640 10 client.5133 ms_handle_connect on v2:172.21.15.184:6833/3297362995 2024-06-02T22:53:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4f9be8640 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:6833/3297362995,v1:172.21.15.184:6835/3297362995] conn(0x55b456adfbb0 0x55b456adff90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28d0562ce8529d2c server_cookie=bff965531cf3d6bf in_seq=0 out_seq=0 2024-06-02T22:53:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4d57fa640 1 -- 172.21.15.82:0/1861285203 <== mds.0 v2:172.21.15.184:6833/3297362995 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b45697b1c0 con 0x55b456adfbb0 2024-06-02T22:53:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4d57fa640 10 client.5133 handle_command_reply: tid=0 2024-06-02T22:53:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4ff436740 1 client.5133 shutdown 2024-06-02T22:53:08.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4ff436740 1 -- 172.21.15.82:0/1861285203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a39790 msgr2=0x55b456a386d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.465+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a39790 0x55b456a386d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55b456a236a0 tx=0x7fa4f0004730 comp rx=0 tx=0).stop 2024-06-02T22:53:08.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4ff436740 1 -- 172.21.15.82:0/1861285203 shutdown_connections 2024-06-02T22:53:08.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55b456a56660 0x55b456a0e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b456a3a700 0x55b456a4b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.184:6833/3297362995,v1:172.21.15.184:6835/3297362995] conn(0x55b456adfbb0 0x55b456adff90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4ff436740 1 --2- 172.21.15.82:0/1861285203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b456a39790 0x55b456a386d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4d57fa640 0 client.5133 ms_handle_reset on v2:172.21.15.184:6833/3297362995 2024-06-02T22:53:08.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4ff436740 1 -- 172.21.15.82:0/1861285203 >> 172.21.15.82:0/1861285203 conn(0x55b456a0a960 msgr2=0x55b456a37170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:08.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4ff436740 1 -- 172.21.15.82:0/1861285203 shutdown_connections 2024-06-02T22:53:08.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4ff436740 1 -- 172.21.15.82:0/1861285203 wait complete. 2024-06-02T22:53:08.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4ff436740 20 client.5133 trim_cache size 0 max 16384 2024-06-02T22:53:08.473 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:53:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "6f85057c-cf41-4021-ae61-b6064b1147d0", 2024-06-02T22:53:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-06-02T22:53:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4929, 2024-06-02T22:53:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-06-02T22:53:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-06-02T22:53:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-06-02T22:53:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 9.6215045640000003, 2024-06-02T22:53:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 16, 2024-06-02T22:53:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 38, 2024-06-02T22:53:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 38, 2024-06-02T22:53:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 16.524957045000001 2024-06-02T22:53:08.474 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:53:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 -- 172.21.15.82:0/680911180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa4d806be60 msgr2=0x7fa4d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa4d806be60 0x7fa4d806e320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009bc0 tx=0x7fa4f0009190 comp rx=0 tx=0).stop 2024-06-02T22:53:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 -- 172.21.15.82:0/680911180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f4143740 msgr2=0x7fa4f4145a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f4143740 0x7fa4f4145a40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4008fd0 tx=0x7fa4e4001120 comp rx=0 tx=0).stop 2024-06-02T22:53:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 -- 172.21.15.82:0/680911180 shutdown_connections 2024-06-02T22:53:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa4d806be60 0x7fa4d806e320 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4f4144ce0 0x7fa4f4145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f4143740 0x7fa4f4145a40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 --2- 172.21.15.82:0/680911180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4e0003f60 0x7fa4f415de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 -- 172.21.15.82:0/680911180 >> 172.21.15.82:0/680911180 conn(0x7fa4f40b19f0 msgr2=0x7fa4f40727f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 -- 172.21.15.82:0/680911180 shutdown_connections 2024-06-02T22:53:08.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.466+0000 7fa4fc64d640 1 -- 172.21.15.82:0/680911180 wait complete. 2024-06-02T22:53:08.477 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T22:53:08.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.576+0000 7fca877fb640 1 Processor -- start 2024-06-02T22:53:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.577+0000 7fca877fb640 1 -- start start 2024-06-02T22:53:08.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.577+0000 7fca877fb640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fca8006e050 0x7fca800cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.577+0000 7fca877fb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca800d12d0 con 0x7fca8009aa10 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.577+0000 7fca877fb640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca800cc5a0 con 0x7fca800703f0 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.577+0000 7fca877fb640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fca800d1d30 con 0x7fca8006e050 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca84d96640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fca8009aa10 0x7fca800cd360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39442/0 (socket says 172.21.15.82:39442) 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca84d96640 1 -- 172.21.15.82:0/1974137289 learned_addr learned my addr 172.21.15.82:0/1974137289 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca85597640 1 --2- 172.21.15.82:0/1974137289 >> v2:172.21.15.184:3300/0 conn(0x7fca8006e050 0x7fca800cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594954735 0 0) 0x7fca800d12d0 con 0x7fca8009aa10 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca6c003520 con 0x7fca8009aa10 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2656690136 0 0) 0x7fca6c003520 con 0x7fca8009aa10 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 >> v2:172.21.15.184:3300/0 conn(0x7fca8006e050 msgr2=0x7fca800cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 --2- 172.21.15.82:0/1974137289 >> v2:172.21.15.184:3300/0 conn(0x7fca8006e050 0x7fca800cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 >> v1:172.21.15.184:6789/0 conn(0x7fca800703f0 legacy=0x7fca800cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca800cc880 con 0x7fca8009aa10 2024-06-02T22:53:08.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fca70001670 con 0x7fca8009aa10 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 >> v1:172.21.15.82:6789/0 conn(0x7fca8009aa10 legacy=0x7fca800cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 --2- 172.21.15.82:0/1974137289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c0039b0 0x7fca6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 --2- 172.21.15.82:0/1974137289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca6c004800 0x7fca6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 --2- 172.21.15.82:0/1974137289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca6c0051c0 0x7fca6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca800d1d30 con 0x7fca6c0039b0 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c00c060 con 0x7fca6c0051c0 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fca6c00c260 con 0x7fca6c004800 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca85597640 1 --2- 172.21.15.82:0/1974137289 >> v2:172.21.15.184:3300/0 conn(0x7fca8006e050 0x7fca800cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca85597640 1 --2- 172.21.15.82:0/1974137289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c0039b0 0x7fca6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca84d96640 1 --2- 172.21.15.82:0/1974137289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca6c004800 0x7fca6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.578+0000 7fca85d98640 1 --2- 172.21.15.82:0/1974137289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca6c0051c0 0x7fca6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.579+0000 7fca85597640 1 -- 172.21.15.82:0/1974137289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca6c004800 msgr2=0x7fca6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.579+0000 7fca85597640 1 --2- 172.21.15.82:0/1974137289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca6c004800 0x7fca6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.579+0000 7fca85597640 1 -- 172.21.15.82:0/1974137289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca6c0051c0 msgr2=0x7fca6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.579+0000 7fca85597640 1 --2- 172.21.15.82:0/1974137289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca6c0051c0 0x7fca6c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.579+0000 7fca85597640 1 -- 172.21.15.82:0/1974137289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6c003520 con 0x7fca6c0039b0 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.579+0000 7fca85d98640 1 -- 172.21.15.82:0/1974137289 reap_dead start 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.579+0000 7fca85597640 1 --2- 172.21.15.82:0/1974137289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c0039b0 0x7fca6c003dd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009c70 tx=0x7fca6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90ec5048d190bd0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.579+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c009840 con 0x7fca6c0039b0 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.579+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7c004020 con 0x7fca6c0039b0 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.579+0000 7fca77fff640 1 -- 172.21.15.82:0/1974137289 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0043d0 con 0x7fca6c0039b0 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.580+0000 7fca877fb640 1 -- 172.21.15.82:0/1974137289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c0039b0 msgr2=0x7fca6c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.580+0000 7fca877fb640 1 --2- 172.21.15.82:0/1974137289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c0039b0 0x7fca6c003dd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009c70 tx=0x7fca6c005830 comp rx=0 tx=0).stop 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.580+0000 7fca877fb640 1 -- 172.21.15.82:0/1974137289 shutdown_connections 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.580+0000 7fca877fb640 1 --2- 172.21.15.82:0/1974137289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca6c0039b0 0x7fca6c003dd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.580+0000 7fca877fb640 1 -- 172.21.15.82:0/1974137289 >> 172.21.15.82:0/1974137289 conn(0x7fca800d1eb0 msgr2=0x7fca800d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.580+0000 7fca877fb640 1 -- 172.21.15.82:0/1974137289 shutdown_connections 2024-06-02T22:53:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.580+0000 7fca877fb640 1 -- 172.21.15.82:0/1974137289 wait complete. 2024-06-02T22:53:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.581+0000 7fca877fb640 1 Processor -- start 2024-06-02T22:53:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.581+0000 7fca877fb640 1 -- start start 2024-06-02T22:53:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca877fb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca6c0039b0 0x7fca800b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca877fb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca801e0710 0x7fca801e0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca877fb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800b6f40 0x7fca800b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca877fb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca8006e430 con 0x7fca801e0710 2024-06-02T22:53:08.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca877fb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fca800cce40 con 0x7fca6c0039b0 2024-06-02T22:53:08.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca877fb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fca800d0f30 con 0x7fca800b6f40 2024-06-02T22:53:08.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca84d96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca801e0710 0x7fca801e0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca84d96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca801e0710 0x7fca801e0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49678/0 (socket says 172.21.15.82:49678) 2024-06-02T22:53:08.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca84d96640 1 -- 172.21.15.82:0/1623543171 learned_addr learned my addr 172.21.15.82:0/1623543171 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:08.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca84d96640 1 -- 172.21.15.82:0/1623543171 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800b6f40 msgr2=0x7fca800b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca85d98640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800b6f40 0x7fca800b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca85597640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca6c0039b0 0x7fca800b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca84d96640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800b6f40 0x7fca800b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca84d96640 1 -- 172.21.15.82:0/1623543171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca6c0039b0 msgr2=0x7fca800b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca84d96640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca6c0039b0 0x7fca800b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca84d96640 1 -- 172.21.15.82:0/1623543171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca801e13b0 con 0x7fca801e0710 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca85d98640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800b6f40 0x7fca800b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca85597640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca6c0039b0 0x7fca800b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.582+0000 7fca84d96640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca801e0710 0x7fca801e0b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fca70007290 tx=0x7fca70007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.583+0000 7fca75ffb640 1 -- 172.21.15.82:0/1623543171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7000f8e0 con 0x7fca801e0710 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.583+0000 7fca75ffb640 1 -- 172.21.15.82:0/1623543171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca70018070 con 0x7fca801e0710 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.583+0000 7fca75ffb640 1 -- 172.21.15.82:0/1623543171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7000fcc0 con 0x7fca801e0710 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.583+0000 7fca877fb640 1 -- 172.21.15.82:0/1623543171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca801e1690 con 0x7fca801e0710 2024-06-02T22:53:08.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.583+0000 7fca877fb640 1 -- 172.21.15.82:0/1623543171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca801e1fb0 con 0x7fca801e0710 2024-06-02T22:53:08.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.584+0000 7fca877fb640 1 -- 172.21.15.82:0/1623543171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca801e21b0 con 0x7fca801e0710 2024-06-02T22:53:08.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.584+0000 7fca75ffb640 1 -- 172.21.15.82:0/1623543171 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca7001d460 con 0x7fca801e0710 2024-06-02T22:53:08.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.584+0000 7fca75ffb640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca6406be30 0x7fca6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:08.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.585+0000 7fca75ffb640 1 -- 172.21.15.82:0/1623543171 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fca7008b010 con 0x7fca801e0710 2024-06-02T22:53:08.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.585+0000 7fca85597640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca6406be30 0x7fca6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:08.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.585+0000 7fca85597640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca6406be30 0x7fca6406e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fca7c032000 tx=0x7fca7c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:08.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.589+0000 7fca75ffb640 1 -- 172.21.15.82:0/1623543171 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fca801e21b0 con 0x7fca801e0710 2024-06-02T22:53:08.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.798+0000 7fca877fb640 1 -- 172.21.15.82:0/1623543171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fca80068430 con 0x7fca801e0710 2024-06-02T22:53:08.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.799+0000 7fca75ffb640 1 -- 172.21.15.82:0/1623543171 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7fca7000fe60 con 0x7fca801e0710 2024-06-02T22:53:08.799 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T22:53:08.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 -- 172.21.15.82:0/1623543171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca6406be30 msgr2=0x7fca6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca6406be30 0x7fca6406e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fca7c032000 tx=0x7fca7c008030 comp rx=0 tx=0).stop 2024-06-02T22:53:08.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 -- 172.21.15.82:0/1623543171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca801e0710 msgr2=0x7fca801e0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:08.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca801e0710 0x7fca801e0b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fca70007290 tx=0x7fca70007750 comp rx=0 tx=0).stop 2024-06-02T22:53:08.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 -- 172.21.15.82:0/1623543171 shutdown_connections 2024-06-02T22:53:08.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fca6406be30 0x7fca6406e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800b6f40 0x7fca800b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca801e0710 0x7fca801e0b90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 --2- 172.21.15.82:0/1623543171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca6c0039b0 0x7fca800b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:08.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 -- 172.21.15.82:0/1623543171 >> 172.21.15.82:0/1623543171 conn(0x7fca800d1eb0 msgr2=0x7fca8006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:08.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 -- 172.21.15.82:0/1623543171 shutdown_connections 2024-06-02T22:53:08.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:08.801+0000 7fca877fb640 1 -- 172.21.15.82:0/1623543171 wait complete. 2024-06-02T22:53:08.811 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T22:53:08.812 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:53:08.812 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-06-02T22:53:08.812 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T22:53:08.812 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:08.812 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T22:53:08.812 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:53:08.812 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:53:08.812 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:08.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:08.812 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-06-02T22:53:08.828 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:53:08.828 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:53:08.829 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:53:08.829 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:08.829 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-02T22:53:08.829 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:08.829 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:08.829 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:08.829 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-06-02T22:53:08.829 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:08.829 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:08.830 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-06-02T22:53:08.830 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:08.830 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:08.830 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:53:08.830 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:08.830 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T22:53:08.830 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42709sec preferred_lft 42709sec 2024-06-02T22:53:08.830 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-06-02T22:53:08.830 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:08.830 INFO:teuthology.orchestra.run.smithi082.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:53:08.831 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:08.831 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T22:53:08.831 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:08.831 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::6847:90ff:fe09:5afd/64 scope link 2024-06-02T22:53:08.831 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:08.831 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:53:08.831 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 7e:10:3a:74:07:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:08.831 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::7c10:3aff:fe74:7cf/64 scope link 2024-06-02T22:53:08.831 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:08.831 INFO:teuthology.orchestra.run.smithi082.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:53:08.831 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:08.832 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::103e:51ff:fe43:acf3/64 scope link 2024-06-02T22:53:08.832 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:08.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:08.832 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:53:08.892 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-06-02T22:53:08.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:08.893 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-06-02T22:53:08.950 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-06-02T22:53:08.950 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:53:08.951 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T22:53:08.951 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T22:53:08.951 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:53:08.951 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:53:08.951 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:53:08.951 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T22:53:08.951 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T22:53:08.951 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T22:53:08.951 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:53:09.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:53:09.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:53:09.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:09.146 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-02T22:53:09.170 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T22:53:09.170 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T22:53:09.170 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:09.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:09.171 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-06-02T22:53:09.242 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-02T22:53:09.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:53:09.243 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:09.305 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:09.305 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:53:09.305 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:09.371 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:53:09.451 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:53:09.514 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:53:09.514 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:53:09.514 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:53:09.514 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:53:09.514 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:53:09.515 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:53:09.515 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:53:09.515 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:53:09.515 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:53:09.515 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:53:09.515 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:53:09.515 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:53:09.516 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:53:09.516 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:53:09.516 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:53:09.516 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:53:09.516 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:53:09.516 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:53:09.516 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:53:09.517 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:53:09.517 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:53:09.517 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:53:09.517 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:53:09.517 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:53:09.517 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:53:09.517 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:53:09.517 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:53:09.518 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:53:09.518 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:53:09.518 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:53:09.518 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:09.518 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:09.518 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:09.518 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:09.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:09.519 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:53:09.576 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T22:53:09.576 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-02T22:53:09.623 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:53:09.648 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:53:09.704 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2024-06-02T22:53:09.704+0000 7fca478ec480 -1 init, newargv = 0x55f353c8b5d0 newargc=15 2024-06-02T22:53:09.704 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[50918]: starting ceph client 2024-06-02T22:53:09.707 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:53:09.707 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:53:09.707 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:53:09.707 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:53:09.707 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:53:09.707 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:53:09.708 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:09.709 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:09.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:09.710 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:53:09.710 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[50918]: starting fuse 2024-06-02T22:53:09.725 INFO:teuthology.orchestra.run.smithi082.stdout:40 2024-06-02T22:53:09.725 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T22:53:09.725 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:53:09.725 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-06-02T22:53:09.725 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:09.726 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-06-02T22:53:09.727 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:53:09.727 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:53:09.727 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:53:09.727 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-06-02T22:53:09.727 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-06-02T22:53:09.727 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-06-02T22:53:09.727 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:53:09.727 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:09.727 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2024-06-02T22:53:09.727 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-06-02T22:53:09.853 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.50918.asok 2024-06-02T22:53:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:53:09.864 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50918.asok 2024-06-02T22:53:09.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:09.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50918.asok status 2024-06-02T22:53:10.003 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:53:10.003 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-06-02T22:53:10.003 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:53:10.003 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "50918", 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5148, 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-06-02T22:53:10.004 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 5148 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 388484004 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 388484004 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.5148 192.168.0.1:0/388484004", 2024-06-02T22:53:10.005 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/388484004", 2024-06-02T22:53:10.006 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-06-02T22:53:10.006 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 16, 2024-06-02T22:53:10.006 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 38, 2024-06-02T22:53:10.006 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:53:10.006 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-06-02T22:53:10.006 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-06-02T22:53:10.006 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:53:10.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:10.015 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-06-02T22:53:10.015 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:10.039 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-06-02T22:53:10.040 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:10.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:10.041 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:10.115 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2024-06-02T22:53:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.260+0000 7f4e0f4d4640 1 Processor -- start 2024-06-02T22:53:10.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.260+0000 7f4e0f4d4640 1 -- start start 2024-06-02T22:53:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.261+0000 7f4e0f4d4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4e08155590 0x7f4e0815b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.261+0000 7f4e0f4d4640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4e080cf370 0x7f4e080ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.261+0000 7f4e0f4d4640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e080acd40 con 0x7f4e0815b9a0 2024-06-02T22:53:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.261+0000 7f4e0f4d4640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0815bfe0 con 0x7f4e08155590 2024-06-02T22:53:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.261+0000 7f4e0f4d4640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0815c2c0 con 0x7f4e080cf370 2024-06-02T22:53:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.261+0000 7f4e0d270640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4e08155590 0x7f4e0815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.261+0000 7f4e0d270640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4e08155590 0x7f4e0815b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49686/0 (socket says 172.21.15.82:49686) 2024-06-02T22:53:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.261+0000 7f4e0d270640 1 -- 172.21.15.82:0/3894251746 learned_addr learned my addr 172.21.15.82:0/3894251746 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.261+0000 7f4e0da71640 1 --2- 172.21.15.82:0/3894251746 >> v2:172.21.15.184:3300/0 conn(0x7f4e080cf370 0x7f4e080ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.261+0000 7f4e0d270640 1 -- 172.21.15.82:0/3894251746 >> v2:172.21.15.184:3300/0 conn(0x7f4e080cf370 msgr2=0x7f4e080ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.261+0000 7f4e0d270640 1 --2- 172.21.15.82:0/3894251746 >> v2:172.21.15.184:3300/0 conn(0x7f4e080cf370 0x7f4e080ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.262+0000 7f4e0d270640 1 -- 172.21.15.82:0/3894251746 >> v1:172.21.15.184:6789/0 conn(0x7f4e0815b9a0 legacy=0x7f4e080cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.262+0000 7f4e0d270640 1 -- 172.21.15.82:0/3894251746 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e080ad000 con 0x7f4e08155590 2024-06-02T22:53:10.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.262+0000 7f4e0d270640 1 --2- 172.21.15.82:0/3894251746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e08155590 0x7f4e0815b460 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4e08070ce0 tx=0x7f4e0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9f998b5db72ef9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:10.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.262+0000 7f4dfffff640 1 -- 172.21.15.82:0/3894251746 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04037070 con 0x7f4e08155590 2024-06-02T22:53:10.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.262+0000 7f4dfffff640 1 -- 172.21.15.82:0/3894251746 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e04032440 con 0x7f4e08155590 2024-06-02T22:53:10.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.262+0000 7f4dfffff640 1 -- 172.21.15.82:0/3894251746 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04032810 con 0x7f4e08155590 2024-06-02T22:53:10.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.263+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/3894251746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e08155590 msgr2=0x7f4e0815b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:10.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.263+0000 7f4e0f4d4640 1 --2- 172.21.15.82:0/3894251746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e08155590 0x7f4e0815b460 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4e08070ce0 tx=0x7f4e0402a270 comp rx=0 tx=0).stop 2024-06-02T22:53:10.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.263+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/3894251746 shutdown_connections 2024-06-02T22:53:10.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.263+0000 7f4e0f4d4640 1 --2- 172.21.15.82:0/3894251746 >> v2:172.21.15.184:3300/0 conn(0x7f4e080cf370 0x7f4e080ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.263+0000 7f4e0f4d4640 1 --2- 172.21.15.82:0/3894251746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e08155590 0x7f4e0815b460 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.263+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/3894251746 >> 172.21.15.82:0/3894251746 conn(0x7f4e080b1980 msgr2=0x7f4e080b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:10.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.263+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/3894251746 shutdown_connections 2024-06-02T22:53:10.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.263+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/3894251746 wait complete. 2024-06-02T22:53:10.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.264+0000 7f4e0f4d4640 1 Processor -- start 2024-06-02T22:53:10.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.264+0000 7f4e0f4d4640 1 -- start start 2024-06-02T22:53:10.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0f4d4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e080cf370 0x7f4e0814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0f4d4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e08155590 0x7f4e0815e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0f4d4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e0815b9a0 0x7f4e0814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0f4d4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4e080add40 con 0x7f4e080cf370 2024-06-02T22:53:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0f4d4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4e080b26d0 con 0x7f4e0815b9a0 2024-06-02T22:53:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0f4d4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4e080adec0 con 0x7f4e08155590 2024-06-02T22:53:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0d270640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e080cf370 0x7f4e0814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0d270640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e080cf370 0x7f4e0814fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49696/0 (socket says 172.21.15.82:49696) 2024-06-02T22:53:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0d270640 1 -- 172.21.15.82:0/4251289014 learned_addr learned my addr 172.21.15.82:0/4251289014 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0ca6f640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e08155590 0x7f4e0815e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0da71640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e0815b9a0 0x7f4e0814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0d270640 1 -- 172.21.15.82:0/4251289014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e08155590 msgr2=0x7f4e0815e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0d270640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e08155590 0x7f4e0815e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0d270640 1 -- 172.21.15.82:0/4251289014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e0815b9a0 msgr2=0x7f4e0814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0d270640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e0815b9a0 0x7f4e0814b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0d270640 1 -- 172.21.15.82:0/4251289014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0814bb40 con 0x7f4e080cf370 2024-06-02T22:53:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.265+0000 7f4e0d270640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e080cf370 0x7f4e0814fa40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4e0402a2b0 tx=0x7f4e040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.266+0000 7f4dfdffb640 1 -- 172.21.15.82:0/4251289014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04041020 con 0x7f4e080cf370 2024-06-02T22:53:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.266+0000 7f4dfdffb640 1 -- 172.21.15.82:0/4251289014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e040306c0 con 0x7f4e080cf370 2024-06-02T22:53:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.266+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/4251289014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0814be20 con 0x7f4e080cf370 2024-06-02T22:53:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.266+0000 7f4dfdffb640 1 -- 172.21.15.82:0/4251289014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04037040 con 0x7f4e080cf370 2024-06-02T22:53:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.266+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/4251289014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0814c3e0 con 0x7f4e080cf370 2024-06-02T22:53:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.267+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/4251289014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0814c620 con 0x7f4e080cf370 2024-06-02T22:53:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.267+0000 7f4dfdffb640 1 -- 172.21.15.82:0/4251289014 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e04044020 con 0x7f4e080cf370 2024-06-02T22:53:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.268+0000 7f4dfdffb640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4dec06be30 0x7f4dec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.268+0000 7f4dfdffb640 1 -- 172.21.15.82:0/4251289014 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f4e040ab830 con 0x7f4e080cf370 2024-06-02T22:53:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.268+0000 7f4e0ca6f640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4dec06be30 0x7f4dec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:10.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.268+0000 7f4e0ca6f640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4dec06be30 0x7f4dec06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4df8007fd0 tx=0x7f4df8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:10.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.272+0000 7f4dfdffb640 1 -- 172.21.15.82:0/4251289014 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4e0814c620 con 0x7f4e080cf370 2024-06-02T22:53:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.444+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/4251289014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) -- 0x7f4e08068540 con 0x7f4e080cf370 2024-06-02T22:53:10.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.579+0000 7f4dfdffb640 1 -- 172.21.15.82:0/4251289014 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v39) ==== 124+0+0 (secure 0 0 0) 0x7f4e0404b030 con 0x7f4e080cf370 2024-06-02T22:53:10.579 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'data_new' created 2024-06-02T22:53:10.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/4251289014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4dec06be30 msgr2=0x7f4dec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:10.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4dec06be30 0x7f4dec06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4df8007fd0 tx=0x7f4df8009040 comp rx=0 tx=0).stop 2024-06-02T22:53:10.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/4251289014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e080cf370 msgr2=0x7f4e0814fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:10.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e080cf370 0x7f4e0814fa40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4e0402a2b0 tx=0x7f4e040046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/4251289014 shutdown_connections 2024-06-02T22:53:10.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4dec06be30 0x7f4dec06e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e0815b9a0 0x7f4e0814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e08155590 0x7f4e0815e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 --2- 172.21.15.82:0/4251289014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e080cf370 0x7f4e0814fa40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/4251289014 >> 172.21.15.82:0/4251289014 conn(0x7f4e080b1980 msgr2=0x7f4e080b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:10.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/4251289014 shutdown_connections 2024-06-02T22:53:10.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.582+0000 7f4e0f4d4640 1 -- 172.21.15.82:0/4251289014 wait complete. 2024-06-02T22:53:10.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2024-06-02T22:53:10.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.701+0000 7f14d1493640 1 Processor -- start 2024-06-02T22:53:10.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.701+0000 7f14d1493640 1 -- start start 2024-06-02T22:53:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14d1493640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14cc0d2a20 0x7f14cc0cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14d1493640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f14cc0cff40 0x7f14cc15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14d1493640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14cc0d17e0 con 0x7f14cc0d2640 2024-06-02T22:53:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14d1493640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f14cc0cef20 con 0x7f14cc0d2a20 2024-06-02T22:53:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14d1493640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f14cc0cf200 con 0x7f14cc0cff40 2024-06-02T22:53:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14c27fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14cc0d2a20 0x7f14cc0cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14caffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f14cc0d2640 0x7f14cc0b0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39444/0 (socket says 172.21.15.82:39444) 2024-06-02T22:53:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14caffd640 1 -- 172.21.15.82:0/431033179 learned_addr learned my addr 172.21.15.82:0/431033179 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14c27fc640 1 -- 172.21.15.82:0/431033179 >> v2:172.21.15.184:3300/0 conn(0x7f14cc0cff40 msgr2=0x7f14cc15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14c27fc640 1 --2- 172.21.15.82:0/431033179 >> v2:172.21.15.184:3300/0 conn(0x7f14cc0cff40 0x7f14cc15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14c27fc640 1 -- 172.21.15.82:0/431033179 >> v1:172.21.15.82:6789/0 conn(0x7f14cc0d2640 legacy=0x7f14cc0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14ca7fc640 1 -- 172.21.15.82:0/431033179 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3712430378 0 0) 0x7f14cc0d17e0 con 0x7f14cc0d2640 2024-06-02T22:53:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.702+0000 7f14c27fc640 1 -- 172.21.15.82:0/431033179 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc0cf4e0 con 0x7f14cc0d2a20 2024-06-02T22:53:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.703+0000 7f14c27fc640 1 --2- 172.21.15.82:0/431033179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc0d2a20 0x7f14cc0cfa00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f14cc1632a0 tx=0x7f14b402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f6eb6bd1da158b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.703+0000 7f14ca7fc640 1 -- 172.21.15.82:0/431033179 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4037070 con 0x7f14cc0d2a20 2024-06-02T22:53:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.703+0000 7f14ca7fc640 1 -- 172.21.15.82:0/431033179 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b4032440 con 0x7f14cc0d2a20 2024-06-02T22:53:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.703+0000 7f14ca7fc640 1 -- 172.21.15.82:0/431033179 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4032810 con 0x7f14cc0d2a20 2024-06-02T22:53:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.703+0000 7f14d1493640 1 -- 172.21.15.82:0/431033179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc0d2a20 msgr2=0x7f14cc0cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.703+0000 7f14d1493640 1 --2- 172.21.15.82:0/431033179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc0d2a20 0x7f14cc0cfa00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f14cc1632a0 tx=0x7f14b402a1a0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.703+0000 7f14d1493640 1 -- 172.21.15.82:0/431033179 shutdown_connections 2024-06-02T22:53:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.703+0000 7f14d1493640 1 --2- 172.21.15.82:0/431033179 >> v2:172.21.15.184:3300/0 conn(0x7f14cc0cff40 0x7f14cc15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.703+0000 7f14d1493640 1 --2- 172.21.15.82:0/431033179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc0d2a20 0x7f14cc0cfa00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.704+0000 7f14d1493640 1 -- 172.21.15.82:0/431033179 >> 172.21.15.82:0/431033179 conn(0x7f14cc09d3a0 msgr2=0x7f14cc0d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.704+0000 7f14d1493640 1 -- 172.21.15.82:0/431033179 shutdown_connections 2024-06-02T22:53:10.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.704+0000 7f14d1493640 1 -- 172.21.15.82:0/431033179 wait complete. 2024-06-02T22:53:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.705+0000 7f14d1493640 1 Processor -- start 2024-06-02T22:53:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.705+0000 7f14d1493640 1 -- start start 2024-06-02T22:53:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14d1493640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14cc0cff40 0x7f14cc0b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14d1493640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc0d2640 0x7f14cc158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14d1493640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14cc0d2a20 0x7f14cc0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14d1493640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc15e6a0 con 0x7f14cc0d2640 2024-06-02T22:53:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14d1493640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc0b1410 con 0x7f14cc0d2a20 2024-06-02T22:53:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14d1493640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f14cc15e820 con 0x7f14cc0cff40 2024-06-02T22:53:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c27fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc0d2640 0x7f14cc158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c27fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc0d2640 0x7f14cc158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49708/0 (socket says 172.21.15.82:49708) 2024-06-02T22:53:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c27fc640 1 -- 172.21.15.82:0/2876423591 learned_addr learned my addr 172.21.15.82:0/2876423591 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14cb7fe640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14cc0d2a20 0x7f14cc0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c27fc640 1 -- 172.21.15.82:0/2876423591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14cc0cff40 msgr2=0x7f14cc0b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c27fc640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14cc0cff40 0x7f14cc0b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c27fc640 1 -- 172.21.15.82:0/2876423591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14cc0d2a20 msgr2=0x7f14cc0c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c27fc640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14cc0d2a20 0x7f14cc0c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c27fc640 1 -- 172.21.15.82:0/2876423591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc0b8450 con 0x7f14cc0d2640 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c27fc640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc0d2640 0x7f14cc158930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f14b4035040 tx=0x7f14b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c3fff640 1 -- 172.21.15.82:0/2876423591 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4042020 con 0x7f14cc0d2640 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c3fff640 1 -- 172.21.15.82:0/2876423591 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b4030970 con 0x7f14cc0d2640 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14d1493640 1 -- 172.21.15.82:0/2876423591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14cc0b8730 con 0x7f14cc0d2640 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14c3fff640 1 -- 172.21.15.82:0/2876423591 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4037040 con 0x7f14cc0d2640 2024-06-02T22:53:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.706+0000 7f14d1493640 1 -- 172.21.15.82:0/2876423591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14cc0b8cf0 con 0x7f14cc0d2640 2024-06-02T22:53:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.707+0000 7f14d1493640 1 -- 172.21.15.82:0/2876423591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14cc0683c0 con 0x7f14cc0d2640 2024-06-02T22:53:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.708+0000 7f14c3fff640 1 -- 172.21.15.82:0/2876423591 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14b4045020 con 0x7f14cc0d2640 2024-06-02T22:53:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.708+0000 7f14c3fff640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f14ac06be60 0x7f14ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.708+0000 7f14c3fff640 1 -- 172.21.15.82:0/2876423591 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6464+0+0 (secure 0 0 0) 0x7f14b40abda0 con 0x7f14cc0d2640 2024-06-02T22:53:10.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.708+0000 7f14caffd640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f14ac06be60 0x7f14ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:10.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.709+0000 7f14caffd640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f14ac06be60 0x7f14ac06e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f14bc007fd0 tx=0x7f14bc007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:10.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.713+0000 7f14c3fff640 1 -- 172.21.15.82:0/2876423591 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f14b404c030 con 0x7f14cc0d2640 2024-06-02T22:53:10.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:10.923+0000 7f14d1493640 1 -- 172.21.15.82:0/2876423591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) -- 0x7f14cc0d4b50 con 0x7f14cc0d2640 2024-06-02T22:53:11.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.590+0000 7f14c3fff640 1 -- 172.21.15.82:0/2876423591 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 7 to fsmap v17) ==== 131+0+0 (secure 0 0 0) 0x7f14b407a4f0 con 0x7f14cc0d2640 2024-06-02T22:53:11.591 INFO:teuthology.orchestra.run.smithi082.stderr:added data pool 7 to fsmap 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.597+0000 7f14d1493640 1 -- 172.21.15.82:0/2876423591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f14ac06be60 msgr2=0x7f14ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.597+0000 7f14d1493640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f14ac06be60 0x7f14ac06e320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f14bc007fd0 tx=0x7f14bc007920 comp rx=0 tx=0).stop 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.597+0000 7f14d1493640 1 -- 172.21.15.82:0/2876423591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc0d2640 msgr2=0x7f14cc158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.597+0000 7f14d1493640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc0d2640 0x7f14cc158930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f14b4035040 tx=0x7f14b40046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.597+0000 7f14d1493640 1 -- 172.21.15.82:0/2876423591 shutdown_connections 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.597+0000 7f14d1493640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f14ac06be60 0x7f14ac06e320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.597+0000 7f14d1493640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14cc0d2a20 0x7f14cc0c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.597+0000 7f14d1493640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14cc0d2640 0x7f14cc158930 secure :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f14b4035040 tx=0x7f14b40046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.597+0000 7f14d1493640 1 --2- 172.21.15.82:0/2876423591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14cc0cff40 0x7f14cc0b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.597+0000 7f14d1493640 1 -- 172.21.15.82:0/2876423591 >> 172.21.15.82:0/2876423591 conn(0x7f14cc09d3a0 msgr2=0x7f14cc15cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.598+0000 7f14d1493640 1 -- 172.21.15.82:0/2876423591 shutdown_connections 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.599+0000 7f14d1493640 1 -- 172.21.15.82:0/2876423591 wait complete. 2024-06-02T22:53:11.613 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:53:11.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.714+0000 7fd998a64640 1 Processor -- start 2024-06-02T22:53:11.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.715+0000 7fd998a64640 1 -- start start 2024-06-02T22:53:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.715+0000 7fd998a64640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9940d2680 0x7fd99415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.716+0000 7fd998a64640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9940d0ad0 con 0x7fd9940d1fc0 2024-06-02T22:53:11.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.716+0000 7fd998a64640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd99415f890 con 0x7fd9940cef70 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.716+0000 7fd998a64640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd9940d13e0 con 0x7fd9940d2680 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.716+0000 7fd99259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9940d2680 0x7fd99415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.716+0000 7fd991d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd9940d1fc0 0x7fd9940d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33674/0 (socket says 172.21.15.82:33674) 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.716+0000 7fd991d9b640 1 -- 172.21.15.82:0/1122833760 learned_addr learned my addr 172.21.15.82:0/1122833760 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.716+0000 7fd99259c640 1 -- 172.21.15.82:0/1122833760 >> v1:172.21.15.184:6789/0 conn(0x7fd9940cef70 legacy=0x7fd9940cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.716+0000 7fd99259c640 1 -- 172.21.15.82:0/1122833760 >> v1:172.21.15.82:6789/0 conn(0x7fd9940d1fc0 legacy=0x7fd9940d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.716+0000 7fd99159a640 1 -- 172.21.15.82:0/1122833760 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 656035537 0 0) 0x7fd9940d0ad0 con 0x7fd9940d1fc0 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.716+0000 7fd99259c640 1 -- 172.21.15.82:0/1122833760 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9940d0d90 con 0x7fd9940d2680 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.717+0000 7fd99259c640 1 --2- 172.21.15.82:0/1122833760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9940d2680 0x7fd99415f1a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd9940d1560 tx=0x7fd98402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84c201f1a74e660 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.717+0000 7fd99159a640 1 -- 172.21.15.82:0/1122833760 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd984037070 con 0x7fd9940d2680 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.717+0000 7fd99159a640 1 -- 172.21.15.82:0/1122833760 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd984032440 con 0x7fd9940d2680 2024-06-02T22:53:11.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.717+0000 7fd99159a640 1 -- 172.21.15.82:0/1122833760 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd984032810 con 0x7fd9940d2680 2024-06-02T22:53:11.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.717+0000 7fd998a64640 1 -- 172.21.15.82:0/1122833760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9940d2680 msgr2=0x7fd99415f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:11.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.717+0000 7fd998a64640 1 --2- 172.21.15.82:0/1122833760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9940d2680 0x7fd99415f1a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd9940d1560 tx=0x7fd98402a1c0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.717+0000 7fd998a64640 1 -- 172.21.15.82:0/1122833760 shutdown_connections 2024-06-02T22:53:11.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.717+0000 7fd998a64640 1 --2- 172.21.15.82:0/1122833760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9940d2680 0x7fd99415f1a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.717+0000 7fd998a64640 1 -- 172.21.15.82:0/1122833760 >> 172.21.15.82:0/1122833760 conn(0x7fd99409d3f0 msgr2=0x7fd9940d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:11.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.717+0000 7fd998a64640 1 -- 172.21.15.82:0/1122833760 shutdown_connections 2024-06-02T22:53:11.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.717+0000 7fd998a64640 1 -- 172.21.15.82:0/1122833760 wait complete. 2024-06-02T22:53:11.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.719+0000 7fd998a64640 1 Processor -- start 2024-06-02T22:53:11.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.719+0000 7fd998a64640 1 -- start start 2024-06-02T22:53:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.719+0000 7fd998a64640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9940cef70 0x7fd9940b9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.719+0000 7fd998a64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9940d1fc0 0x7fd9941f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.719+0000 7fd998a64640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9940d2680 0x7fd9941f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.719+0000 7fd998a64640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9940d4f00 con 0x7fd9940d1fc0 2024-06-02T22:53:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd998a64640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd9940d2400 con 0x7fd9940cef70 2024-06-02T22:53:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd998a64640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd9940d1870 con 0x7fd9940d2680 2024-06-02T22:53:11.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd991d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9940d1fc0 0x7fd9941f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd991d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9940d1fc0 0x7fd9941f7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42134/0 (socket says 172.21.15.82:42134) 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd991d9b640 1 -- 172.21.15.82:0/1470171746 learned_addr learned my addr 172.21.15.82:0/1470171746 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd99259c640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9940cef70 0x7fd9940b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd992d9d640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9940d2680 0x7fd9941f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd991d9b640 1 -- 172.21.15.82:0/1470171746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9940d2680 msgr2=0x7fd9941f8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd991d9b640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9940d2680 0x7fd9941f8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd991d9b640 1 -- 172.21.15.82:0/1470171746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9940cef70 msgr2=0x7fd9940b9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd991d9b640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9940cef70 0x7fd9940b9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd991d9b640 1 -- 172.21.15.82:0/1470171746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9940b80d0 con 0x7fd9940d1fc0 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd991d9b640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9940d1fc0 0x7fd9941f7e10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c4d0 tx=0x7fd97c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd98affd640 1 -- 172.21.15.82:0/1470171746 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c018070 con 0x7fd9940d1fc0 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd98affd640 1 -- 172.21.15.82:0/1470171746 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97c007500 con 0x7fd9940d1fc0 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd998a64640 1 -- 172.21.15.82:0/1470171746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9940b83b0 con 0x7fd9940d1fc0 2024-06-02T22:53:11.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd98affd640 1 -- 172.21.15.82:0/1470171746 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c004a20 con 0x7fd9940d1fc0 2024-06-02T22:53:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.720+0000 7fd998a64640 1 -- 172.21.15.82:0/1470171746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9940b8970 con 0x7fd9940d1fc0 2024-06-02T22:53:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.721+0000 7fd998a64640 1 -- 172.21.15.82:0/1470171746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd994068430 con 0x7fd9940d1fc0 2024-06-02T22:53:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.722+0000 7fd98affd640 1 -- 172.21.15.82:0/1470171746 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd97c01b070 con 0x7fd9940d1fc0 2024-06-02T22:53:11.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.722+0000 7fd98affd640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd97406be30 0x7fd97406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.722+0000 7fd98affd640 1 -- 172.21.15.82:0/1470171746 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6496+0+0 (secure 0 0 0) 0x7fd97c08a380 con 0x7fd9940d1fc0 2024-06-02T22:53:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.722+0000 7fd99259c640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd97406be30 0x7fd97406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:11.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.723+0000 7fd99259c640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd97406be30 0x7fd97406e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd984034000 tx=0x7fd98402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:11.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.727+0000 7fd98affd640 1 -- 172.21.15.82:0/1470171746 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd97c058460 con 0x7fd9940d1fc0 2024-06-02T22:53:11.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.935+0000 7fd998a64640 1 -- 172.21.15.82:0/1470171746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9940d04e0 con 0x7fd9940d1fc0 2024-06-02T22:53:11.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.935+0000 7fd98affd640 1 -- 172.21.15.82:0/1470171746 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5189 (secure 0 0 0) 0x7fd97c05c760 con 0x7fd9940d1fc0 2024-06-02T22:53:11.935 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:11.935 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2802926071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2802926071},{"type":"v1","addr":"172.21.15.184:6834","nonce":2802926071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4908,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2538474234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2538474234},{"type":"v1","addr":"172.21.15.82:6836","nonce":2538474234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1604488280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1604488280},{"type":"v1","addr":"172.21.15.82:6837","nonce":1604488280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:58.170722+0000","modified":"2024-06-02T22:53:10.925095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3297362995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":3297362995},{"type":"v1","addr":"172.21.15.184:6835","nonce":3297362995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4929,"qdb_cluster":[4929]},"id":2}]} 2024-06-02T22:53:11.935 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-06-02T22:53:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 -- 172.21.15.82:0/1470171746 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd97406be30 msgr2=0x7fd97406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd97406be30 0x7fd97406e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd984034000 tx=0x7fd98402e000 comp rx=0 tx=0).stop 2024-06-02T22:53:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 -- 172.21.15.82:0/1470171746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9940d1fc0 msgr2=0x7fd9941f7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9940d1fc0 0x7fd9941f7e10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c4d0 tx=0x7fd97c00c990 comp rx=0 tx=0).stop 2024-06-02T22:53:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 -- 172.21.15.82:0/1470171746 shutdown_connections 2024-06-02T22:53:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd97406be30 0x7fd97406e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9940d2680 0x7fd9941f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9940d1fc0 0x7fd9941f7e10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 --2- 172.21.15.82:0/1470171746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9940cef70 0x7fd9940b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 -- 172.21.15.82:0/1470171746 >> 172.21.15.82:0/1470171746 conn(0x7fd99409d3f0 msgr2=0x7fd9940cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 -- 172.21.15.82:0/1470171746 shutdown_connections 2024-06-02T22:53:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:11.937+0000 7fd998a64640 1 -- 172.21.15.82:0/1470171746 wait complete. 2024-06-02T22:53:11.948 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:53:12.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.047+0000 7f56795a2640 1 Processor -- start 2024-06-02T22:53:12.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.047+0000 7f56795a2640 1 -- start start 2024-06-02T22:53:12.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f56795a2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f567406ebf0 0x7f56740cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f56795a2640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f56740cf190 0x7f56740acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f56795a2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56740cf600 con 0x7f56740ae910 2024-06-02T22:53:12.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f56795a2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f567406d130 con 0x7f567406ebf0 2024-06-02T22:53:12.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f56795a2640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f567406d410 con 0x7f56740cf190 2024-06-02T22:53:12.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f56727fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f567406ebf0 0x7f56740cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f5672ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f56740ae910 0x7f567406e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33688/0 (socket says 172.21.15.82:33688) 2024-06-02T22:53:12.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f5672ffd640 1 -- 172.21.15.82:0/3471961733 learned_addr learned my addr 172.21.15.82:0/3471961733 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:12.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f56737fe640 1 --2- 172.21.15.82:0/3471961733 >> v2:172.21.15.184:3300/0 conn(0x7f56740cf190 0x7f56740acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f56727fc640 1 -- 172.21.15.82:0/3471961733 >> v2:172.21.15.184:3300/0 conn(0x7f56740cf190 msgr2=0x7f56740acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:12.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f56727fc640 1 --2- 172.21.15.82:0/3471961733 >> v2:172.21.15.184:3300/0 conn(0x7f56740cf190 0x7f56740acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f56727fc640 1 -- 172.21.15.82:0/3471961733 >> v1:172.21.15.82:6789/0 conn(0x7f56740ae910 legacy=0x7f567406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f5671ffb640 1 -- 172.21.15.82:0/3471961733 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682130385 0 0) 0x7f56740cf600 con 0x7f56740ae910 2024-06-02T22:53:12.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.048+0000 7f56727fc640 1 -- 172.21.15.82:0/3471961733 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567406d6f0 con 0x7f567406ebf0 2024-06-02T22:53:12.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.049+0000 7f56727fc640 1 --2- 172.21.15.82:0/3471961733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567406ebf0 0x7f56740cec50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f567406dcb0 tx=0x7f566802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b1b5e64d77522f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.049+0000 7f5671ffb640 1 -- 172.21.15.82:0/3471961733 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668037070 con 0x7f567406ebf0 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.049+0000 7f5671ffb640 1 -- 172.21.15.82:0/3471961733 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5668032440 con 0x7f567406ebf0 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.049+0000 7f5671ffb640 1 -- 172.21.15.82:0/3471961733 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566802ae60 con 0x7f567406ebf0 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.050+0000 7f56795a2640 1 -- 172.21.15.82:0/3471961733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567406ebf0 msgr2=0x7f56740cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.050+0000 7f56795a2640 1 --2- 172.21.15.82:0/3471961733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567406ebf0 0x7f56740cec50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f567406dcb0 tx=0x7f566802a110 comp rx=0 tx=0).stop 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.050+0000 7f56795a2640 1 -- 172.21.15.82:0/3471961733 shutdown_connections 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.050+0000 7f56795a2640 1 --2- 172.21.15.82:0/3471961733 >> v2:172.21.15.184:3300/0 conn(0x7f56740cf190 0x7f56740acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.050+0000 7f56795a2640 1 --2- 172.21.15.82:0/3471961733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f567406ebf0 0x7f56740cec50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.050+0000 7f56795a2640 1 -- 172.21.15.82:0/3471961733 >> 172.21.15.82:0/3471961733 conn(0x7f56740b19f0 msgr2=0x7f56740b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.050+0000 7f56795a2640 1 -- 172.21.15.82:0/3471961733 shutdown_connections 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.050+0000 7f56795a2640 1 -- 172.21.15.82:0/3471961733 wait complete. 2024-06-02T22:53:12.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.051+0000 7f56795a2640 1 Processor -- start 2024-06-02T22:53:12.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.051+0000 7f56795a2640 1 -- start start 2024-06-02T22:53:12.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56795a2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f567406ebf0 0x7f5674150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56795a2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56740ae910 0x7f567415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56795a2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56740cf190 0x7f56740cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56795a2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f56740ad280 con 0x7f56740ae910 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56795a2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f56740aecf0 con 0x7f567406ebf0 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56795a2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f56740ad400 con 0x7f56740cf190 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56727fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56740ae910 0x7f567415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56727fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56740ae910 0x7f567415bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42162/0 (socket says 172.21.15.82:42162) 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56727fc640 1 -- 172.21.15.82:0/3216867449 learned_addr learned my addr 172.21.15.82:0/3216867449 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56737fe640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56740cf190 0x7f56740cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f5672ffd640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f567406ebf0 0x7f5674150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56727fc640 1 -- 172.21.15.82:0/3216867449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56740cf190 msgr2=0x7f56740cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56727fc640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56740cf190 0x7f56740cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56727fc640 1 -- 172.21.15.82:0/3216867449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f567406ebf0 msgr2=0x7f5674150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56727fc640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f567406ebf0 0x7f5674150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56727fc640 1 -- 172.21.15.82:0/3216867449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5674150da0 con 0x7f56740ae910 2024-06-02T22:53:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f5672ffd640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f567406ebf0 0x7f5674150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.052+0000 7f56727fc640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56740ae910 0x7f567415bed0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5668000c00 tx=0x7f56680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.053+0000 7f565b7fe640 1 -- 172.21.15.82:0/3216867449 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668041070 con 0x7f56740ae910 2024-06-02T22:53:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.053+0000 7f565b7fe640 1 -- 172.21.15.82:0/3216867449 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566803c890 con 0x7f56740ae910 2024-06-02T22:53:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.053+0000 7f565b7fe640 1 -- 172.21.15.82:0/3216867449 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668037040 con 0x7f56740ae910 2024-06-02T22:53:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.053+0000 7f56795a2640 1 -- 172.21.15.82:0/3216867449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567415ca30 con 0x7f56740ae910 2024-06-02T22:53:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.053+0000 7f56795a2640 1 -- 172.21.15.82:0/3216867449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567415cff0 con 0x7f56740ae910 2024-06-02T22:53:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.054+0000 7f56795a2640 1 -- 172.21.15.82:0/3216867449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5674068410 con 0x7f56740ae910 2024-06-02T22:53:12.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.054+0000 7f565b7fe640 1 -- 172.21.15.82:0/3216867449 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5668044070 con 0x7f56740ae910 2024-06-02T22:53:12.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.055+0000 7f565b7fe640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f566006be30 0x7f566006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.055+0000 7f5672ffd640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f566006be30 0x7f566006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.055+0000 7f565b7fe640 1 -- 172.21.15.82:0/3216867449 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6496+0+0 (secure 0 0 0) 0x7f56680abee0 con 0x7f56740ae910 2024-06-02T22:53:12.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.055+0000 7f5672ffd640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f566006be30 0x7f566006e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5664000f60 tx=0x7f5664009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:12.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.059+0000 7f565b7fe640 1 -- 172.21.15.82:0/3216867449 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5674150da0 con 0x7f56740ae910 2024-06-02T22:53:12.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.233+0000 7f56795a2640 1 -- 172.21.15.82:0/3216867449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56740ce860 con 0x7f56740ae910 2024-06-02T22:53:12.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.234+0000 7f565b7fe640 1 -- 172.21.15.82:0/3216867449 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+18767 (secure 0 0 0) 0x7f566807a6a0 con 0x7f56740ae910 2024-06-02T22:53:12.234 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:12.234 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":40,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:53:10.924841+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:56.075878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:57.154913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-06-02T22:53:10.463415+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:53:12.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 -- 172.21.15.82:0/3216867449 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f566006be30 msgr2=0x7f566006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f566006be30 0x7f566006e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5664000f60 tx=0x7f5664009040 comp rx=0 tx=0).stop 2024-06-02T22:53:12.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 -- 172.21.15.82:0/3216867449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56740ae910 msgr2=0x7f567415bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56740ae910 0x7f567415bed0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5668000c00 tx=0x7f56680046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 -- 172.21.15.82:0/3216867449 shutdown_connections 2024-06-02T22:53:12.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f566006be30 0x7f566006e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56740cf190 0x7f56740cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56740ae910 0x7f567415bed0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 --2- 172.21.15.82:0/3216867449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f567406ebf0 0x7f5674150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 -- 172.21.15.82:0/3216867449 >> 172.21.15.82:0/3216867449 conn(0x7f56740b19f0 msgr2=0x7f56740b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 -- 172.21.15.82:0/3216867449 shutdown_connections 2024-06-02T22:53:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.236+0000 7f56795a2640 1 -- 172.21.15.82:0/3216867449 wait complete. 2024-06-02T22:53:12.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:12.247 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2024-06-02T22:53:12.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:12.269 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2024-06-02T22:53:12.327 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-06-02T22:53:12.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.475+0000 7f6c1e534640 1 Processor -- start 2024-06-02T22:53:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.475+0000 7f6c1e534640 1 -- start start 2024-06-02T22:53:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.475+0000 7f6c1e534640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c180b3000 0x7f6c180b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.475+0000 7f6c1e534640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6c1815bd70 0x7f6c1815c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.475+0000 7f6c1e534640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1806d950 con 0x7f6c18154d60 2024-06-02T22:53:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.475+0000 7f6c1e534640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1806dc30 con 0x7f6c1815bd70 2024-06-02T22:53:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.475+0000 7f6c1e534640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1806df10 con 0x7f6c180b3000 2024-06-02T22:53:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c17fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6c18154d60 0x7f6c1806cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33694/0 (socket says 172.21.15.82:33694) 2024-06-02T22:53:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c17fff640 1 -- 172.21.15.82:0/2916204696 learned_addr learned my addr 172.21.15.82:0/2916204696 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215874205 0 0) 0x7f6c1806d950 con 0x7f6c18154d60 2024-06-02T22:53:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c177fe640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c180b3000 0x7f6c180b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c1cad1640 1 --2- 172.21.15.82:0/2916204696 >> v2:172.21.15.184:3300/0 conn(0x7f6c1815bd70 0x7f6c1815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c00003520 con 0x7f6c18154d60 2024-06-02T22:53:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1735772660 0 0) 0x7f6c00003520 con 0x7f6c18154d60 2024-06-02T22:53:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c180b3000 msgr2=0x7f6c180b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c180b3000 0x7f6c180b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 >> v2:172.21.15.184:3300/0 conn(0x7f6c1815bd70 msgr2=0x7f6c1815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 --2- 172.21.15.82:0/2916204696 >> v2:172.21.15.184:3300/0 conn(0x7f6c1815bd70 0x7f6c1815c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1806e1f0 con 0x7f6c18154d60 2024-06-02T22:53:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f6c08001670 con 0x7f6c18154d60 2024-06-02T22:53:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 >> v1:172.21.15.82:6789/0 conn(0x7f6c18154d60 legacy=0x7f6c1806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c000039b0 0x7f6c00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c00004800 0x7f6c00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c180b3000 0x7f6c000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1806dc30 con 0x7f6c000039b0 2024-06-02T22:53:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1806df10 con 0x7f6c00004800 2024-06-02T22:53:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6c0000b9c0 con 0x7f6c180b3000 2024-06-02T22:53:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c17fff640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c000039b0 0x7f6c00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c177fe640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c00004800 0x7f6c00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c1cad1640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c180b3000 0x7f6c000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.476+0000 7f6c17fff640 1 -- 172.21.15.82:0/2916204696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c180b3000 msgr2=0x7f6c000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.477+0000 7f6c17fff640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c180b3000 0x7f6c000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.477+0000 7f6c17fff640 1 -- 172.21.15.82:0/2916204696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c00004800 msgr2=0x7f6c00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.477+0000 7f6c17fff640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c00004800 0x7f6c00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.477+0000 7f6c17fff640 1 -- 172.21.15.82:0/2916204696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c00003520 con 0x7f6c000039b0 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.477+0000 7f6c17fff640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c000039b0 0x7f6c00003dd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c210 tx=0x7f6c00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5ac303d8092499 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.477+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08034020 con 0x7f6c000039b0 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.477+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c08005af0 con 0x7f6c000039b0 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.477+0000 7f6c16ffd640 1 -- 172.21.15.82:0/2916204696 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08007d30 con 0x7f6c000039b0 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.478+0000 7f6c1e534640 1 -- 172.21.15.82:0/2916204696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c000039b0 msgr2=0x7f6c00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.478+0000 7f6c1e534640 1 --2- 172.21.15.82:0/2916204696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c000039b0 0x7f6c00003dd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c210 tx=0x7f6c00005830 comp rx=0 tx=0).stop 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.478+0000 7f6c1cad1640 1 -- 172.21.15.82:0/2916204696 reap_dead start 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.478+0000 7f6c1e534640 1 -- 172.21.15.82:0/2916204696 shutdown_connections 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.478+0000 7f6c1e534640 1 -- 172.21.15.82:0/2916204696 >> 172.21.15.82:0/2916204696 conn(0x7f6c1806b7e0 msgr2=0x7f6c1806bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.478+0000 7f6c1e534640 1 -- 172.21.15.82:0/2916204696 shutdown_connections 2024-06-02T22:53:12.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.478+0000 7f6c1e534640 1 -- 172.21.15.82:0/2916204696 wait complete. 2024-06-02T22:53:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.479+0000 7f6c1e534640 1 Processor -- start 2024-06-02T22:53:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.479+0000 7f6c1e534640 1 -- start start 2024-06-02T22:53:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1e534640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000039b0 0x7f6c180cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1e534640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c180ae070 0x7f6c18155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1e534640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c18155680 0x7f6c181532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1e534640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1806d670 con 0x7f6c18155680 2024-06-02T22:53:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1e534640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1806d4f0 con 0x7f6c180ae070 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1e534640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6c180b3480 con 0x7f6c000039b0 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1cad1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c18155680 0x7f6c181532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1cad1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c18155680 0x7f6c181532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42178/0 (socket says 172.21.15.82:42178) 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1cad1640 1 -- 172.21.15.82:0/803410124 learned_addr learned my addr 172.21.15.82:0/803410124 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c17fff640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000039b0 0x7f6c180cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1cad1640 1 -- 172.21.15.82:0/803410124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000039b0 msgr2=0x7f6c180cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1cad1640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000039b0 0x7f6c180cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1cad1640 1 -- 172.21.15.82:0/803410124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c180ae070 msgr2=0x7f6c18155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1cad1640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c180ae070 0x7f6c18155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.480+0000 7f6c1cad1640 1 -- 172.21.15.82:0/803410124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180ccb80 con 0x7f6c18155680 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.481+0000 7f6c1cad1640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c18155680 0x7f6c181532d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6c1806f400 tx=0x7f6c100115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.481+0000 7f6c14ff9640 1 -- 172.21.15.82:0/803410124 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10011e10 con 0x7f6c18155680 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.481+0000 7f6c14ff9640 1 -- 172.21.15.82:0/803410124 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c1001b070 con 0x7f6c18155680 2024-06-02T22:53:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.481+0000 7f6c14ff9640 1 -- 172.21.15.82:0/803410124 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10003990 con 0x7f6c18155680 2024-06-02T22:53:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.481+0000 7f6c1e534640 1 -- 172.21.15.82:0/803410124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c180ca3a0 con 0x7f6c18155680 2024-06-02T22:53:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.481+0000 7f6c1e534640 1 -- 172.21.15.82:0/803410124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c180ca960 con 0x7f6c18155680 2024-06-02T22:53:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.482+0000 7f6c1e534640 1 -- 172.21.15.82:0/803410124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c180683c0 con 0x7f6c18155680 2024-06-02T22:53:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.482+0000 7f6c14ff9640 1 -- 172.21.15.82:0/803410124 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c10005d10 con 0x7f6c18155680 2024-06-02T22:53:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.483+0000 7f6c14ff9640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6c0406be30 0x7f6c0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.483+0000 7f6c14ff9640 1 -- 172.21.15.82:0/803410124 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6496+0+0 (secure 0 0 0) 0x7f6c1008b640 con 0x7f6c18155680 2024-06-02T22:53:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.483+0000 7f6c17fff640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6c0406be30 0x7f6c0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.483+0000 7f6c17fff640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6c0406be30 0x7f6c0406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c08035000 tx=0x7f6c08009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:12.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.487+0000 7f6c14ff9640 1 -- 172.21.15.82:0/803410124 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6c10025020 con 0x7f6c18155680 2024-06-02T22:53:12.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.728+0000 7f6c1e534640 1 -- 172.21.15.82:0/803410124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) -- 0x7f6c180cc110 con 0x7f6c18155680 2024-06-02T22:53:12.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.730+0000 7f6c14ff9640 1 -- 172.21.15.82:0/803410124 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v10) ==== 210+0+167 (secure 0 0 0) 0x7f6c1001d310 con 0x7f6c18155680 2024-06-02T22:53:12.729 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-06-02T22:53:12.730 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g== 2024-06-02T22:53:12.730 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow rw" 2024-06-02T22:53:12.730 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2024-06-02T22:53:12.730 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-06-02T22:53:12.730 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2024-06-02T22:53:12.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.732+0000 7f6c1e534640 1 -- 172.21.15.82:0/803410124 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6c0406be30 msgr2=0x7f6c0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.732+0000 7f6c1e534640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6c0406be30 0x7f6c0406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c08035000 tx=0x7f6c08009030 comp rx=0 tx=0).stop 2024-06-02T22:53:12.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.732+0000 7f6c1e534640 1 -- 172.21.15.82:0/803410124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c18155680 msgr2=0x7f6c181532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.732+0000 7f6c1e534640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c18155680 0x7f6c181532d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6c1806f400 tx=0x7f6c100115a0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.732+0000 7f6c1e534640 1 -- 172.21.15.82:0/803410124 shutdown_connections 2024-06-02T22:53:12.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.732+0000 7f6c1e534640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6c0406be30 0x7f6c0406e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.732+0000 7f6c1e534640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c18155680 0x7f6c181532d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.732+0000 7f6c1e534640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c180ae070 0x7f6c18155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.732+0000 7f6c1e534640 1 --2- 172.21.15.82:0/803410124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c000039b0 0x7f6c180cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.732+0000 7f6c1e534640 1 -- 172.21.15.82:0/803410124 >> 172.21.15.82:0/803410124 conn(0x7f6c1806b7e0 msgr2=0x7f6c1815a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:12.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.733+0000 7f6c1e534640 1 -- 172.21.15.82:0/803410124 shutdown_connections 2024-06-02T22:53:12.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.733+0000 7f6c1e534640 1 -- 172.21.15.82:0/803410124 wait complete. 2024-06-02T22:53:12.743 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:12.743 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:12.760 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:53:12.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.901+0000 7f0cd2716640 1 Processor -- start 2024-06-02T22:53:12.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.901+0000 7f0cd2716640 1 -- start start 2024-06-02T22:53:12.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0cd2716640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 0x7f0ccc06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0cd2716640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ccc06ea20 0x7f0ccc0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0cd2716640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ccc0cf620 con 0x7f0ccc0cf190 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0cd2716640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0ccc06ee60 con 0x7f0ccc06ea20 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0cd2716640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0ccc06d130 con 0x7f0ccc0ae910 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0ccb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ccc06ea20 0x7f0ccc0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0ccb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ccc06ea20 0x7f0ccc0cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42186/0 (socket says 172.21.15.82:42186) 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0ccb7fe640 1 -- 172.21.15.82:0/36379550 learned_addr learned my addr 172.21.15.82:0/36379550 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0ccbfff640 1 --2- 172.21.15.82:0/36379550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 0x7f0ccc06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0ccb7fe640 1 -- 172.21.15.82:0/36379550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 msgr2=0x7f0ccc06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0ccb7fe640 1 --2- 172.21.15.82:0/36379550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 0x7f0ccc06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0ccb7fe640 1 -- 172.21.15.82:0/36379550 >> v1:172.21.15.184:6789/0 conn(0x7f0ccc0cf190 legacy=0x7f0ccc15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:12.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0ccb7fe640 1 -- 172.21.15.82:0/36379550 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ccc06d410 con 0x7f0ccc06ea20 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.902+0000 7f0ccbfff640 1 --2- 172.21.15.82:0/36379550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 0x7f0ccc06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.903+0000 7f0ccb7fe640 1 --2- 172.21.15.82:0/36379550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ccc06ea20 0x7f0ccc0cec50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000bb40 tx=0x7f0cc002c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972c6ee7ef9b2dac server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.903+0000 7f0ccaffd640 1 -- 172.21.15.82:0/36379550 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0034620 con 0x7f0ccc06ea20 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.903+0000 7f0ccaffd640 1 -- 172.21.15.82:0/36379550 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc00347c0 con 0x7f0ccc06ea20 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.903+0000 7f0ccaffd640 1 -- 172.21.15.82:0/36379550 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0034b90 con 0x7f0ccc06ea20 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.904+0000 7f0cd2716640 1 -- 172.21.15.82:0/36379550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ccc06ea20 msgr2=0x7f0ccc0cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.904+0000 7f0cd2716640 1 --2- 172.21.15.82:0/36379550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ccc06ea20 0x7f0ccc0cec50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000bb40 tx=0x7f0cc002c870 comp rx=0 tx=0).stop 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.904+0000 7f0cd2716640 1 -- 172.21.15.82:0/36379550 shutdown_connections 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.904+0000 7f0cd2716640 1 --2- 172.21.15.82:0/36379550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ccc06ea20 0x7f0ccc0cec50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.904+0000 7f0cd2716640 1 --2- 172.21.15.82:0/36379550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 0x7f0ccc06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.904+0000 7f0cd2716640 1 -- 172.21.15.82:0/36379550 >> 172.21.15.82:0/36379550 conn(0x7f0ccc0b19f0 msgr2=0x7f0ccc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.904+0000 7f0cd2716640 1 -- 172.21.15.82:0/36379550 shutdown_connections 2024-06-02T22:53:12.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.904+0000 7f0cd2716640 1 -- 172.21.15.82:0/36379550 wait complete. 2024-06-02T22:53:12.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.905+0000 7f0cd2716640 1 Processor -- start 2024-06-02T22:53:12.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.905+0000 7f0cd2716640 1 -- start start 2024-06-02T22:53:12.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cd2716640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ccc06ea20 0x7f0ccc15d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cd2716640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 0x7f0ccc1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cd2716640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ccc0cf190 0x7f0ccc158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cd2716640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc0aecf0 con 0x7f0ccc06ea20 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cd2716640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc06d9d0 con 0x7f0ccc0cf190 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cd2716640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0ccc0add50 con 0x7f0ccc0ae910 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0ccbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ccc06ea20 0x7f0ccc15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0ccbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ccc06ea20 0x7f0ccc15d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42190/0 (socket says 172.21.15.82:42190) 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0ccbfff640 1 -- 172.21.15.82:0/188655758 learned_addr learned my addr 172.21.15.82:0/188655758 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0ccb7fe640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 0x7f0ccc1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cd0cb3640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ccc0cf190 0x7f0ccc158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0ccbfff640 1 -- 172.21.15.82:0/188655758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 msgr2=0x7f0ccc1504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0ccbfff640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 0x7f0ccc1504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0ccbfff640 1 -- 172.21.15.82:0/188655758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ccc0cf190 msgr2=0x7f0ccc158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0ccbfff640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ccc0cf190 0x7f0ccc158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0ccbfff640 1 -- 172.21.15.82:0/188655758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ccc1509e0 con 0x7f0ccc06ea20 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0ccb7fe640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 0x7f0ccc1504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cd0cb3640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ccc0cf190 0x7f0ccc158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0ccbfff640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ccc06ea20 0x7f0ccc15d140 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00c7f0 tx=0x7f0cbc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cc8ff9640 1 -- 172.21.15.82:0/188655758 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc015070 con 0x7f0ccc06ea20 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cc8ff9640 1 -- 172.21.15.82:0/188655758 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc007a30 con 0x7f0ccc06ea20 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cd2716640 1 -- 172.21.15.82:0/188655758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ccc15c0a0 con 0x7f0ccc06ea20 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.906+0000 7f0cc8ff9640 1 -- 172.21.15.82:0/188655758 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc007e00 con 0x7f0ccc06ea20 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.907+0000 7f0cd2716640 1 -- 172.21.15.82:0/188655758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ccc15c660 con 0x7f0ccc06ea20 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.907+0000 7f0cd2716640 1 -- 172.21.15.82:0/188655758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ccc068430 con 0x7f0ccc06ea20 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.908+0000 7f0cc8ff9640 1 -- 172.21.15.82:0/188655758 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0cbc018070 con 0x7f0ccc06ea20 2024-06-02T22:53:12.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.908+0000 7f0cc8ff9640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0cb806be30 0x7f0cb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:12.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.909+0000 7f0cc8ff9640 1 -- 172.21.15.82:0/188655758 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f0cbc08b0f0 con 0x7f0ccc06ea20 2024-06-02T22:53:12.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.909+0000 7f0ccb7fe640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0cb806be30 0x7f0cb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:12.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.909+0000 7f0ccb7fe640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0cb806be30 0x7f0cb806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0037000 tx=0x7f0cc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:12.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:12.913+0000 7f0cc8ff9640 1 -- 172.21.15.82:0/188655758 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0cbc059790 con 0x7f0ccc06ea20 2024-06-02T22:53:13.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.099+0000 7f0cd2716640 1 -- 172.21.15.82:0/188655758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0ccc06e580 con 0x7f0ccc06ea20 2024-06-02T22:53:13.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.100+0000 7f0cc8ff9640 1 -- 172.21.15.82:0/188655758 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f0cbc059090 con 0x7f0ccc06ea20 2024-06-02T22:53:13.100 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:53:13.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 -- 172.21.15.82:0/188655758 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0cb806be30 msgr2=0x7f0cb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:13.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0cb806be30 0x7f0cb806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0037000 tx=0x7f0cc0008040 comp rx=0 tx=0).stop 2024-06-02T22:53:13.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 -- 172.21.15.82:0/188655758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ccc06ea20 msgr2=0x7f0ccc15d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:13.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ccc06ea20 0x7f0ccc15d140 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00c7f0 tx=0x7f0cbc00cbf0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 -- 172.21.15.82:0/188655758 shutdown_connections 2024-06-02T22:53:13.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0cb806be30 0x7f0cb806e2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ccc0cf190 0x7f0ccc158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ccc0ae910 0x7f0ccc1504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 --2- 172.21.15.82:0/188655758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ccc06ea20 0x7f0ccc15d140 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 -- 172.21.15.82:0/188655758 >> 172.21.15.82:0/188655758 conn(0x7f0ccc0b19f0 msgr2=0x7f0ccc0728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:13.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 -- 172.21.15.82:0/188655758 shutdown_connections 2024-06-02T22:53:13.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.102+0000 7f0cd2716640 1 -- 172.21.15.82:0/188655758 wait complete. 2024-06-02T22:53:13.113 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:13.113 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:13.128 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:53:13.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.269+0000 7f3f40109640 1 Processor -- start 2024-06-02T22:53:13.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.269+0000 7f3f40109640 1 -- start start 2024-06-02T22:53:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.270+0000 7f3f40109640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3f3815e3e0 0x7f3f38072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.270+0000 7f3f40109640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f3806e1b0 0x7f3f3806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.270+0000 7f3f40109640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3f3806d910 0x7f3f380cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.270+0000 7f3f40109640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3f38071eb0 con 0x7f3f3806d910 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.270+0000 7f3f40109640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f3f38072e40 con 0x7f3f3815e3e0 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.270+0000 7f3f40109640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3806dd40 con 0x7f3f3806e1b0 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.270+0000 7f3f3e6a6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3f3806d910 0x7f3f380cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.270+0000 7f3f3e6a6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3f3806d910 0x7f3f380cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42194/0 (socket says 172.21.15.82:42194) 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.270+0000 7f3f3e6a6640 1 -- 172.21.15.82:0/3252626264 learned_addr learned my addr 172.21.15.82:0/3252626264 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.271+0000 7f3f3e6a6640 1 -- 172.21.15.82:0/3252626264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f3806e1b0 msgr2=0x7f3f3806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.271+0000 7f3f3e6a6640 1 --2- 172.21.15.82:0/3252626264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f3806e1b0 0x7f3f3806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.271+0000 7f3f3e6a6640 1 -- 172.21.15.82:0/3252626264 >> v2:172.21.15.184:3300/0 conn(0x7f3f3815e3e0 msgr2=0x7f3f38072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.271+0000 7f3f3dea5640 1 --2- 172.21.15.82:0/3252626264 >> v2:172.21.15.184:3300/0 conn(0x7f3f3815e3e0 0x7f3f38072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.271+0000 7f3f3e6a6640 1 --2- 172.21.15.82:0/3252626264 >> v2:172.21.15.184:3300/0 conn(0x7f3f3815e3e0 0x7f3f38072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.271+0000 7f3f3e6a6640 1 -- 172.21.15.82:0/3252626264 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f380af480 con 0x7f3f3806d910 2024-06-02T22:53:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.271+0000 7f3f3e6a6640 1 --2- 172.21.15.82:0/3252626264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f3806d910 0x7f3f380cdbf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3f38074070 tx=0x7f3f3002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c94eda538aa2a60 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f3cea3640 1 -- 172.21.15.82:0/3252626264 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30037070 con 0x7f3f3806d910 2024-06-02T22:53:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f3cea3640 1 -- 172.21.15.82:0/3252626264 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f30032440 con 0x7f3f3806d910 2024-06-02T22:53:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f3cea3640 1 -- 172.21.15.82:0/3252626264 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30032810 con 0x7f3f3806d910 2024-06-02T22:53:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f40109640 1 -- 172.21.15.82:0/3252626264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f3806d910 msgr2=0x7f3f380cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f40109640 1 --2- 172.21.15.82:0/3252626264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f3806d910 0x7f3f380cdbf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3f38074070 tx=0x7f3f3002a210 comp rx=0 tx=0).stop 2024-06-02T22:53:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f40109640 1 -- 172.21.15.82:0/3252626264 shutdown_connections 2024-06-02T22:53:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f40109640 1 --2- 172.21.15.82:0/3252626264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f3806d910 0x7f3f380cdbf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f40109640 1 --2- 172.21.15.82:0/3252626264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f3806e1b0 0x7f3f3806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f40109640 1 --2- 172.21.15.82:0/3252626264 >> v2:172.21.15.184:3300/0 conn(0x7f3f3815e3e0 0x7f3f38072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f40109640 1 -- 172.21.15.82:0/3252626264 >> 172.21.15.82:0/3252626264 conn(0x7f3f380b1bb0 msgr2=0x7f3f380b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f40109640 1 -- 172.21.15.82:0/3252626264 shutdown_connections 2024-06-02T22:53:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.272+0000 7f3f40109640 1 -- 172.21.15.82:0/3252626264 wait complete. 2024-06-02T22:53:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.273+0000 7f3f40109640 1 Processor -- start 2024-06-02T22:53:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.273+0000 7f3f40109640 1 -- start start 2024-06-02T22:53:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f40109640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f3806d910 0x7f3f3815d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f40109640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f3806e1b0 0x7f3f3815e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f40109640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f3815e3e0 0x7f3f380b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f40109640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3f380723e0 con 0x7f3f3806e1b0 2024-06-02T22:53:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f40109640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3f38072100 con 0x7f3f3815e3e0 2024-06-02T22:53:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f40109640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f3f380ce130 con 0x7f3f3806d910 2024-06-02T22:53:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f3d6a4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f3806e1b0 0x7f3f3815e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f3d6a4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f3806e1b0 0x7f3f3815e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42208/0 (socket says 172.21.15.82:42208) 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f3d6a4640 1 -- 172.21.15.82:0/4033164695 learned_addr learned my addr 172.21.15.82:0/4033164695 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f3d6a4640 1 -- 172.21.15.82:0/4033164695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f3806d910 msgr2=0x7f3f3815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f3dea5640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f3806d910 0x7f3f3815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f3d6a4640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f3806d910 0x7f3f3815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f3e6a6640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f3815e3e0 0x7f3f380b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.274+0000 7f3f3d6a4640 1 -- 172.21.15.82:0/4033164695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f3815e3e0 msgr2=0x7f3f380b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.275+0000 7f3f3d6a4640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f3815e3e0 0x7f3f380b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.275+0000 7f3f3d6a4640 1 -- 172.21.15.82:0/4033164695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f380c7cb0 con 0x7f3f3806e1b0 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.275+0000 7f3f3dea5640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f3806d910 0x7f3f3815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.275+0000 7f3f3e6a6640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f3815e3e0 0x7f3f380b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.275+0000 7f3f3d6a4640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f3806e1b0 0x7f3f3815e7c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b4a0 tx=0x7f3f2800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.275+0000 7f3f2e7fc640 1 -- 172.21.15.82:0/4033164695 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28014070 con 0x7f3f3806e1b0 2024-06-02T22:53:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.275+0000 7f3f2e7fc640 1 -- 172.21.15.82:0/4033164695 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f28010610 con 0x7f3f3806e1b0 2024-06-02T22:53:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.275+0000 7f3f40109640 1 -- 172.21.15.82:0/4033164695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3815f0c0 con 0x7f3f3806e1b0 2024-06-02T22:53:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.275+0000 7f3f2e7fc640 1 -- 172.21.15.82:0/4033164695 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28010a00 con 0x7f3f3806e1b0 2024-06-02T22:53:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.275+0000 7f3f40109640 1 -- 172.21.15.82:0/4033164695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f3815f680 con 0x7f3f3806e1b0 2024-06-02T22:53:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.276+0000 7f3f40109640 1 -- 172.21.15.82:0/4033164695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f38068430 con 0x7f3f3806e1b0 2024-06-02T22:53:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.276+0000 7f3f2e7fc640 1 -- 172.21.15.82:0/4033164695 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f28017070 con 0x7f3f3806e1b0 2024-06-02T22:53:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.277+0000 7f3f2e7fc640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3f1c06be30 0x7f3f1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.277+0000 7f3f3dea5640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3f1c06be30 0x7f3f1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.277+0000 7f3f2e7fc640 1 -- 172.21.15.82:0/4033164695 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f3f2808ab00 con 0x7f3f3806e1b0 2024-06-02T22:53:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.278+0000 7f3f3dea5640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3f1c06be30 0x7f3f1c06e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3f34007eb0 tx=0x7f3f34007400 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:13.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.281+0000 7f3f2e7fc640 1 -- 172.21.15.82:0/4033164695 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3f28059230 con 0x7f3f3806e1b0 2024-06-02T22:53:13.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.468+0000 7f3f40109640 1 -- 172.21.15.82:0/4033164695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3f3815db40 con 0x7f3f3806e1b0 2024-06-02T22:53:13.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.468+0000 7f3f2e7fc640 1 -- 172.21.15.82:0/4033164695 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f3f28058b30 con 0x7f3f3806e1b0 2024-06-02T22:53:13.468 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:53:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 -- 172.21.15.82:0/4033164695 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3f1c06be30 msgr2=0x7f3f1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3f1c06be30 0x7f3f1c06e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3f34007eb0 tx=0x7f3f34007400 comp rx=0 tx=0).stop 2024-06-02T22:53:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 -- 172.21.15.82:0/4033164695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f3806e1b0 msgr2=0x7f3f3815e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f3806e1b0 0x7f3f3815e7c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b4a0 tx=0x7f3f2800b960 comp rx=0 tx=0).stop 2024-06-02T22:53:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 -- 172.21.15.82:0/4033164695 shutdown_connections 2024-06-02T22:53:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3f1c06be30 0x7f3f1c06e2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f3815e3e0 0x7f3f380b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f3806e1b0 0x7f3f3815e7c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 --2- 172.21.15.82:0/4033164695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f3806d910 0x7f3f3815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:13.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 -- 172.21.15.82:0/4033164695 >> 172.21.15.82:0/4033164695 conn(0x7f3f380b1bb0 msgr2=0x7f3f380b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:13.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 -- 172.21.15.82:0/4033164695 shutdown_connections 2024-06-02T22:53:13.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:13.470+0000 7f3f40109640 1 -- 172.21.15.82:0/4033164695 wait complete. 2024-06-02T22:53:13.481 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-06-02T22:53:13.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:13.481 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:13.504 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[50918]: fuse finished with error 0 and tester_r 0 2024-06-02T22:53:13.505 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:53:19.607 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:53:19.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:19.608 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T22:53:19.627 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T22:53:19.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.778+0000 7f8adb777640 1 Processor -- start 2024-06-02T22:53:19.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.778+0000 7f8adb777640 1 -- start start 2024-06-02T22:53:19.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8adb777640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 0x7f8ad4165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:19.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8adb777640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad406d130 con 0x7f8ad406ebf0 2024-06-02T22:53:19.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8adb777640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad406d410 con 0x7f8ad40ae910 2024-06-02T22:53:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8adb777640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad406d6f0 con 0x7f8ad40add50 2024-06-02T22:53:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8ad8d12640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8ad406ebf0 0x7f8ad40cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33706/0 (socket says 172.21.15.82:33706) 2024-06-02T22:53:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8ad8d12640 1 -- 172.21.15.82:0/1875995198 learned_addr learned my addr 172.21.15.82:0/1875995198 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8ad9d14640 1 --2- 172.21.15.82:0/1875995198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 0x7f8ad4165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8acbfff640 1 -- 172.21.15.82:0/1875995198 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786817965 0 0) 0x7f8ad406d130 con 0x7f8ad406ebf0 2024-06-02T22:53:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8acbfff640 1 -- 172.21.15.82:0/1875995198 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac0003520 con 0x7f8ad406ebf0 2024-06-02T22:53:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8acbfff640 1 -- 172.21.15.82:0/1875995198 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1696163669 0 0) 0x7f8ad406d410 con 0x7f8ad40ae910 2024-06-02T22:53:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8ad9d14640 1 -- 172.21.15.82:0/1875995198 >> v1:172.21.15.184:6789/0 conn(0x7f8ad40ae910 legacy=0x7f8ad406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8ad9d14640 1 -- 172.21.15.82:0/1875995198 >> v1:172.21.15.82:6789/0 conn(0x7f8ad406ebf0 legacy=0x7f8ad40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.779+0000 7f8ad9d14640 1 -- 172.21.15.82:0/1875995198 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad406d9d0 con 0x7f8ad40add50 2024-06-02T22:53:19.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.780+0000 7f8ad9d14640 1 --2- 172.21.15.82:0/1875995198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 0x7f8ad4165c30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009dc0 tx=0x7f8acc02a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc162bedb6e64aeb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:19.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.780+0000 7f8acbfff640 1 -- 172.21.15.82:0/1875995198 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc035020 con 0x7f8ad40add50 2024-06-02T22:53:19.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.780+0000 7f8acbfff640 1 -- 172.21.15.82:0/1875995198 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8acc007540 con 0x7f8ad40add50 2024-06-02T22:53:19.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.780+0000 7f8acbfff640 1 -- 172.21.15.82:0/1875995198 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4001670 con 0x7f8ad40add50 2024-06-02T22:53:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.781+0000 7f8adb777640 1 -- 172.21.15.82:0/1875995198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 msgr2=0x7f8ad4165c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.781+0000 7f8adb777640 1 --2- 172.21.15.82:0/1875995198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 0x7f8ad4165c30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009dc0 tx=0x7f8acc02a5b0 comp rx=0 tx=0).stop 2024-06-02T22:53:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.781+0000 7f8adb777640 1 -- 172.21.15.82:0/1875995198 shutdown_connections 2024-06-02T22:53:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.781+0000 7f8adb777640 1 --2- 172.21.15.82:0/1875995198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 0x7f8ad4165c30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.781+0000 7f8adb777640 1 -- 172.21.15.82:0/1875995198 >> 172.21.15.82:0/1875995198 conn(0x7f8ad40b19f0 msgr2=0x7f8ad40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.781+0000 7f8adb777640 1 -- 172.21.15.82:0/1875995198 shutdown_connections 2024-06-02T22:53:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.781+0000 7f8adb777640 1 -- 172.21.15.82:0/1875995198 wait complete. 2024-06-02T22:53:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.782+0000 7f8adb777640 1 Processor -- start 2024-06-02T22:53:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.782+0000 7f8adb777640 1 -- start start 2024-06-02T22:53:19.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8adb777640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad406ebf0 0x7f8ad409cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:19.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8adb777640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 0x7f8ad41588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:19.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8adb777640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad40ae910 0x7f8ad40c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:19.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8adb777640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad40cf4e0 con 0x7f8ad406ebf0 2024-06-02T22:53:19.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8adb777640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad40cf360 con 0x7f8ad40ae910 2024-06-02T22:53:19.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8adb777640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad40cf660 con 0x7f8ad40add50 2024-06-02T22:53:19.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad9513640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad406ebf0 0x7f8ad409cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:19.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad9513640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad406ebf0 0x7f8ad409cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42222/0 (socket says 172.21.15.82:42222) 2024-06-02T22:53:19.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad9513640 1 -- 172.21.15.82:0/3622902246 learned_addr learned my addr 172.21.15.82:0/3622902246 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:19.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad8d12640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 0x7f8ad41588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:19.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad9d14640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad40ae910 0x7f8ad40c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:19.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad9513640 1 -- 172.21.15.82:0/3622902246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 msgr2=0x7f8ad41588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad9513640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 0x7f8ad41588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad9513640 1 -- 172.21.15.82:0/3622902246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad40ae910 msgr2=0x7f8ad40c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad9513640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad40ae910 0x7f8ad40c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad9513640 1 -- 172.21.15.82:0/3622902246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad40c5bb0 con 0x7f8ad406ebf0 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad8d12640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 0x7f8ad41588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.783+0000 7f8ad9d14640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad40ae910 0x7f8ad40c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.784+0000 7f8ad9513640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad406ebf0 0x7f8ad409cfb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000c4b0 tx=0x7f8ad000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.784+0000 7f8ac9ffb640 1 -- 172.21.15.82:0/3622902246 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0017070 con 0x7f8ad406ebf0 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.784+0000 7f8ac9ffb640 1 -- 172.21.15.82:0/3622902246 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad0005480 con 0x7f8ad406ebf0 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.784+0000 7f8adb777640 1 -- 172.21.15.82:0/3622902246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad40c5e50 con 0x7f8ad406ebf0 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.784+0000 7f8ac9ffb640 1 -- 172.21.15.82:0/3622902246 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0003830 con 0x7f8ad406ebf0 2024-06-02T22:53:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.784+0000 7f8adb777640 1 -- 172.21.15.82:0/3622902246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad40c6410 con 0x7f8ad406ebf0 2024-06-02T22:53:19.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.785+0000 7f8adb777640 1 -- 172.21.15.82:0/3622902246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad40b45e0 con 0x7f8ad406ebf0 2024-06-02T22:53:19.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.785+0000 7f8ac9ffb640 1 -- 172.21.15.82:0/3622902246 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ad001a070 con 0x7f8ad406ebf0 2024-06-02T22:53:19.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.786+0000 7f8ac9ffb640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ab806be30 0x7f8ab806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:19.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.786+0000 7f8ac9ffb640 1 -- 172.21.15.82:0/3622902246 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f8ad008a5f0 con 0x7f8ad406ebf0 2024-06-02T22:53:19.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.786+0000 7f8ad8d12640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ab806be30 0x7f8ab806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:19.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.786+0000 7f8ad8d12640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ab806be30 0x7f8ab806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40017e0 tx=0x7f8ac4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:19.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:19.790+0000 7f8ac9ffb640 1 -- 172.21.15.82:0/3622902246 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8ad40b45e0 con 0x7f8ad406ebf0 2024-06-02T22:53:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.003+0000 7f8adb777640 1 -- 172.21.15.82:0/3622902246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8ad4068430 con 0x7f8ad406ebf0 2024-06-02T22:53:20.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.003+0000 7f8ac9ffb640 1 -- 172.21.15.82:0/3622902246 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+82 (secure 0 0 0) 0x7f8ad0077070 con 0x7f8ad406ebf0 2024-06-02T22:53:20.003 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-06-02T22:53:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 -- 172.21.15.82:0/3622902246 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ab806be30 msgr2=0x7f8ab806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ab806be30 0x7f8ab806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40017e0 tx=0x7f8ac4009040 comp rx=0 tx=0).stop 2024-06-02T22:53:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 -- 172.21.15.82:0/3622902246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad406ebf0 msgr2=0x7f8ad409cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad406ebf0 0x7f8ad409cfb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000c4b0 tx=0x7f8ad000c970 comp rx=0 tx=0).stop 2024-06-02T22:53:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 -- 172.21.15.82:0/3622902246 shutdown_connections 2024-06-02T22:53:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ab806be30 0x7f8ab806e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad40ae910 0x7f8ad40c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ad40add50 0x7f8ad41588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 --2- 172.21.15.82:0/3622902246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ad406ebf0 0x7f8ad409cfb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 -- 172.21.15.82:0/3622902246 >> 172.21.15.82:0/3622902246 conn(0x7f8ad40b19f0 msgr2=0x7f8ad40747a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 -- 172.21.15.82:0/3622902246 shutdown_connections 2024-06-02T22:53:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20.005+0000 7f8adb777640 1 -- 172.21.15.82:0/3622902246 wait complete. 2024-06-02T22:53:20.016 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T22:53:20.016 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:53:20.016 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-06-02T22:53:20.016 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T22:53:20.016 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:20.016 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T22:53:20.016 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:53:20.017 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:53:20.017 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:20.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:20.017 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-06-02T22:53:20.033 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:53:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:53:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:53:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-02T22:53:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42698sec preferred_lft 42698sec 2024-06-02T22:53:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::6847:90ff:fe09:5afd/64 scope link 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 7e:10:3a:74:07:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::7c10:3aff:fe74:7cf/64 scope link 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:53:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:20.036 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::103e:51ff:fe43:acf3/64 scope link 2024-06-02T22:53:20.036 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:20.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:20.036 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:53:20.096 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-06-02T22:53:20.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:20.098 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-06-02T22:53:20.155 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-06-02T22:53:20.155 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:53:20.155 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T22:53:20.155 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T22:53:20.155 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:53:20.155 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:53:20.155 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:53:20.155 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T22:53:20.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T22:53:20.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T22:53:20.156 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:53:20.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:53:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:53:20.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:20.281 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-02T22:53:20.296 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T22:53:20.296 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T22:53:20.296 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:20.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:20.296 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-06-02T22:53:20.361 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-02T22:53:20.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:53:20.361 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:20.417 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:20.417 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:53:20.417 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:20.472 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:53:20.538 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:53:20.594 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:53:20.594 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:53:20.594 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:53:20.594 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:53:20.595 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:53:20.595 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:53:20.595 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:53:20.595 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:53:20.595 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:53:20.595 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:53:20.595 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:53:20.595 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:53:20.595 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:53:20.595 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:53:20.596 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:53:20.597 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:53:20.597 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:53:20.597 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:53:20.597 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:20.597 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:20.597 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:20.597 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:20.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:20.597 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:53:20.650 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T22:53:20.650 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-02T22:53:20.693 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:53:20.717 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:53:20.774 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2024-06-02T22:53:20.774+0000 7fb0b8f65480 -1 init, newargv = 0x5587a85dc520 newargc=15 2024-06-02T22:53:20.775 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[51733]: starting ceph client 2024-06-02T22:53:20.775 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:53:20.775 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:53:20.775 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:53:20.776 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:53:20.777 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:53:20.778 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:20.778 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:20.778 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:20.778 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:20.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:20.778 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:53:20.779 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[51733]: starting fuse 2024-06-02T22:53:20.794 INFO:teuthology.orchestra.run.smithi082.stdout:40 2024-06-02T22:53:20.794 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T22:53:20.794 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:53:20.794 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-06-02T22:53:20.794 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-06-02T22:53:20.794 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:53:20.795 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:53:20.796 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:53:20.796 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-06-02T22:53:20.796 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-06-02T22:53:20.796 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-06-02T22:53:20.796 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:53:20.796 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:20.796 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2024-06-02T22:53:20.796 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-06-02T22:53:20.912 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.51733.asok 2024-06-02T22:53:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:53:20.923 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51733.asok 2024-06-02T22:53:20.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:20.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51733.asok status 2024-06-02T22:53:21.058 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:53:21.058 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-06-02T22:53:21.058 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:53:21.058 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:53:21.058 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2024-06-02T22:53:21.058 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-06-02T22:53:21.059 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-02T22:53:21.059 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "51733", 2024-06-02T22:53:21.059 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-06-02T22:53:21.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:21.059 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-06-02T22:53:21.059 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-06-02T22:53:21.059 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5211, 2024-06-02T22:53:21.059 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-06-02T22:53:21.059 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-06-02T22:53:21.062 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-06-02T22:53:21.062 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 5211 2024-06-02T22:53:21.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:21.062 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 600162736 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 600162736 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.5211 192.168.0.1:0/600162736", 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/600162736", 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-06-02T22:53:21.063 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 17, 2024-06-02T22:53:21.064 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 41, 2024-06-02T22:53:21.064 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:53:21.064 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-06-02T22:53:21.064 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-06-02T22:53:21.064 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:53:21.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:21.067 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-06-02T22:53:21.067 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:21.083 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-06-02T22:53:21.083 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:21.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:21.083 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:21.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:21.149 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-06-02T22:53:21.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:53:21.206 INFO:teuthology.orchestra.run.smithi082.stderr:setfattr: layoutfile: Permission denied 2024-06-02T22:53:21.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:21.207 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-06-02T22:53:21.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:53:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:setfattr: layoutdir: Permission denied 2024-06-02T22:53:21.267 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:21.267 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:21.323 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:53:21.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.463+0000 7f077eecd640 1 Processor -- start 2024-06-02T22:53:21.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.463+0000 7f077eecd640 1 -- start start 2024-06-02T22:53:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.463+0000 7f077eecd640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f077815a870 0x7f077806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.463+0000 7f077eecd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07780aef70 0x7f07780b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.463+0000 7f077eecd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07780af3d0 0x7f07780b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.463+0000 7f077eecd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f07780b4fe0 con 0x7f07780aef70 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.463+0000 7f077eecd640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f077806e390 con 0x7f077815a870 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.463+0000 7f077eecd640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f077815ac50 con 0x7f07780af3d0 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.464+0000 7f0777fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07780aef70 0x7f07780b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.464+0000 7f0777fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07780aef70 0x7f07780b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49888/0 (socket says 172.21.15.82:49888) 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.464+0000 7f0777fff640 1 -- 172.21.15.82:0/489753325 learned_addr learned my addr 172.21.15.82:0/489753325 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.464+0000 7f077d46a640 1 --2- 172.21.15.82:0/489753325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07780af3d0 0x7f07780b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.464+0000 7f077cc69640 1 --2- 172.21.15.82:0/489753325 >> v2:172.21.15.184:3300/0 conn(0x7f077815a870 0x7f077806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.464+0000 7f0777fff640 1 -- 172.21.15.82:0/489753325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07780af3d0 msgr2=0x7f07780b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.464+0000 7f0777fff640 1 --2- 172.21.15.82:0/489753325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07780af3d0 0x7f07780b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.464+0000 7f0777fff640 1 -- 172.21.15.82:0/489753325 >> v2:172.21.15.184:3300/0 conn(0x7f077815a870 msgr2=0x7f077806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.464+0000 7f0777fff640 1 --2- 172.21.15.82:0/489753325 >> v2:172.21.15.184:3300/0 conn(0x7f077815a870 0x7f077806de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.464+0000 7f0777fff640 1 -- 172.21.15.82:0/489753325 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077806cdb0 con 0x7f07780aef70 2024-06-02T22:53:21.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.464+0000 7f077d46a640 1 --2- 172.21.15.82:0/489753325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07780af3d0 0x7f07780b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:21.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f0777fff640 1 --2- 172.21.15.82:0/489753325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aef70 0x7f07780b4560 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0778075030 tx=0x7f076402c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcd10df40eafa08 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:21.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f07777fe640 1 -- 172.21.15.82:0/489753325 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764032700 con 0x7f07780aef70 2024-06-02T22:53:21.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f07777fe640 1 -- 172.21.15.82:0/489753325 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07640328a0 con 0x7f07780aef70 2024-06-02T22:53:21.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f07777fe640 1 -- 172.21.15.82:0/489753325 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764032c70 con 0x7f07780aef70 2024-06-02T22:53:21.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f077eecd640 1 -- 172.21.15.82:0/489753325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aef70 msgr2=0x7f07780b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f077eecd640 1 --2- 172.21.15.82:0/489753325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aef70 0x7f07780b4560 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0778075030 tx=0x7f076402c800 comp rx=0 tx=0).stop 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f077eecd640 1 -- 172.21.15.82:0/489753325 shutdown_connections 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f077eecd640 1 --2- 172.21.15.82:0/489753325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07780af3d0 0x7f07780b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f077eecd640 1 --2- 172.21.15.82:0/489753325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07780aef70 0x7f07780b4560 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f077eecd640 1 --2- 172.21.15.82:0/489753325 >> v2:172.21.15.184:3300/0 conn(0x7f077815a870 0x7f077806de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f077eecd640 1 -- 172.21.15.82:0/489753325 >> 172.21.15.82:0/489753325 conn(0x7f07780b19f0 msgr2=0x7f07780b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f077eecd640 1 -- 172.21.15.82:0/489753325 shutdown_connections 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.465+0000 7f077eecd640 1 -- 172.21.15.82:0/489753325 wait complete. 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.467+0000 7f077eecd640 1 Processor -- start 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.467+0000 7f077eecd640 1 -- start start 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.467+0000 7f077eecd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07780aef70 0x7f07781efa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.467+0000 7f077eecd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07780af3d0 0x7f077814cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.467+0000 7f077eecd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077815a870 0x7f077814d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077eecd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f077806d650 con 0x7f077815a870 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077eecd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f077806d370 con 0x7f07780aef70 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077eecd640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f077806d930 con 0x7f07780af3d0 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077d46a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077815a870 0x7f077814d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077d46a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077815a870 0x7f077814d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49894/0 (socket says 172.21.15.82:49894) 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077d46a640 1 -- 172.21.15.82:0/1430004759 learned_addr learned my addr 172.21.15.82:0/1430004759 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077cc69640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07780aef70 0x7f07781efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f0777fff640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07780af3d0 0x7f077814cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077d46a640 1 -- 172.21.15.82:0/1430004759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07780af3d0 msgr2=0x7f077814cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077d46a640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07780af3d0 0x7f077814cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077d46a640 1 -- 172.21.15.82:0/1430004759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07780aef70 msgr2=0x7f07781efa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077d46a640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07780aef70 0x7f07781efa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077d46a640 1 -- 172.21.15.82:0/1430004759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07780adcc0 con 0x7f077815a870 2024-06-02T22:53:21.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077d46a640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077815a870 0x7f077814d0b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f077000cd10 tx=0x7f077000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:21.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f07757fa640 1 -- 172.21.15.82:0/1430004759 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077000f680 con 0x7f077815a870 2024-06-02T22:53:21.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f07757fa640 1 -- 172.21.15.82:0/1430004759 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f077000f840 con 0x7f077815a870 2024-06-02T22:53:21.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077eecd640 1 -- 172.21.15.82:0/1430004759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07780adfa0 con 0x7f077815a870 2024-06-02T22:53:21.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f07757fa640 1 -- 172.21.15.82:0/1430004759 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077000fc30 con 0x7f077815a870 2024-06-02T22:53:21.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.468+0000 7f077eecd640 1 -- 172.21.15.82:0/1430004759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07780ae560 con 0x7f077815a870 2024-06-02T22:53:21.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.469+0000 7f077eecd640 1 -- 172.21.15.82:0/1430004759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0778068430 con 0x7f077815a870 2024-06-02T22:53:21.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.470+0000 7f07757fa640 1 -- 172.21.15.82:0/1430004759 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07700213f0 con 0x7f077815a870 2024-06-02T22:53:21.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.470+0000 7f07757fa640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f075c06be30 0x7f075c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.470+0000 7f07757fa640 1 -- 172.21.15.82:0/1430004759 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f077008bdc0 con 0x7f077815a870 2024-06-02T22:53:21.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.470+0000 7f077cc69640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f075c06be30 0x7f075c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.471+0000 7f077cc69640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f075c06be30 0x7f075c06e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f076c00aac0 tx=0x7f076c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:21.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.474+0000 7f07757fa640 1 -- 172.21.15.82:0/1430004759 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0770014030 con 0x7f077815a870 2024-06-02T22:53:21.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.661+0000 7f077eecd640 1 -- 172.21.15.82:0/1430004759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f07780b2650 con 0x7f077815a870 2024-06-02T22:53:21.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.661+0000 7f07757fa640 1 -- 172.21.15.82:0/1430004759 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f0770059e10 con 0x7f077815a870 2024-06-02T22:53:21.661 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:53:21.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 -- 172.21.15.82:0/1430004759 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f075c06be30 msgr2=0x7f075c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:21.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f075c06be30 0x7f075c06e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f076c00aac0 tx=0x7f076c008040 comp rx=0 tx=0).stop 2024-06-02T22:53:21.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 -- 172.21.15.82:0/1430004759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077815a870 msgr2=0x7f077814d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:21.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077815a870 0x7f077814d0b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f077000cd10 tx=0x7f077000a650 comp rx=0 tx=0).stop 2024-06-02T22:53:21.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 -- 172.21.15.82:0/1430004759 shutdown_connections 2024-06-02T22:53:21.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f075c06be30 0x7f075c06e2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f077815a870 0x7f077814d0b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f07780af3d0 0x7f077814cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 --2- 172.21.15.82:0/1430004759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07780aef70 0x7f07781efa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 -- 172.21.15.82:0/1430004759 >> 172.21.15.82:0/1430004759 conn(0x7f07780b19f0 msgr2=0x7f07780cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:21.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 -- 172.21.15.82:0/1430004759 shutdown_connections 2024-06-02T22:53:21.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.663+0000 7f077eecd640 1 -- 172.21.15.82:0/1430004759 wait complete. 2024-06-02T22:53:21.674 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:21.675 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:21.692 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:53:21.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.833+0000 7fdadb1c8640 1 Processor -- start 2024-06-02T22:53:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.833+0000 7fdadb1c8640 1 -- start start 2024-06-02T22:53:21.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.833+0000 7fdadb1c8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdad415f1a0 0x7fdad40d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdadb1c8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdad415f5e0 con 0x7fdad40d2680 2024-06-02T22:53:21.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdadb1c8640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdad40d0ad0 con 0x7fdad40cef70 2024-06-02T22:53:21.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdadb1c8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdad40d13e0 con 0x7fdad415f1a0 2024-06-02T22:53:21.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdad8f64640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdad40d2680 0x7fdad40d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38116/0 (socket says 172.21.15.82:38116) 2024-06-02T22:53:21.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdad8f64640 1 -- 172.21.15.82:0/3674108061 learned_addr learned my addr 172.21.15.82:0/3674108061 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:21.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdad3fff640 1 --2- 172.21.15.82:0/3674108061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdad415f1a0 0x7fdad40d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdad37fe640 1 -- 172.21.15.82:0/3674108061 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3377457507 0 0) 0x7fdad415f5e0 con 0x7fdad40d2680 2024-06-02T22:53:21.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdad37fe640 1 -- 172.21.15.82:0/3674108061 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdac4003520 con 0x7fdad40d2680 2024-06-02T22:53:21.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdad37fe640 1 -- 172.21.15.82:0/3674108061 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 142580704 0 0) 0x7fdad40d0ad0 con 0x7fdad40cef70 2024-06-02T22:53:21.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdad37fe640 1 -- 172.21.15.82:0/3674108061 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdad415f5e0 con 0x7fdad40cef70 2024-06-02T22:53:21.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdad3fff640 1 -- 172.21.15.82:0/3674108061 >> v1:172.21.15.184:6789/0 conn(0x7fdad40cef70 legacy=0x7fdad40cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:21.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdad3fff640 1 -- 172.21.15.82:0/3674108061 >> v1:172.21.15.82:6789/0 conn(0x7fdad40d2680 legacy=0x7fdad40d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:21.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.834+0000 7fdad3fff640 1 -- 172.21.15.82:0/3674108061 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad415f890 con 0x7fdad415f1a0 2024-06-02T22:53:21.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.835+0000 7fdad3fff640 1 --2- 172.21.15.82:0/3674108061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdad415f1a0 0x7fdad40d1fc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdac00097d0 tx=0x7fdac002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81dd3beabf9ea209 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:21.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.835+0000 7fdad37fe640 1 -- 172.21.15.82:0/3674108061 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0037070 con 0x7fdad415f1a0 2024-06-02T22:53:21.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.835+0000 7fdad37fe640 1 -- 172.21.15.82:0/3674108061 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac0032440 con 0x7fdad415f1a0 2024-06-02T22:53:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.835+0000 7fdad37fe640 1 -- 172.21.15.82:0/3674108061 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac00327f0 con 0x7fdad415f1a0 2024-06-02T22:53:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.836+0000 7fdadb1c8640 1 -- 172.21.15.82:0/3674108061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdad415f1a0 msgr2=0x7fdad40d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.836+0000 7fdadb1c8640 1 --2- 172.21.15.82:0/3674108061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdad415f1a0 0x7fdad40d1fc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdac00097d0 tx=0x7fdac002a200 comp rx=0 tx=0).stop 2024-06-02T22:53:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.836+0000 7fdadb1c8640 1 -- 172.21.15.82:0/3674108061 shutdown_connections 2024-06-02T22:53:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.836+0000 7fdadb1c8640 1 --2- 172.21.15.82:0/3674108061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdad415f1a0 0x7fdad40d1fc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.836+0000 7fdadb1c8640 1 -- 172.21.15.82:0/3674108061 >> 172.21.15.82:0/3674108061 conn(0x7fdad409d3f0 msgr2=0x7fdad40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.836+0000 7fdadb1c8640 1 -- 172.21.15.82:0/3674108061 shutdown_connections 2024-06-02T22:53:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.836+0000 7fdadb1c8640 1 -- 172.21.15.82:0/3674108061 wait complete. 2024-06-02T22:53:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.837+0000 7fdadb1c8640 1 Processor -- start 2024-06-02T22:53:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.837+0000 7fdadb1c8640 1 -- start start 2024-06-02T22:53:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.838+0000 7fdadb1c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdad40cef70 0x7fdad415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.838+0000 7fdadb1c8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdad40d2680 0x7fdad40c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.838+0000 7fdadb1c8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdad415f1a0 0x7fdad40c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.838+0000 7fdadb1c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdad40d4f00 con 0x7fdad40cef70 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.838+0000 7fdadb1c8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdad40d1070 con 0x7fdad415f1a0 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.838+0000 7fdadb1c8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdad40d1870 con 0x7fdad40d2680 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.838+0000 7fdad8f64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdad40cef70 0x7fdad415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.838+0000 7fdad8f64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdad40cef70 0x7fdad415a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49906/0 (socket says 172.21.15.82:49906) 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.838+0000 7fdad8f64640 1 -- 172.21.15.82:0/1358926127 learned_addr learned my addr 172.21.15.82:0/1358926127 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.838+0000 7fdad3fff640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdad40d2680 0x7fdad40c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdad9765640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdad415f1a0 0x7fdad40c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdad8f64640 1 -- 172.21.15.82:0/1358926127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdad40d2680 msgr2=0x7fdad40c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdad8f64640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdad40d2680 0x7fdad40c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdad8f64640 1 -- 172.21.15.82:0/1358926127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdad415f1a0 msgr2=0x7fdad40c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdad8f64640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdad415f1a0 0x7fdad40c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdad8f64640 1 -- 172.21.15.82:0/1358926127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad415c3f0 con 0x7fdad40cef70 2024-06-02T22:53:21.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdad8f64640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdad40cef70 0x7fdad415a0e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdac800c500 tx=0x7fdac800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:21.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdad17fa640 1 -- 172.21.15.82:0/1358926127 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8017070 con 0x7fdad40cef70 2024-06-02T22:53:21.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdad17fa640 1 -- 172.21.15.82:0/1358926127 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac8005ce0 con 0x7fdad40cef70 2024-06-02T22:53:21.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdadb1c8640 1 -- 172.21.15.82:0/1358926127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad415c690 con 0x7fdad40cef70 2024-06-02T22:53:21.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdad17fa640 1 -- 172.21.15.82:0/1358926127 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac80072f0 con 0x7fdad40cef70 2024-06-02T22:53:21.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.839+0000 7fdadb1c8640 1 -- 172.21.15.82:0/1358926127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad415cc50 con 0x7fdad40cef70 2024-06-02T22:53:21.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.840+0000 7fdadb1c8640 1 -- 172.21.15.82:0/1358926127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad4068430 con 0x7fdad40cef70 2024-06-02T22:53:21.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.841+0000 7fdad17fa640 1 -- 172.21.15.82:0/1358926127 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdac801a070 con 0x7fdad40cef70 2024-06-02T22:53:21.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.841+0000 7fdad17fa640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdab806be30 0x7fdab806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:21.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.841+0000 7fdad17fa640 1 -- 172.21.15.82:0/1358926127 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fdac808a410 con 0x7fdad40cef70 2024-06-02T22:53:21.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.841+0000 7fdad3fff640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdab806be30 0x7fdab806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:21.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.842+0000 7fdad3fff640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdab806be30 0x7fdab806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdac0034000 tx=0x7fdac002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:21.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:21.846+0000 7fdad17fa640 1 -- 172.21.15.82:0/1358926127 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdac80584f0 con 0x7fdad40cef70 2024-06-02T22:53:22.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.033+0000 7fdadb1c8640 1 -- 172.21.15.82:0/1358926127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdad40d04e0 con 0x7fdad40cef70 2024-06-02T22:53:22.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.033+0000 7fdad17fa640 1 -- 172.21.15.82:0/1358926127 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7fdac805c7f0 con 0x7fdad40cef70 2024-06-02T22:53:22.033 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:53:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 -- 172.21.15.82:0/1358926127 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdab806be30 msgr2=0x7fdab806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdab806be30 0x7fdab806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdac0034000 tx=0x7fdac002e000 comp rx=0 tx=0).stop 2024-06-02T22:53:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 -- 172.21.15.82:0/1358926127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdad40cef70 msgr2=0x7fdad415a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdad40cef70 0x7fdad415a0e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdac800c500 tx=0x7fdac800c9c0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 -- 172.21.15.82:0/1358926127 shutdown_connections 2024-06-02T22:53:22.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdab806be30 0x7fdab806e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdad415f1a0 0x7fdad40c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdad40d2680 0x7fdad40c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 --2- 172.21.15.82:0/1358926127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdad40cef70 0x7fdad415a0e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 -- 172.21.15.82:0/1358926127 >> 172.21.15.82:0/1358926127 conn(0x7fdad409d3f0 msgr2=0x7fdad406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:22.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 -- 172.21.15.82:0/1358926127 shutdown_connections 2024-06-02T22:53:22.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.035+0000 7fdadb1c8640 1 -- 172.21.15.82:0/1358926127 wait complete. 2024-06-02T22:53:22.046 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-06-02T22:53:22.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:22.046 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:22.069 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[51733]: fuse finished with error 0 and tester_r 0 2024-06-02T22:53:22.071 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:53:22.164 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:53:22.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:22.164 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T22:53:22.180 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-06-02T22:53:22.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.327+0000 7fc0b6714640 1 Processor -- start 2024-06-02T22:53:22.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.327+0000 7fc0b6714640 1 -- start start 2024-06-02T22:53:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.327+0000 7fc0b6714640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b01589e0 0x7fc0b015f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.327+0000 7fc0b6714640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0b00d06e0 0x7fc0b00ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.327+0000 7fc0b6714640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b0158dc0 con 0x7fc0b015ea40 2024-06-02T22:53:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.327+0000 7fc0b6714640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b00721b0 con 0x7fc0b00d06e0 2024-06-02T22:53:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.327+0000 7fc0b6714640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b0072490 con 0x7fc0b01589e0 2024-06-02T22:53:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.328+0000 7fc0b4cb1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0b00d06e0 0x7fc0b00ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.328+0000 7fc0af7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc0b015ea40 0x7fc0b00cffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38118/0 (socket says 172.21.15.82:38118) 2024-06-02T22:53:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.328+0000 7fc0af7fe640 1 -- 172.21.15.82:0/2450606482 learned_addr learned my addr 172.21.15.82:0/2450606482 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.328+0000 7fc0affff640 1 --2- 172.21.15.82:0/2450606482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b01589e0 0x7fc0b015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.328+0000 7fc0b4cb1640 1 -- 172.21.15.82:0/2450606482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b01589e0 msgr2=0x7fc0b015f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.328+0000 7fc0b4cb1640 1 --2- 172.21.15.82:0/2450606482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b01589e0 0x7fc0b015f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.328+0000 7fc0b4cb1640 1 -- 172.21.15.82:0/2450606482 >> v1:172.21.15.82:6789/0 conn(0x7fc0b015ea40 legacy=0x7fc0b00cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.328+0000 7fc0aeffd640 1 -- 172.21.15.82:0/2450606482 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 329845080 0 0) 0x7fc0b0158dc0 con 0x7fc0b015ea40 2024-06-02T22:53:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.328+0000 7fc0b4cb1640 1 -- 172.21.15.82:0/2450606482 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b0072770 con 0x7fc0b00d06e0 2024-06-02T22:53:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.328+0000 7fc0affff640 1 --2- 172.21.15.82:0/2450606482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b01589e0 0x7fc0b015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0b4cb1640 1 --2- 172.21.15.82:0/2450606482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b00d06e0 0x7fc0b00ad690 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009d90 tx=0x7fc0a802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2e1c8b5bf066ee server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0aeffd640 1 -- 172.21.15.82:0/2450606482 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8007740 con 0x7fc0b00d06e0 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0aeffd640 1 -- 172.21.15.82:0/2450606482 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a80078e0 con 0x7fc0b00d06e0 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0aeffd640 1 -- 172.21.15.82:0/2450606482 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8007cb0 con 0x7fc0b00d06e0 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0b6714640 1 -- 172.21.15.82:0/2450606482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b00d06e0 msgr2=0x7fc0b00ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0b6714640 1 --2- 172.21.15.82:0/2450606482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b00d06e0 0x7fc0b00ad690 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009d90 tx=0x7fc0a802a660 comp rx=0 tx=0).stop 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0b6714640 1 -- 172.21.15.82:0/2450606482 shutdown_connections 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0b6714640 1 --2- 172.21.15.82:0/2450606482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b00d06e0 0x7fc0b00ad690 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0b6714640 1 --2- 172.21.15.82:0/2450606482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b01589e0 0x7fc0b015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0b6714640 1 -- 172.21.15.82:0/2450606482 >> 172.21.15.82:0/2450606482 conn(0x7fc0b006b7e0 msgr2=0x7fc0b006bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0b6714640 1 -- 172.21.15.82:0/2450606482 shutdown_connections 2024-06-02T22:53:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.329+0000 7fc0b6714640 1 -- 172.21.15.82:0/2450606482 wait complete. 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.330+0000 7fc0b6714640 1 Processor -- start 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.331+0000 7fc0b6714640 1 -- start start 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.331+0000 7fc0b6714640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b00d06e0 0x7fc0b014e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.331+0000 7fc0b6714640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b01589e0 0x7fc0b009c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.331+0000 7fc0b6714640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b015ea40 0x7fc0b009c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.331+0000 7fc0b6714640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b015f7b0 con 0x7fc0b01589e0 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.331+0000 7fc0b6714640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b0072d30 con 0x7fc0b00d06e0 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.331+0000 7fc0b6714640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b0073250 con 0x7fc0b015ea40 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.331+0000 7fc0af7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b01589e0 0x7fc0b009c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.331+0000 7fc0af7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b01589e0 0x7fc0b009c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49920/0 (socket says 172.21.15.82:49920) 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.331+0000 7fc0af7fe640 1 -- 172.21.15.82:0/4226195938 learned_addr learned my addr 172.21.15.82:0/4226195938 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0b4cb1640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b015ea40 0x7fc0b009c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0affff640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b00d06e0 0x7fc0b014e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0af7fe640 1 -- 172.21.15.82:0/4226195938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b015ea40 msgr2=0x7fc0b009c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0af7fe640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b015ea40 0x7fc0b009c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0af7fe640 1 -- 172.21.15.82:0/4226195938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b00d06e0 msgr2=0x7fc0b014e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0af7fe640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b00d06e0 0x7fc0b014e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0af7fe640 1 -- 172.21.15.82:0/4226195938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b014ec60 con 0x7fc0b01589e0 2024-06-02T22:53:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0af7fe640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b01589e0 0x7fc0b009c350 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c430 tx=0x7fc0a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0acff9640 1 -- 172.21.15.82:0/4226195938 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40074e0 con 0x7fc0b01589e0 2024-06-02T22:53:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0acff9640 1 -- 172.21.15.82:0/4226195938 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a40047e0 con 0x7fc0b01589e0 2024-06-02T22:53:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0b6714640 1 -- 172.21.15.82:0/4226195938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b009cef0 con 0x7fc0b01589e0 2024-06-02T22:53:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0acff9640 1 -- 172.21.15.82:0/4226195938 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4004bd0 con 0x7fc0b01589e0 2024-06-02T22:53:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.332+0000 7fc0b6714640 1 -- 172.21.15.82:0/4226195938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b009d4b0 con 0x7fc0b01589e0 2024-06-02T22:53:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.333+0000 7fc0b6714640 1 -- 172.21.15.82:0/4226195938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b00683c0 con 0x7fc0b01589e0 2024-06-02T22:53:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.333+0000 7fc0acff9640 1 -- 172.21.15.82:0/4226195938 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0a4011070 con 0x7fc0b01589e0 2024-06-02T22:53:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.334+0000 7fc0acff9640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc09c06be30 0x7fc09c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.334+0000 7fc0acff9640 1 -- 172.21.15.82:0/4226195938 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fc0a408ad50 con 0x7fc0b01589e0 2024-06-02T22:53:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.334+0000 7fc0affff640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc09c06be30 0x7fc09c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.334+0000 7fc0affff640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc09c06be30 0x7fc09c06e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0b009dc40 tx=0x7fc0a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:22.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.338+0000 7fc0acff9640 1 -- 172.21.15.82:0/4226195938 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc0a408e030 con 0x7fc0b01589e0 2024-06-02T22:53:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.575+0000 7fc0b6714640 1 -- 172.21.15.82:0/4226195938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) -- 0x7fc0b015f300 con 0x7fc0b01589e0 2024-06-02T22:53:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.577+0000 7fc0acff9640 1 -- 172.21.15.82:0/4226195938 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v11) ==== 211+0+168 (secure 0 0 0) 0x7fc0b014ec60 con 0x7fc0b01589e0 2024-06-02T22:53:22.577 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-06-02T22:53:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g== 2024-06-02T22:53:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow rwp" 2024-06-02T22:53:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2024-06-02T22:53:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-06-02T22:53:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2024-06-02T22:53:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 -- 172.21.15.82:0/4226195938 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc09c06be30 msgr2=0x7fc09c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc09c06be30 0x7fc09c06e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0b009dc40 tx=0x7fc0a0008040 comp rx=0 tx=0).stop 2024-06-02T22:53:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 -- 172.21.15.82:0/4226195938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b01589e0 msgr2=0x7fc0b009c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b01589e0 0x7fc0b009c350 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c430 tx=0x7fc0a400c8f0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 -- 172.21.15.82:0/4226195938 shutdown_connections 2024-06-02T22:53:22.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc09c06be30 0x7fc09c06e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b015ea40 0x7fc0b009c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b01589e0 0x7fc0b009c350 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 --2- 172.21.15.82:0/4226195938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b00d06e0 0x7fc0b014e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 -- 172.21.15.82:0/4226195938 >> 172.21.15.82:0/4226195938 conn(0x7fc0b006b7e0 msgr2=0x7fc0b006e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:22.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 -- 172.21.15.82:0/4226195938 shutdown_connections 2024-06-02T22:53:22.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.579+0000 7fc0b6714640 1 -- 172.21.15.82:0/4226195938 wait complete. 2024-06-02T22:53:22.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T22:53:22.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.690+0000 7f0f6c5e9640 1 Processor -- start 2024-06-02T22:53:22.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.691+0000 7f0f6c5e9640 1 -- start start 2024-06-02T22:53:22.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.691+0000 7f0f6c5e9640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0f640d2680 0x7f0f6415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.691+0000 7f0f6c5e9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f640d0ad0 con 0x7f0f640cef70 2024-06-02T22:53:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.691+0000 7f0f6c5e9640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6415f890 con 0x7f0f640d1fc0 2024-06-02T22:53:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.691+0000 7f0f6c5e9640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f0f640d13e0 con 0x7f0f640d2680 2024-06-02T22:53:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f6ab86640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0f640cef70 0x7f0f640cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38134/0 (socket says 172.21.15.82:38134) 2024-06-02T22:53:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f6ab86640 1 -- 172.21.15.82:0/2911727831 learned_addr learned my addr 172.21.15.82:0/2911727831 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f6a385640 1 --2- 172.21.15.82:0/2911727831 >> v2:172.21.15.184:3300/0 conn(0x7f0f640d2680 0x7f0f6415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290225639 0 0) 0x7f0f640d0ad0 con 0x7f0f640cef70 2024-06-02T22:53:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f50003520 con 0x7f0f640cef70 2024-06-02T22:53:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461022228 0 0) 0x7f0f6415f890 con 0x7f0f640d1fc0 2024-06-02T22:53:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f640d0ad0 con 0x7f0f640d1fc0 2024-06-02T22:53:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 471847214 0 0) 0x7f0f50003520 con 0x7f0f640cef70 2024-06-02T22:53:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 >> v2:172.21.15.184:3300/0 conn(0x7f0f640d2680 msgr2=0x7f0f6415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 --2- 172.21.15.82:0/2911727831 >> v2:172.21.15.184:3300/0 conn(0x7f0f640d2680 0x7f0f6415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 >> v1:172.21.15.184:6789/0 conn(0x7f0f640d1fc0 legacy=0x7f0f640d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f640d0d90 con 0x7f0f640cef70 2024-06-02T22:53:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f0f5c0019f0 con 0x7f0f640cef70 2024-06-02T22:53:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 >> v1:172.21.15.82:6789/0 conn(0x7f0f640cef70 legacy=0x7f0f640cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 --2- 172.21.15.82:0/2911727831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50003b40 0x7f0f50003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 --2- 172.21.15.82:0/2911727831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f50004800 0x7f0f50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 --2- 172.21.15.82:0/2911727831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f500051c0 0x7f0f5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640d13e0 con 0x7f0f50003b40 2024-06-02T22:53:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5000c060 con 0x7f0f50004800 2024-06-02T22:53:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5000c260 con 0x7f0f500051c0 2024-06-02T22:53:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.692+0000 7f0f6a385640 1 --2- 172.21.15.82:0/2911727831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50003b40 0x7f0f50003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.693+0000 7f0f6a385640 1 -- 172.21.15.82:0/2911727831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f500051c0 msgr2=0x7f0f5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.693+0000 7f0f6a385640 1 --2- 172.21.15.82:0/2911727831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f500051c0 0x7f0f5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.693+0000 7f0f6a385640 1 -- 172.21.15.82:0/2911727831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f50004800 msgr2=0x7f0f50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.693+0000 7f0f6a385640 1 --2- 172.21.15.82:0/2911727831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f50004800 0x7f0f50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.693+0000 7f0f6a385640 1 -- 172.21.15.82:0/2911727831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f50003520 con 0x7f0f50003b40 2024-06-02T22:53:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.693+0000 7f0f6ab86640 1 -- 172.21.15.82:0/2911727831 reap_dead start 2024-06-02T22:53:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.693+0000 7f0f6a385640 1 --2- 172.21.15.82:0/2911727831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50003b40 0x7f0f50003f60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009ac0 tx=0x7f0f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a2f4ef1a73e090 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.693+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54036070 con 0x7f0f50003b40 2024-06-02T22:53:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.693+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f54031400 con 0x7f0f50003b40 2024-06-02T22:53:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.693+0000 7f0f69383640 1 -- 172.21.15.82:0/2911727831 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54009690 con 0x7f0f50003b40 2024-06-02T22:53:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.694+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/2911727831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50003b40 msgr2=0x7f0f50003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.694+0000 7f0f6c5e9640 1 --2- 172.21.15.82:0/2911727831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50003b40 0x7f0f50003f60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009ac0 tx=0x7f0f50005830 comp rx=0 tx=0).stop 2024-06-02T22:53:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.694+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/2911727831 shutdown_connections 2024-06-02T22:53:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.694+0000 7f0f6c5e9640 1 --2- 172.21.15.82:0/2911727831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50003b40 0x7f0f50003f60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.694+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/2911727831 >> 172.21.15.82:0/2911727831 conn(0x7f0f6409d3f0 msgr2=0x7f0f640d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.694+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/2911727831 shutdown_connections 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.694+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/2911727831 wait complete. 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.695+0000 7f0f6c5e9640 1 Processor -- start 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.695+0000 7f0f6c5e9640 1 -- start start 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f6c5e9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f50003b40 0x7f0f6415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f6c5e9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f641f4340 0x7f0f640cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f6c5e9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f640cd370 0x7f0f641f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f6c5e9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640d4f00 con 0x7f0f641f4340 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f6c5e9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640d2400 con 0x7f0f50003b40 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f6c5e9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f0f640d1870 con 0x7f0f640cd370 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f69b84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f641f4340 0x7f0f640cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f69b84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f641f4340 0x7f0f640cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49942/0 (socket says 172.21.15.82:49942) 2024-06-02T22:53:22.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f69b84640 1 -- 172.21.15.82:0/1283686278 learned_addr learned my addr 172.21.15.82:0/1283686278 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:22.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f6ab86640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f640cd370 0x7f0f641f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f6a385640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f50003b40 0x7f0f6415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f69b84640 1 -- 172.21.15.82:0/1283686278 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f640cd370 msgr2=0x7f0f641f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f69b84640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f640cd370 0x7f0f641f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f69b84640 1 -- 172.21.15.82:0/1283686278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f50003b40 msgr2=0x7f0f6415bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f69b84640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f50003b40 0x7f0f6415bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f69b84640 1 -- 172.21.15.82:0/1283686278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f641f8c80 con 0x7f0f641f4340 2024-06-02T22:53:22.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f6a385640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f50003b40 0x7f0f6415bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:22.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.696+0000 7f0f69b84640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f641f4340 0x7f0f640cce30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000c730 tx=0x7f0f6000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:22.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.697+0000 7f0f5affd640 1 -- 172.21.15.82:0/1283686278 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f600052d0 con 0x7f0f641f4340 2024-06-02T22:53:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.697+0000 7f0f5affd640 1 -- 172.21.15.82:0/1283686278 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f60005490 con 0x7f0f641f4340 2024-06-02T22:53:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.697+0000 7f0f5affd640 1 -- 172.21.15.82:0/1283686278 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60003830 con 0x7f0f641f4340 2024-06-02T22:53:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.697+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/1283686278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f641f8f60 con 0x7f0f641f4340 2024-06-02T22:53:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.697+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/1283686278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6415b740 con 0x7f0f641f4340 2024-06-02T22:53:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.697+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/1283686278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f64073620 con 0x7f0f641f4340 2024-06-02T22:53:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.698+0000 7f0f5affd640 1 -- 172.21.15.82:0/1283686278 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f600039d0 con 0x7f0f641f4340 2024-06-02T22:53:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.698+0000 7f0f5affd640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f4806be30 0x7f0f4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.698+0000 7f0f5affd640 1 -- 172.21.15.82:0/1283686278 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f0f6008ae20 con 0x7f0f641f4340 2024-06-02T22:53:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.699+0000 7f0f6a385640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f4806be30 0x7f0f4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.699+0000 7f0f6a385640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f4806be30 0x7f0f4806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f54033000 tx=0x7f0f54008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:22.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.703+0000 7f0f5affd640 1 -- 172.21.15.82:0/1283686278 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0f64073620 con 0x7f0f641f4340 2024-06-02T22:53:22.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.917+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/1283686278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0f640b9fc0 con 0x7f0f641f4340 2024-06-02T22:53:22.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.917+0000 7f0f5affd640 1 -- 172.21.15.82:0/1283686278 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+82 (secure 0 0 0) 0x7f0f640b9fc0 con 0x7f0f641f4340 2024-06-02T22:53:22.917 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-06-02T22:53:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.919+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/1283686278 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f4806be30 msgr2=0x7f0f4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.919+0000 7f0f6c5e9640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f4806be30 0x7f0f4806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f54033000 tx=0x7f0f54008030 comp rx=0 tx=0).stop 2024-06-02T22:53:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.919+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/1283686278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f641f4340 msgr2=0x7f0f640cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.919+0000 7f0f6c5e9640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f641f4340 0x7f0f640cce30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000c730 tx=0x7f0f6000cbf0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.919+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/1283686278 shutdown_connections 2024-06-02T22:53:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.919+0000 7f0f6c5e9640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f0f4806be30 0x7f0f4806e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.919+0000 7f0f6c5e9640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f640cd370 0x7f0f641f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.919+0000 7f0f6c5e9640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f641f4340 0x7f0f640cce30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.919+0000 7f0f6c5e9640 1 --2- 172.21.15.82:0/1283686278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f50003b40 0x7f0f6415bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.919+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/1283686278 >> 172.21.15.82:0/1283686278 conn(0x7f0f6409d3f0 msgr2=0x7f0f640b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.920+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/1283686278 shutdown_connections 2024-06-02T22:53:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:22.920+0000 7f0f6c5e9640 1 -- 172.21.15.82:0/1283686278 wait complete. 2024-06-02T22:53:22.931 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T22:53:22.931 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:53:22.931 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-06-02T22:53:22.931 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T22:53:22.931 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:22.932 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T22:53:22.932 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:53:22.932 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:53:22.932 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:22.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:22.933 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-06-02T22:53:22.949 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:53:22.949 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:53:22.949 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:53:22.949 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:22.949 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-02T22:53:22.949 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:22.949 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:22.950 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:22.950 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-06-02T22:53:22.950 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:22.950 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:22.950 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-06-02T22:53:22.950 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:22.950 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:22.950 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:53:22.950 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:22.950 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42695sec preferred_lft 42695sec 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::6847:90ff:fe09:5afd/64 scope link 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 7e:10:3a:74:07:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::7c10:3aff:fe74:7cf/64 scope link 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:22.951 INFO:teuthology.orchestra.run.smithi082.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:53:22.952 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:22.952 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::103e:51ff:fe43:acf3/64 scope link 2024-06-02T22:53:22.952 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:22.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:22.952 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:53:23.013 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-06-02T22:53:23.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:23.015 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-06-02T22:53:23.070 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-06-02T22:53:23.071 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:53:23.071 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T22:53:23.071 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T22:53:23.071 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:53:23.071 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:53:23.071 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:53:23.072 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T22:53:23.072 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T22:53:23.072 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T22:53:23.072 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:53:23.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:53:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:53:23.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:23.197 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-02T22:53:23.213 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T22:53:23.213 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T22:53:23.213 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:23.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:23.213 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-06-02T22:53:23.278 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-02T22:53:23.278 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:53:23.279 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:23.333 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:23.334 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:53:23.334 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:23.388 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:53:23.453 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:53:23.510 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:53:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:53:23.512 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:53:23.513 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:53:23.513 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:53:23.513 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:53:23.513 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:23.513 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:23.513 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:23.513 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:23.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:23.514 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:53:23.566 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T22:53:23.566 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-02T22:53:23.609 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:53:23.634 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:53:23.690 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:53:23.690 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:53:23.690 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:53:23.690 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:53:23.690 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:53:23.690 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:53:23.690 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:53:23.690 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:53:23.690 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:53:23.690 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:53:23.690 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:53:23.691 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:53:23.692 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:53:23.692 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:53:23.692 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:53:23.692 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:53:23.692 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:53:23.692 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:53:23.692 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:23.692 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:23.692 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:23.692 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:23.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:23.693 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:53:23.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2024-06-02T22:53:23.691+0000 7fdc98fe3480 -1 init, newargv = 0x55e4040b44e0 newargc=15 2024-06-02T22:53:23.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[52377]: starting ceph client 2024-06-02T22:53:23.696 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[52377]: starting fuse 2024-06-02T22:53:23.710 INFO:teuthology.orchestra.run.smithi082.stdout:40 2024-06-02T22:53:23.711 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T22:53:23.711 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:53:23.711 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-06-02T22:53:23.711 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-06-02T22:53:23.711 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-06-02T22:53:23.711 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-06-02T22:53:23.711 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:23.711 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-06-02T22:53:23.711 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-06-02T22:53:23.712 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-06-02T22:53:23.713 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-06-02T22:53:23.713 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:53:23.713 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:23.713 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2024-06-02T22:53:23.713 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-06-02T22:53:23.829 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.52377.asok 2024-06-02T22:53:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:53:23.840 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52377.asok 2024-06-02T22:53:23.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:23.840 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52377.asok status 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "52377", 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5244, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 5244 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3014771153 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3014771153 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.5244 192.168.0.1:0/3014771153", 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/3014771153", 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 17, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 41, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:53:23.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:23.984 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-06-02T22:53:23.984 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:23.999 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-06-02T22:53:24.000 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:24.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:24.000 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:24.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:24.065 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-06-02T22:53:24.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:24.124 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-06-02T22:53:24.183 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:24.183 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:24.240 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:53:24.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.380+0000 7f1a81fee640 1 Processor -- start 2024-06-02T22:53:24.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.380+0000 7f1a81fee640 1 -- start start 2024-06-02T22:53:24.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a81fee640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a7c0cc6d0 0x7f1a7c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a81fee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a7c071c60 0x7f1a7c0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a81fee640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7c0ccff0 con 0x7f1a7c0b36c0 2024-06-02T22:53:24.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a81fee640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7c072820 con 0x7f1a7c0cc6d0 2024-06-02T22:53:24.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a81fee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7c072b00 con 0x7f1a7c071c60 2024-06-02T22:53:24.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a7b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a7c0cc6d0 0x7f1a7c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:24.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a7bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1a7c0b36c0 0x7f1a7c0b3b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38140/0 (socket says 172.21.15.82:38140) 2024-06-02T22:53:24.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a7bfff640 1 -- 172.21.15.82:0/2851697547 learned_addr learned my addr 172.21.15.82:0/2851697547 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:24.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a7affd640 1 --2- 172.21.15.82:0/2851697547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a7c071c60 0x7f1a7c0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:24.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a7b7fe640 1 -- 172.21.15.82:0/2851697547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a7c071c60 msgr2=0x7f1a7c0720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:24.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a7b7fe640 1 --2- 172.21.15.82:0/2851697547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a7c071c60 0x7f1a7c0720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a7b7fe640 1 -- 172.21.15.82:0/2851697547 >> v1:172.21.15.82:6789/0 conn(0x7f1a7c0b36c0 legacy=0x7f1a7c0b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:24.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a7b7fe640 1 -- 172.21.15.82:0/2851697547 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c072de0 con 0x7f1a7c0cc6d0 2024-06-02T22:53:24.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a7a7fc640 1 -- 172.21.15.82:0/2851697547 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776462360 0 0) 0x7f1a7c0ccff0 con 0x7f1a7c0b36c0 2024-06-02T22:53:24.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.381+0000 7f1a7affd640 1 --2- 172.21.15.82:0/2851697547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a7c071c60 0x7f1a7c0720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:24.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.382+0000 7f1a7b7fe640 1 --2- 172.21.15.82:0/2851697547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7c0cc6d0 0x7f1a7c0ccab0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0097a0 tx=0x7f1a6c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c885d692f3809dab server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:24.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.382+0000 7f1a7a7fc640 1 -- 172.21.15.82:0/2851697547 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c037070 con 0x7f1a7c0cc6d0 2024-06-02T22:53:24.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.382+0000 7f1a7a7fc640 1 -- 172.21.15.82:0/2851697547 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6c032440 con 0x7f1a7c0cc6d0 2024-06-02T22:53:24.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.382+0000 7f1a7a7fc640 1 -- 172.21.15.82:0/2851697547 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c032810 con 0x7f1a7c0cc6d0 2024-06-02T22:53:24.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.383+0000 7f1a81fee640 1 -- 172.21.15.82:0/2851697547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7c0cc6d0 msgr2=0x7f1a7c0ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:24.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.383+0000 7f1a81fee640 1 --2- 172.21.15.82:0/2851697547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7c0cc6d0 0x7f1a7c0ccab0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0097a0 tx=0x7f1a6c02a180 comp rx=0 tx=0).stop 2024-06-02T22:53:24.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.383+0000 7f1a81fee640 1 -- 172.21.15.82:0/2851697547 shutdown_connections 2024-06-02T22:53:24.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.383+0000 7f1a81fee640 1 --2- 172.21.15.82:0/2851697547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a7c071c60 0x7f1a7c0720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.383+0000 7f1a81fee640 1 --2- 172.21.15.82:0/2851697547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7c0cc6d0 0x7f1a7c0ccab0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.383+0000 7f1a81fee640 1 -- 172.21.15.82:0/2851697547 >> 172.21.15.82:0/2851697547 conn(0x7f1a7c0b19f0 msgr2=0x7f1a7c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.383+0000 7f1a81fee640 1 -- 172.21.15.82:0/2851697547 shutdown_connections 2024-06-02T22:53:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.383+0000 7f1a81fee640 1 -- 172.21.15.82:0/2851697547 wait complete. 2024-06-02T22:53:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.384+0000 7f1a81fee640 1 Processor -- start 2024-06-02T22:53:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.384+0000 7f1a81fee640 1 -- start start 2024-06-02T22:53:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a81fee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7c071c60 0x7f1a7c14b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a81fee640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a7c0b36c0 0x7f1a7c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a81fee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a7c0cc6d0 0x7f1a7c1f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a81fee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c159f60 con 0x7f1a7c071c60 2024-06-02T22:53:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a81fee640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c15c890 con 0x7f1a7c0b36c0 2024-06-02T22:53:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a81fee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7c0b4240 con 0x7f1a7c0cc6d0 2024-06-02T22:53:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a7b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7c071c60 0x7f1a7c14b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a7b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7c071c60 0x7f1a7c14b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49948/0 (socket says 172.21.15.82:49948) 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a7b7fe640 1 -- 172.21.15.82:0/2836565917 learned_addr learned my addr 172.21.15.82:0/2836565917 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a7b7fe640 1 -- 172.21.15.82:0/2836565917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a7c0cc6d0 msgr2=0x7f1a7c1f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a7b7fe640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a7c0cc6d0 0x7f1a7c1f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a7b7fe640 1 -- 172.21.15.82:0/2836565917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a7c0b36c0 msgr2=0x7f1a7c156060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a7b7fe640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a7c0b36c0 0x7f1a7c156060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.385+0000 7f1a7b7fe640 1 -- 172.21.15.82:0/2836565917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c1565a0 con 0x7f1a7c071c60 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.386+0000 7f1a7b7fe640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7c071c60 0x7f1a7c14b090 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0098c0 tx=0x7f1a6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.386+0000 7f1a63fff640 1 -- 172.21.15.82:0/2836565917 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c037040 con 0x7f1a7c071c60 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.386+0000 7f1a63fff640 1 -- 172.21.15.82:0/2836565917 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6c030770 con 0x7f1a7c071c60 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.386+0000 7f1a81fee640 1 -- 172.21.15.82:0/2836565917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7c09d910 con 0x7f1a7c071c60 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.386+0000 7f1a63fff640 1 -- 172.21.15.82:0/2836565917 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c030b40 con 0x7f1a7c071c60 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.386+0000 7f1a81fee640 1 -- 172.21.15.82:0/2836565917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a7c09afa0 con 0x7f1a7c071c60 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.387+0000 7f1a81fee640 1 -- 172.21.15.82:0/2836565917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a7c068430 con 0x7f1a7c071c60 2024-06-02T22:53:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.387+0000 7f1a63fff640 1 -- 172.21.15.82:0/2836565917 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a6c044020 con 0x7f1a7c071c60 2024-06-02T22:53:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.388+0000 7f1a63fff640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1a6806be30 0x7f1a6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.388+0000 7f1a63fff640 1 -- 172.21.15.82:0/2836565917 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f1a6c0ab670 con 0x7f1a7c071c60 2024-06-02T22:53:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.388+0000 7f1a7affd640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1a6806be30 0x7f1a6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.388+0000 7f1a7affd640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1a6806be30 0x7f1a6806e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c1f4b50 tx=0x7f1a70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.392+0000 7f1a63fff640 1 -- 172.21.15.82:0/2836565917 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1a6c032e20 con 0x7f1a7c071c60 2024-06-02T22:53:24.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.578+0000 7f1a81fee640 1 -- 172.21.15.82:0/2836565917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1a7c075430 con 0x7f1a7c071c60 2024-06-02T22:53:24.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.578+0000 7f1a63fff640 1 -- 172.21.15.82:0/2836565917 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f1a6c079da0 con 0x7f1a7c071c60 2024-06-02T22:53:24.579 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:53:24.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.580+0000 7f1a81fee640 1 -- 172.21.15.82:0/2836565917 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1a6806be30 msgr2=0x7f1a6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.580+0000 7f1a81fee640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1a6806be30 0x7f1a6806e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c1f4b50 tx=0x7f1a70008040 comp rx=0 tx=0).stop 2024-06-02T22:53:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.580+0000 7f1a81fee640 1 -- 172.21.15.82:0/2836565917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7c071c60 msgr2=0x7f1a7c14b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.580+0000 7f1a81fee640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7c071c60 0x7f1a7c14b090 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0098c0 tx=0x7f1a6c0046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.580+0000 7f1a81fee640 1 -- 172.21.15.82:0/2836565917 shutdown_connections 2024-06-02T22:53:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.580+0000 7f1a81fee640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f1a6806be30 0x7f1a6806e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.580+0000 7f1a81fee640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a7c0cc6d0 0x7f1a7c1f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.580+0000 7f1a81fee640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a7c0b36c0 0x7f1a7c156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.580+0000 7f1a81fee640 1 --2- 172.21.15.82:0/2836565917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a7c071c60 0x7f1a7c14b090 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.580+0000 7f1a81fee640 1 -- 172.21.15.82:0/2836565917 >> 172.21.15.82:0/2836565917 conn(0x7f1a7c0b19f0 msgr2=0x7f1a7c15c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.581+0000 7f1a81fee640 1 -- 172.21.15.82:0/2836565917 shutdown_connections 2024-06-02T22:53:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.581+0000 7f1a81fee640 1 -- 172.21.15.82:0/2836565917 wait complete. 2024-06-02T22:53:24.591 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:24.591 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:24.607 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:53:24.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.748+0000 7fc429942640 1 Processor -- start 2024-06-02T22:53:24.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.748+0000 7fc429942640 1 -- start start 2024-06-02T22:53:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc429942640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc42415a870 0x7fc42406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc429942640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4240aef70 0x7fc4240b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc429942640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc4240af3d0 0x7fc4240b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc429942640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc4240b4fe0 con 0x7fc42415a870 2024-06-02T22:53:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc429942640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fc42406e390 con 0x7fc4240af3d0 2024-06-02T22:53:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc429942640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc42415ac50 con 0x7fc4240aef70 2024-06-02T22:53:24.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc422ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc42415a870 0x7fc42406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc422ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc42415a870 0x7fc42406de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49958/0 (socket says 172.21.15.82:49958) 2024-06-02T22:53:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc422ffd640 1 -- 172.21.15.82:0/1828407303 learned_addr learned my addr 172.21.15.82:0/1828407303 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc422ffd640 1 -- 172.21.15.82:0/1828407303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4240aef70 msgr2=0x7fc4240b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc422ffd640 1 --2- 172.21.15.82:0/1828407303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4240aef70 0x7fc4240b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc422ffd640 1 -- 172.21.15.82:0/1828407303 >> v2:172.21.15.184:3300/0 conn(0x7fc4240af3d0 msgr2=0x7fc4240b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc422ffd640 1 --2- 172.21.15.82:0/1828407303 >> v2:172.21.15.184:3300/0 conn(0x7fc4240af3d0 0x7fc4240b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.749+0000 7fc422ffd640 1 -- 172.21.15.82:0/1828407303 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42406cdb0 con 0x7fc42415a870 2024-06-02T22:53:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.750+0000 7fc422ffd640 1 --2- 172.21.15.82:0/1828407303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42415a870 0x7fc42406de50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4240cd970 tx=0x7fc41402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb67f1c05ccc23b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.750+0000 7fc421ffb640 1 -- 172.21.15.82:0/1828407303 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414037070 con 0x7fc42415a870 2024-06-02T22:53:24.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.750+0000 7fc421ffb640 1 -- 172.21.15.82:0/1828407303 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc414032440 con 0x7fc42415a870 2024-06-02T22:53:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.750+0000 7fc421ffb640 1 -- 172.21.15.82:0/1828407303 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414032810 con 0x7fc42415a870 2024-06-02T22:53:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.751+0000 7fc429942640 1 -- 172.21.15.82:0/1828407303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42415a870 msgr2=0x7fc42406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.751+0000 7fc429942640 1 --2- 172.21.15.82:0/1828407303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42415a870 0x7fc42406de50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4240cd970 tx=0x7fc41402a140 comp rx=0 tx=0).stop 2024-06-02T22:53:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.751+0000 7fc429942640 1 -- 172.21.15.82:0/1828407303 shutdown_connections 2024-06-02T22:53:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.751+0000 7fc429942640 1 --2- 172.21.15.82:0/1828407303 >> v2:172.21.15.184:3300/0 conn(0x7fc4240af3d0 0x7fc4240b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.751+0000 7fc429942640 1 --2- 172.21.15.82:0/1828407303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4240aef70 0x7fc4240b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.751+0000 7fc429942640 1 --2- 172.21.15.82:0/1828407303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc42415a870 0x7fc42406de50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.751+0000 7fc429942640 1 -- 172.21.15.82:0/1828407303 >> 172.21.15.82:0/1828407303 conn(0x7fc4240b19f0 msgr2=0x7fc4240b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.751+0000 7fc429942640 1 -- 172.21.15.82:0/1828407303 shutdown_connections 2024-06-02T22:53:24.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.751+0000 7fc429942640 1 -- 172.21.15.82:0/1828407303 wait complete. 2024-06-02T22:53:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.752+0000 7fc429942640 1 Processor -- start 2024-06-02T22:53:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.752+0000 7fc429942640 1 -- start start 2024-06-02T22:53:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc429942640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4240aef70 0x7fc42415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc429942640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4240af3d0 0x7fc424146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc429942640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc42415a870 0x7fc424148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc429942640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc42406d650 con 0x7fc4240af3d0 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc429942640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc42406d370 con 0x7fc42415a870 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc429942640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc42406d930 con 0x7fc4240aef70 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc4227fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4240af3d0 0x7fc424146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc4227fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4240af3d0 0x7fc424146730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49968/0 (socket says 172.21.15.82:49968) 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc4227fc640 1 -- 172.21.15.82:0/4194007463 learned_addr learned my addr 172.21.15.82:0/4194007463 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc4237fe640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc42415a870 0x7fc424148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc422ffd640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4240aef70 0x7fc42415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc4227fc640 1 -- 172.21.15.82:0/4194007463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4240aef70 msgr2=0x7fc42415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc4227fc640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4240aef70 0x7fc42415d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc4227fc640 1 -- 172.21.15.82:0/4194007463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc42415a870 msgr2=0x7fc424148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc4227fc640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc42415a870 0x7fc424148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc4227fc640 1 -- 172.21.15.82:0/4194007463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc424146c70 con 0x7fc4240af3d0 2024-06-02T22:53:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.753+0000 7fc4237fe640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc42415a870 0x7fc424148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.754+0000 7fc4227fc640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4240af3d0 0x7fc424146730 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00ba50 tx=0x7fc40c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.754+0000 7fc41bfff640 1 -- 172.21.15.82:0/4194007463 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c019070 con 0x7fc4240af3d0 2024-06-02T22:53:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.754+0000 7fc41bfff640 1 -- 172.21.15.82:0/4194007463 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40c00cba0 con 0x7fc4240af3d0 2024-06-02T22:53:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.754+0000 7fc41bfff640 1 -- 172.21.15.82:0/4194007463 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c014440 con 0x7fc4240af3d0 2024-06-02T22:53:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.754+0000 7fc429942640 1 -- 172.21.15.82:0/4194007463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42415da20 con 0x7fc4240af3d0 2024-06-02T22:53:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.754+0000 7fc429942640 1 -- 172.21.15.82:0/4194007463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4240adbd0 con 0x7fc4240af3d0 2024-06-02T22:53:24.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.755+0000 7fc429942640 1 -- 172.21.15.82:0/4194007463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4240ad700 con 0x7fc4240af3d0 2024-06-02T22:53:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.755+0000 7fc41bfff640 1 -- 172.21.15.82:0/4194007463 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc40c01c070 con 0x7fc4240af3d0 2024-06-02T22:53:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.756+0000 7fc41bfff640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40406be30 0x7fc40406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.756+0000 7fc41bfff640 1 -- 172.21.15.82:0/4194007463 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fc40c08aea0 con 0x7fc4240af3d0 2024-06-02T22:53:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.756+0000 7fc422ffd640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40406be30 0x7fc40406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:24.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.756+0000 7fc422ffd640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40406be30 0x7fc40406e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc414034000 tx=0x7fc41402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:24.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.760+0000 7fc41bfff640 1 -- 172.21.15.82:0/4194007463 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc40c059540 con 0x7fc4240af3d0 2024-06-02T22:53:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.948+0000 7fc429942640 1 -- 172.21.15.82:0/4194007463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc424068430 con 0x7fc4240af3d0 2024-06-02T22:53:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.948+0000 7fc41bfff640 1 -- 172.21.15.82:0/4194007463 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7fc40c058e40 con 0x7fc4240af3d0 2024-06-02T22:53:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:53:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 -- 172.21.15.82:0/4194007463 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40406be30 msgr2=0x7fc40406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40406be30 0x7fc40406e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc414034000 tx=0x7fc41402e000 comp rx=0 tx=0).stop 2024-06-02T22:53:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 -- 172.21.15.82:0/4194007463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4240af3d0 msgr2=0x7fc424146730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4240af3d0 0x7fc424146730 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00ba50 tx=0x7fc40c00bf10 comp rx=0 tx=0).stop 2024-06-02T22:53:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 -- 172.21.15.82:0/4194007463 shutdown_connections 2024-06-02T22:53:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc40406be30 0x7fc40406e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc42415a870 0x7fc424148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4240af3d0 0x7fc424146730 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 --2- 172.21.15.82:0/4194007463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4240aef70 0x7fc42415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 -- 172.21.15.82:0/4194007463 >> 172.21.15.82:0/4194007463 conn(0x7fc4240b19f0 msgr2=0x7fc4240ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 -- 172.21.15.82:0/4194007463 shutdown_connections 2024-06-02T22:53:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:24.950+0000 7fc429942640 1 -- 172.21.15.82:0/4194007463 wait complete. 2024-06-02T22:53:24.960 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-06-02T22:53:24.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:24.961 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:24.983 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[52377]: fuse finished with error 0 and tester_r 0 2024-06-02T22:53:24.985 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:53:25.080 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:53:25.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:25.080 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T22:53:25.096 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-06-02T22:53:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.244+0000 7f4e7f4f5640 1 Processor -- start 2024-06-02T22:53:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.244+0000 7f4e7f4f5640 1 -- start start 2024-06-02T22:53:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.245+0000 7f4e7f4f5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e780d11f0 0x7f4e780d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.245+0000 7f4e7f4f5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e780cf9a0 con 0x7f4e7815e1c0 2024-06-02T22:53:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.245+0000 7f4e7f4f5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e780cfc70 con 0x7f4e780b2f60 2024-06-02T22:53:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.245+0000 7f4e7f4f5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4e780cff50 con 0x7f4e780d11f0 2024-06-02T22:53:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.245+0000 7f4e7d291640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4e7815e1c0 0x7f4e780d0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38152/0 (socket says 172.21.15.82:38152) 2024-06-02T22:53:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.245+0000 7f4e7d291640 1 -- 172.21.15.82:0/3141503201 learned_addr learned my addr 172.21.15.82:0/3141503201 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e7ca90640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e780d11f0 0x7f4e780d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1784054950 0 0) 0x7f4e780cf9a0 con 0x7f4e7815e1c0 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e60003520 con 0x7f4e7815e1c0 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3877079748 0 0) 0x7f4e60003520 con 0x7f4e7815e1c0 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e780d11f0 msgr2=0x7f4e780d4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e780d11f0 0x7f4e780d4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 >> v1:172.21.15.184:6789/0 conn(0x7f4e780b2f60 legacy=0x7f4e780d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e780d0230 con 0x7f4e7815e1c0 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f4e680019f0 con 0x7f4e7815e1c0 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 >> v1:172.21.15.82:6789/0 conn(0x7f4e7815e1c0 legacy=0x7f4e780d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e780d11f0 0x7f4e600039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e60003f20 0x7f4e60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 0x7f4e600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780cff50 con 0x7f4e60004d40 2024-06-02T22:53:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6000ba20 con 0x7f4e60003f20 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6000bc20 con 0x7f4e780d11f0 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e7da92640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 0x7f4e600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e7d291640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e780d11f0 0x7f4e600039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e7ca90640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e60003f20 0x7f4e60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e7da92640 1 -- 172.21.15.82:0/3141503201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e780d11f0 msgr2=0x7f4e600039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e7da92640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e780d11f0 0x7f4e600039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e7da92640 1 -- 172.21.15.82:0/3141503201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e60003f20 msgr2=0x7f4e60004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e7da92640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e60003f20 0x7f4e60004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.246+0000 7f4e7da92640 1 -- 172.21.15.82:0/3141503201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e60003520 con 0x7f4e60004d40 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.247+0000 7f4e7da92640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 0x7f4e600051c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4e70001860 tx=0x7f4e60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e65e6658e5c4353 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.247+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70037070 con 0x7f4e60004d40 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.247+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7002abf0 con 0x7f4e60004d40 2024-06-02T22:53:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.247+0000 7f4e77fff640 1 -- 172.21.15.82:0/3141503201 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70001430 con 0x7f4e60004d40 2024-06-02T22:53:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.248+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/3141503201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 msgr2=0x7f4e600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.248+0000 7f4e7f4f5640 1 --2- 172.21.15.82:0/3141503201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 0x7f4e600051c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4e70001860 tx=0x7f4e60005830 comp rx=0 tx=0).stop 2024-06-02T22:53:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.248+0000 7f4e7da92640 1 -- 172.21.15.82:0/3141503201 reap_dead start 2024-06-02T22:53:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.248+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/3141503201 shutdown_connections 2024-06-02T22:53:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.248+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/3141503201 >> 172.21.15.82:0/3141503201 conn(0x7f4e7809d3e0 msgr2=0x7f4e780d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.248+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/3141503201 shutdown_connections 2024-06-02T22:53:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.248+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/3141503201 wait complete. 2024-06-02T22:53:25.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.249+0000 7f4e7f4f5640 1 Processor -- start 2024-06-02T22:53:25.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.249+0000 7f4e7f4f5640 1 -- start start 2024-06-02T22:53:25.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7f4f5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 0x7f4e780ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:25.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7f4f5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e7815e5a0 0x7f4e780b9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7f4f5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e780b3340 0x7f4e780b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7f4f5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780b0cd0 con 0x7f4e60004d40 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7f4f5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780d1d40 con 0x7f4e780b3340 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7f4f5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4e780b0e50 con 0x7f4e7815e5a0 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7d291640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 0x7f4e780ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7d291640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 0x7f4e780ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49992/0 (socket says 172.21.15.82:49992) 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7d291640 1 -- 172.21.15.82:0/73558618 learned_addr learned my addr 172.21.15.82:0/73558618 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7d291640 1 -- 172.21.15.82:0/73558618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e7815e5a0 msgr2=0x7f4e780b9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7d291640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e7815e5a0 0x7f4e780b9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7d291640 1 -- 172.21.15.82:0/73558618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e780b3340 msgr2=0x7f4e780b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7d291640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e780b3340 0x7f4e780b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7d291640 1 -- 172.21.15.82:0/73558618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e780cbe60 con 0x7f4e60004d40 2024-06-02T22:53:25.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e7d291640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 0x7f4e780ce020 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4e68007a20 tx=0x7f4e6800a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.250+0000 7f4e75ffb640 1 -- 172.21.15.82:0/73558618 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680133f0 con 0x7f4e60004d40 2024-06-02T22:53:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.251+0000 7f4e75ffb640 1 -- 172.21.15.82:0/73558618 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e68018070 con 0x7f4e60004d40 2024-06-02T22:53:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.251+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/73558618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e780b9b90 con 0x7f4e60004d40 2024-06-02T22:53:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.251+0000 7f4e75ffb640 1 -- 172.21.15.82:0/73558618 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680137d0 con 0x7f4e60004d40 2024-06-02T22:53:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.251+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/73558618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7815ee40 con 0x7f4e60004d40 2024-06-02T22:53:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.252+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/73558618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e780683c0 con 0x7f4e60004d40 2024-06-02T22:53:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.252+0000 7f4e75ffb640 1 -- 172.21.15.82:0/73558618 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e68013970 con 0x7f4e60004d40 2024-06-02T22:53:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.252+0000 7f4e75ffb640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e6406be30 0x7f4e6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.252+0000 7f4e75ffb640 1 -- 172.21.15.82:0/73558618 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f4e6808baf0 con 0x7f4e60004d40 2024-06-02T22:53:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.252+0000 7f4e7ca90640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e6406be30 0x7f4e6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.253+0000 7f4e7ca90640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e6406be30 0x7f4e6406e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4e780ca2c0 tx=0x7f4e6c0095d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:25.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.257+0000 7f4e75ffb640 1 -- 172.21.15.82:0/73558618 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4e6805a190 con 0x7f4e60004d40 2024-06-02T22:53:25.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.495+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/73558618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) -- 0x7f4e7808c0c0 con 0x7f4e60004d40 2024-06-02T22:53:25.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.497+0000 7f4e75ffb640 1 -- 172.21.15.82:0/73558618 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v12) ==== 184+0+141 (secure 0 0 0) 0x7f4e68059a90 con 0x7f4e60004d40 2024-06-02T22:53:25.497 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-06-02T22:53:25.497 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g== 2024-06-02T22:53:25.497 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2024-06-02T22:53:25.497 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2024-06-02T22:53:25.497 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw pool=cephfs_data" 2024-06-02T22:53:25.497 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2024-06-02T22:53:25.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/73558618 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e6406be30 msgr2=0x7f4e6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:25.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e6406be30 0x7f4e6406e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4e780ca2c0 tx=0x7f4e6c0095d0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/73558618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 msgr2=0x7f4e780ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:25.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 0x7f4e780ce020 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4e68007a20 tx=0x7f4e6800a730 comp rx=0 tx=0).stop 2024-06-02T22:53:25.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/73558618 shutdown_connections 2024-06-02T22:53:25.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f4e6406be30 0x7f4e6406e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e780b3340 0x7f4e780b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e7815e5a0 0x7f4e780b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 --2- 172.21.15.82:0/73558618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e60004d40 0x7f4e780ce020 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/73558618 >> 172.21.15.82:0/73558618 conn(0x7f4e7809d3e0 msgr2=0x7f4e780d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/73558618 shutdown_connections 2024-06-02T22:53:25.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.500+0000 7f4e7f4f5640 1 -- 172.21.15.82:0/73558618 wait complete. 2024-06-02T22:53:25.511 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-02T22:53:25.511 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T22:53:25.547 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T22:53:25.593 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-02T22:53:25.593 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T22:53:25.593 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:25.593 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:25.608 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17664 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T22:53:25.609 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:53:25.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:25.609 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T22:53:25.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:53:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-06-02T22:53:25.664 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T22:53:25.664 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:53:25.665 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:25.683 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14652 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T22:53:25.683 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:53:25.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:25.683 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-02T22:53:25.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:53:25.741 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-06-02T22:53:25.741 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T22:53:25.741 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:25.742 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:25.758 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17664 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T22:53:25.759 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:53:25.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:25.759 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-02T22:53:25.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:53:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-06-02T22:53:25.814 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T22:53:25.814 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:53:25.814 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:25.833 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14652 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T22:53:25.833 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:53:25.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:25.833 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-02T22:53:25.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:53:25.892 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-06-02T22:53:25.892 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:53:25.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.993+0000 7fc9a5e53640 1 Processor -- start 2024-06-02T22:53:25.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.993+0000 7fc9a5e53640 1 -- start start 2024-06-02T22:53:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.994+0000 7fc9a5e53640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9a00cd230 0x7fc9a00b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.994+0000 7fc9a5e53640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a00b3420 con 0x7fc9a00cec50 2024-06-02T22:53:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.994+0000 7fc9a5e53640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a00cc750 con 0x7fc9a01553c0 2024-06-02T22:53:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.994+0000 7fc9a5e53640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a00cca30 con 0x7fc9a00cd230 2024-06-02T22:53:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.994+0000 7fc99effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9a00cd230 0x7fc9a00b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.994+0000 7fc99ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc9a00cec50 0x7fc9a0071030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38164/0 (socket says 172.21.15.82:38164) 2024-06-02T22:53:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.994+0000 7fc99ffff640 1 -- 172.21.15.82:0/377569888 learned_addr learned my addr 172.21.15.82:0/377569888 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.994+0000 7fc99effd640 1 -- 172.21.15.82:0/377569888 >> v1:172.21.15.184:6789/0 conn(0x7fc9a01553c0 legacy=0x7fc9a015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:25.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.994+0000 7fc99effd640 1 -- 172.21.15.82:0/377569888 >> v1:172.21.15.82:6789/0 conn(0x7fc9a00cec50 legacy=0x7fc9a0071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:25.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.994+0000 7fc99effd640 1 -- 172.21.15.82:0/377569888 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a00ccd10 con 0x7fc9a00cd230 2024-06-02T22:53:25.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.994+0000 7fc99e7fc640 1 -- 172.21.15.82:0/377569888 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188264222 0 0) 0x7fc9a00b3420 con 0x7fc9a00cec50 2024-06-02T22:53:25.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.995+0000 7fc99effd640 1 --2- 172.21.15.82:0/377569888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a00cd230 0x7fc9a00b2cf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc99400ba40 tx=0x7fc99402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97e439d3b1cf615 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:25.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.995+0000 7fc99e7fc640 1 -- 172.21.15.82:0/377569888 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994032770 con 0x7fc9a00cd230 2024-06-02T22:53:25.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.995+0000 7fc99e7fc640 1 -- 172.21.15.82:0/377569888 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc994038070 con 0x7fc9a00cd230 2024-06-02T22:53:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.995+0000 7fc99e7fc640 1 -- 172.21.15.82:0/377569888 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994032b30 con 0x7fc9a00cd230 2024-06-02T22:53:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.995+0000 7fc9a5e53640 1 -- 172.21.15.82:0/377569888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a00cd230 msgr2=0x7fc9a00b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.995+0000 7fc9a5e53640 1 --2- 172.21.15.82:0/377569888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a00cd230 0x7fc9a00b2cf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc99400ba40 tx=0x7fc99402c8b0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.995+0000 7fc9a5e53640 1 -- 172.21.15.82:0/377569888 shutdown_connections 2024-06-02T22:53:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.995+0000 7fc9a5e53640 1 --2- 172.21.15.82:0/377569888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a00cd230 0x7fc9a00b2cf0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.995+0000 7fc9a5e53640 1 -- 172.21.15.82:0/377569888 >> 172.21.15.82:0/377569888 conn(0x7fc9a00b19f0 msgr2=0x7fc9a00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.996+0000 7fc9a5e53640 1 -- 172.21.15.82:0/377569888 shutdown_connections 2024-06-02T22:53:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.996+0000 7fc9a5e53640 1 -- 172.21.15.82:0/377569888 wait complete. 2024-06-02T22:53:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.997+0000 7fc9a5e53640 1 Processor -- start 2024-06-02T22:53:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.997+0000 7fc9a5e53640 1 -- start start 2024-06-02T22:53:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.997+0000 7fc9a5e53640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a00cd230 0x7fc9a01519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.997+0000 7fc9a5e53640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a00cec50 0x7fc9a009d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.997+0000 7fc9a5e53640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9a01553c0 0x7fc9a00b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.997+0000 7fc9a5e53640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a0155920 con 0x7fc9a00cec50 2024-06-02T22:53:26.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.997+0000 7fc9a5e53640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01557a0 con 0x7fc9a00cd230 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.997+0000 7fc9a5e53640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a00cf0e0 con 0x7fc9a01553c0 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a00cec50 0x7fc9a009d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a00cec50 0x7fc9a009d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50002/0 (socket says 172.21.15.82:50002) 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99effd640 1 -- 172.21.15.82:0/3212519487 learned_addr learned my addr 172.21.15.82:0/3212519487 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99f7fe640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a00cd230 0x7fc9a01519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99effd640 1 -- 172.21.15.82:0/3212519487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9a01553c0 msgr2=0x7fc9a00b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99ffff640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9a01553c0 0x7fc9a00b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99effd640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9a01553c0 0x7fc9a00b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99effd640 1 -- 172.21.15.82:0/3212519487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a00cd230 msgr2=0x7fc9a01519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99effd640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a00cd230 0x7fc9a01519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99effd640 1 -- 172.21.15.82:0/3212519487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a009db50 con 0x7fc9a00cec50 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99f7fe640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a00cd230 0x7fc9a01519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:26.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc99effd640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a00cec50 0x7fc9a009d320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc994035040 tx=0x7fc9940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc987fff640 1 -- 172.21.15.82:0/3212519487 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99404a070 con 0x7fc9a00cec50 2024-06-02T22:53:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc987fff640 1 -- 172.21.15.82:0/3212519487 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc994033610 con 0x7fc9a00cec50 2024-06-02T22:53:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc9a5e53640 1 -- 172.21.15.82:0/3212519487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a00b0c00 con 0x7fc9a00cec50 2024-06-02T22:53:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc987fff640 1 -- 172.21.15.82:0/3212519487 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994033a20 con 0x7fc9a00cec50 2024-06-02T22:53:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.998+0000 7fc9a5e53640 1 -- 172.21.15.82:0/3212519487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a00b14a0 con 0x7fc9a00cec50 2024-06-02T22:53:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:25.999+0000 7fc9a5e53640 1 -- 172.21.15.82:0/3212519487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a00b0dd0 con 0x7fc9a00cec50 2024-06-02T22:53:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.000+0000 7fc987fff640 1 -- 172.21.15.82:0/3212519487 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc99404d070 con 0x7fc9a00cec50 2024-06-02T22:53:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.000+0000 7fc987fff640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc98c06be30 0x7fc98c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.000+0000 7fc987fff640 1 -- 172.21.15.82:0/3212519487 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fc9940ada50 con 0x7fc9a00cec50 2024-06-02T22:53:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.000+0000 7fc99f7fe640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc98c06be30 0x7fc98c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.001+0000 7fc99f7fe640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc98c06be30 0x7fc98c06e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc99000a810 tx=0x7fc990008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:26.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.004+0000 7fc987fff640 1 -- 172.21.15.82:0/3212519487 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc99407c0f0 con 0x7fc9a00cec50 2024-06-02T22:53:26.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.213+0000 7fc9a5e53640 1 -- 172.21.15.82:0/3212519487 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9a0068430 con 0x7fc9a00cec50 2024-06-02T22:53:26.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.214+0000 7fc987fff640 1 -- 172.21.15.82:0/3212519487 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5189 (secure 0 0 0) 0x7fc99407b9f0 con 0x7fc9a00cec50 2024-06-02T22:53:26.214 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:26.214 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2802926071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2802926071},{"type":"v1","addr":"172.21.15.184:6834","nonce":2802926071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4908,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2538474234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2538474234},{"type":"v1","addr":"172.21.15.82:6836","nonce":2538474234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1604488280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1604488280},{"type":"v1","addr":"172.21.15.82:6837","nonce":1604488280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:58.170722+0000","modified":"2024-06-02T22:53:10.925095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3297362995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":3297362995},{"type":"v1","addr":"172.21.15.184:6835","nonce":3297362995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4929,"qdb_cluster":[4929]},"id":2}]} 2024-06-02T22:53:26.214 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-06-02T22:53:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.215+0000 7fc9a5e53640 1 -- 172.21.15.82:0/3212519487 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc98c06be30 msgr2=0x7fc98c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.215+0000 7fc9a5e53640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc98c06be30 0x7fc98c06e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc99000a810 tx=0x7fc990008040 comp rx=0 tx=0).stop 2024-06-02T22:53:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.215+0000 7fc9a5e53640 1 -- 172.21.15.82:0/3212519487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a00cec50 msgr2=0x7fc9a009d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.215+0000 7fc9a5e53640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a00cec50 0x7fc9a009d320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc994035040 tx=0x7fc9940046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.216+0000 7fc9a5e53640 1 -- 172.21.15.82:0/3212519487 shutdown_connections 2024-06-02T22:53:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.216+0000 7fc9a5e53640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc98c06be30 0x7fc98c06e2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.216+0000 7fc9a5e53640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9a01553c0 0x7fc9a00b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.216+0000 7fc9a5e53640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9a00cec50 0x7fc9a009d320 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.216+0000 7fc9a5e53640 1 --2- 172.21.15.82:0/3212519487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9a00cd230 0x7fc9a01519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.216+0000 7fc9a5e53640 1 -- 172.21.15.82:0/3212519487 >> 172.21.15.82:0/3212519487 conn(0x7fc9a00b19f0 msgr2=0x7fc9a0153d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.216+0000 7fc9a5e53640 1 -- 172.21.15.82:0/3212519487 shutdown_connections 2024-06-02T22:53:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.216+0000 7fc9a5e53640 1 -- 172.21.15.82:0/3212519487 wait complete. 2024-06-02T22:53:26.227 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:53:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.326+0000 7fde0626b640 1 Processor -- start 2024-06-02T22:53:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.326+0000 7fde0626b640 1 -- start start 2024-06-02T22:53:26.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fde0626b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde001553c0 0x7fde000cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fde0626b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fde000cec50 0x7fde000cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fde0626b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde000b31a0 con 0x7fde000b2cf0 2024-06-02T22:53:26.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fde0626b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fde000b3420 con 0x7fde001553c0 2024-06-02T22:53:26.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fde0626b640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fde000cc750 con 0x7fde000cec50 2024-06-02T22:53:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fddfffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde001553c0 0x7fde000cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fddfffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde001553c0 0x7fde000cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50008/0 (socket says 172.21.15.82:50008) 2024-06-02T22:53:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fddfffff640 1 -- 172.21.15.82:0/3053831502 learned_addr learned my addr 172.21.15.82:0/3053831502 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fddfffff640 1 -- 172.21.15.82:0/3053831502 >> v2:172.21.15.184:3300/0 conn(0x7fde000cec50 msgr2=0x7fde000cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fddfffff640 1 --2- 172.21.15.82:0/3053831502 >> v2:172.21.15.184:3300/0 conn(0x7fde000cec50 0x7fde000cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fddfffff640 1 -- 172.21.15.82:0/3053831502 >> v1:172.21.15.184:6789/0 conn(0x7fde000b2cf0 legacy=0x7fde0015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.327+0000 7fddfffff640 1 -- 172.21.15.82:0/3053831502 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde000cca30 con 0x7fde001553c0 2024-06-02T22:53:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.328+0000 7fddfffff640 1 --2- 172.21.15.82:0/3053831502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde001553c0 0x7fde000cd230 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009870 tx=0x7fddf002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219c3c0929e29b60 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.328+0000 7fddfeffd640 1 -- 172.21.15.82:0/3053831502 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0037070 con 0x7fde001553c0 2024-06-02T22:53:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.328+0000 7fddfeffd640 1 -- 172.21.15.82:0/3053831502 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf0032440 con 0x7fde001553c0 2024-06-02T22:53:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.328+0000 7fddfeffd640 1 -- 172.21.15.82:0/3053831502 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0032810 con 0x7fde001553c0 2024-06-02T22:53:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.329+0000 7fde0626b640 1 -- 172.21.15.82:0/3053831502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde001553c0 msgr2=0x7fde000cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.329+0000 7fde0626b640 1 --2- 172.21.15.82:0/3053831502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde001553c0 0x7fde000cd230 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009870 tx=0x7fddf002a270 comp rx=0 tx=0).stop 2024-06-02T22:53:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.329+0000 7fde0626b640 1 -- 172.21.15.82:0/3053831502 shutdown_connections 2024-06-02T22:53:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.329+0000 7fde0626b640 1 --2- 172.21.15.82:0/3053831502 >> v2:172.21.15.184:3300/0 conn(0x7fde000cec50 0x7fde000cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.329+0000 7fde0626b640 1 --2- 172.21.15.82:0/3053831502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde001553c0 0x7fde000cd230 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.329+0000 7fde0626b640 1 -- 172.21.15.82:0/3053831502 >> 172.21.15.82:0/3053831502 conn(0x7fde000b19f0 msgr2=0x7fde000b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.329+0000 7fde0626b640 1 -- 172.21.15.82:0/3053831502 shutdown_connections 2024-06-02T22:53:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.329+0000 7fde0626b640 1 -- 172.21.15.82:0/3053831502 wait complete. 2024-06-02T22:53:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.330+0000 7fde0626b640 1 Processor -- start 2024-06-02T22:53:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.330+0000 7fde0626b640 1 -- start start 2024-06-02T22:53:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fde0626b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000b2cf0 0x7fde00150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fde0626b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde000cec50 0x7fde0015c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fde0626b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde001553c0 0x7fde000cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fde0626b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fde001557a0 con 0x7fde000b2cf0 2024-06-02T22:53:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fde0626b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fde000b3700 con 0x7fde000cec50 2024-06-02T22:53:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fde0626b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fde00155920 con 0x7fde001553c0 2024-06-02T22:53:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fddfffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000b2cf0 0x7fde00150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fddfffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000b2cf0 0x7fde00150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50010/0 (socket says 172.21.15.82:50010) 2024-06-02T22:53:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fddfffff640 1 -- 172.21.15.82:0/2095151561 learned_addr learned my addr 172.21.15.82:0/2095151561 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fde04808640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde001553c0 0x7fde000cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fddff7fe640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde000cec50 0x7fde0015c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fddfffff640 1 -- 172.21.15.82:0/2095151561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde001553c0 msgr2=0x7fde000cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fddfffff640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde001553c0 0x7fde000cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fddfffff640 1 -- 172.21.15.82:0/2095151561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde000cec50 msgr2=0x7fde0015c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fddfffff640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde000cec50 0x7fde0015c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fddfffff640 1 -- 172.21.15.82:0/2095151561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde001508c0 con 0x7fde000b2cf0 2024-06-02T22:53:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.331+0000 7fddff7fe640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde000cec50 0x7fde0015c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.332+0000 7fddfffff640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000b2cf0 0x7fde00150380 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fddf0000c00 tx=0x7fddf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.332+0000 7fddfcff9640 1 -- 172.21.15.82:0/2095151561 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0037040 con 0x7fde000b2cf0 2024-06-02T22:53:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.332+0000 7fddfcff9640 1 -- 172.21.15.82:0/2095151561 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf0004230 con 0x7fde000b2cf0 2024-06-02T22:53:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.332+0000 7fde0626b640 1 -- 172.21.15.82:0/2095151561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0009bd40 con 0x7fde000b2cf0 2024-06-02T22:53:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.332+0000 7fddfcff9640 1 -- 172.21.15.82:0/2095151561 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf003c670 con 0x7fde000b2cf0 2024-06-02T22:53:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.332+0000 7fde0626b640 1 -- 172.21.15.82:0/2095151561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0015d780 con 0x7fde000b2cf0 2024-06-02T22:53:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.333+0000 7fde0626b640 1 -- 172.21.15.82:0/2095151561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0009c130 con 0x7fde000b2cf0 2024-06-02T22:53:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.333+0000 7fddfcff9640 1 -- 172.21.15.82:0/2095151561 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddf003a070 con 0x7fde000b2cf0 2024-06-02T22:53:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.334+0000 7fddfcff9640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fddec06be30 0x7fddec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.334+0000 7fddff7fe640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fddec06be30 0x7fddec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.334+0000 7fddfcff9640 1 -- 172.21.15.82:0/2095151561 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fddf00ab9f0 con 0x7fde000b2cf0 2024-06-02T22:53:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.334+0000 7fddff7fe640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fddec06be30 0x7fddec06e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde00153f60 tx=0x7fddf4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:26.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.338+0000 7fddfcff9640 1 -- 172.21.15.82:0/2095151561 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fddf0041020 con 0x7fde000b2cf0 2024-06-02T22:53:26.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.544+0000 7fde0626b640 1 -- 172.21.15.82:0/2095151561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde00068430 con 0x7fde000b2cf0 2024-06-02T22:53:26.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.545+0000 7fddfcff9640 1 -- 172.21.15.82:0/2095151561 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5189 (secure 0 0 0) 0x7fde000b31a0 con 0x7fde000b2cf0 2024-06-02T22:53:26.545 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:26.545 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2802926071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2802926071},{"type":"v1","addr":"172.21.15.184:6834","nonce":2802926071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4908,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2538474234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2538474234},{"type":"v1","addr":"172.21.15.82:6836","nonce":2538474234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1604488280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1604488280},{"type":"v1","addr":"172.21.15.82:6837","nonce":1604488280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:58.170722+0000","modified":"2024-06-02T22:53:10.925095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3297362995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":3297362995},{"type":"v1","addr":"172.21.15.184:6835","nonce":3297362995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4929,"qdb_cluster":[4929]},"id":2}]} 2024-06-02T22:53:26.545 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-06-02T22:53:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 -- 172.21.15.82:0/2095151561 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fddec06be30 msgr2=0x7fddec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fddec06be30 0x7fddec06e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde00153f60 tx=0x7fddf4009040 comp rx=0 tx=0).stop 2024-06-02T22:53:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 -- 172.21.15.82:0/2095151561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000b2cf0 msgr2=0x7fde00150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000b2cf0 0x7fde00150380 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fddf0000c00 tx=0x7fddf00046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 -- 172.21.15.82:0/2095151561 shutdown_connections 2024-06-02T22:53:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fddec06be30 0x7fddec06e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde001553c0 0x7fde000cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde000cec50 0x7fde0015c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 --2- 172.21.15.82:0/2095151561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000b2cf0 0x7fde00150380 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 -- 172.21.15.82:0/2095151561 >> 172.21.15.82:0/2095151561 conn(0x7fde000b19f0 msgr2=0x7fde0015b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:26.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 -- 172.21.15.82:0/2095151561 shutdown_connections 2024-06-02T22:53:26.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.547+0000 7fde0626b640 1 -- 172.21.15.82:0/2095151561 wait complete. 2024-06-02T22:53:26.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:53:26.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.661+0000 7f89cdff9640 1 Processor -- start 2024-06-02T22:53:26.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.661+0000 7f89cdff9640 1 -- start start 2024-06-02T22:53:26.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.662+0000 7f89cdff9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f89c815a870 0x7f89c806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.662+0000 7f89cdff9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c806e390 con 0x7f89c80aef70 2024-06-02T22:53:26.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.662+0000 7f89cdff9640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c815ac50 con 0x7f89c80af3d0 2024-06-02T22:53:26.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.662+0000 7f89cdff9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f89c806cdb0 con 0x7f89c815a870 2024-06-02T22:53:26.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.662+0000 7f89c77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f89c815a870 0x7f89c806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.662+0000 7f89bffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f89c80aef70 0x7f89c80b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38166/0 (socket says 172.21.15.82:38166) 2024-06-02T22:53:26.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.662+0000 7f89bffff640 1 -- 172.21.15.82:0/1851005536 learned_addr learned my addr 172.21.15.82:0/1851005536 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:26.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.662+0000 7f89c77fe640 1 -- 172.21.15.82:0/1851005536 >> v1:172.21.15.184:6789/0 conn(0x7f89c80af3d0 legacy=0x7f89c80cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:26.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.662+0000 7f89c77fe640 1 -- 172.21.15.82:0/1851005536 >> v1:172.21.15.82:6789/0 conn(0x7f89c80aef70 legacy=0x7f89c80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.662+0000 7f89c77fe640 1 -- 172.21.15.82:0/1851005536 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c806d090 con 0x7f89c815a870 2024-06-02T22:53:26.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.662+0000 7f89c6ffd640 1 -- 172.21.15.82:0/1851005536 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2574776697 0 0) 0x7f89c806e390 con 0x7f89c80aef70 2024-06-02T22:53:26.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.663+0000 7f89c77fe640 1 --2- 172.21.15.82:0/1851005536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c815a870 0x7f89c806de50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f89b800a940 tx=0x7f89b802b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8b1972cc3da370 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:26.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.663+0000 7f89c6ffd640 1 -- 172.21.15.82:0/1851005536 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b800b040 con 0x7f89c815a870 2024-06-02T22:53:26.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.663+0000 7f89c6ffd640 1 -- 172.21.15.82:0/1851005536 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b8030710 con 0x7f89c815a870 2024-06-02T22:53:26.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.663+0000 7f89c6ffd640 1 -- 172.21.15.82:0/1851005536 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8030ae0 con 0x7f89c815a870 2024-06-02T22:53:26.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.663+0000 7f89cdff9640 1 -- 172.21.15.82:0/1851005536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c815a870 msgr2=0x7f89c806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.663+0000 7f89cdff9640 1 --2- 172.21.15.82:0/1851005536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c815a870 0x7f89c806de50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f89b800a940 tx=0x7f89b802b510 comp rx=0 tx=0).stop 2024-06-02T22:53:26.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.664+0000 7f89cdff9640 1 -- 172.21.15.82:0/1851005536 shutdown_connections 2024-06-02T22:53:26.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.664+0000 7f89cdff9640 1 --2- 172.21.15.82:0/1851005536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c815a870 0x7f89c806de50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.664+0000 7f89cdff9640 1 -- 172.21.15.82:0/1851005536 >> 172.21.15.82:0/1851005536 conn(0x7f89c80b19f0 msgr2=0x7f89c80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:26.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.664+0000 7f89cdff9640 1 -- 172.21.15.82:0/1851005536 shutdown_connections 2024-06-02T22:53:26.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.664+0000 7f89cdff9640 1 -- 172.21.15.82:0/1851005536 wait complete. 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.665+0000 7f89cdff9640 1 Processor -- start 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.665+0000 7f89cdff9640 1 -- start start 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.665+0000 7f89cdff9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c80aef70 0x7f89c8146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.665+0000 7f89cdff9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89c80af3d0 0x7f89c8151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.665+0000 7f89cdff9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89c815a870 0x7f89c8158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.665+0000 7f89cdff9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89c806d930 con 0x7f89c80aef70 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.665+0000 7f89cdff9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f89c806d650 con 0x7f89c815a870 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.665+0000 7f89cdff9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f89c80b2e40 con 0x7f89c80af3d0 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c80aef70 0x7f89c8146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c80aef70 0x7f89c8146590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50042/0 (socket says 172.21.15.82:50042) 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c77fe640 1 -- 172.21.15.82:0/539125415 learned_addr learned my addr 172.21.15.82:0/539125415 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:26.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89bffff640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89c80af3d0 0x7f89c8151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c7fff640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89c815a870 0x7f89c8158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c77fe640 1 -- 172.21.15.82:0/539125415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89c80af3d0 msgr2=0x7f89c8151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c77fe640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89c80af3d0 0x7f89c8151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c77fe640 1 -- 172.21.15.82:0/539125415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89c815a870 msgr2=0x7f89c8158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c77fe640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89c815a870 0x7f89c8158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c77fe640 1 -- 172.21.15.82:0/539125415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c8151a80 con 0x7f89c80aef70 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c77fe640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c80aef70 0x7f89c8146590 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f89b800a940 tx=0x7f89b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c4ff9640 1 -- 172.21.15.82:0/539125415 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b803f030 con 0x7f89c80aef70 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c4ff9640 1 -- 172.21.15.82:0/539125415 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b8030510 con 0x7f89c80aef70 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89cdff9640 1 -- 172.21.15.82:0/539125415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c8151d60 con 0x7f89c80aef70 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89c4ff9640 1 -- 172.21.15.82:0/539125415 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b803b430 con 0x7f89c80aef70 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.666+0000 7f89cdff9640 1 -- 172.21.15.82:0/539125415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c81526e0 con 0x7f89c80aef70 2024-06-02T22:53:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.667+0000 7f89cdff9640 1 -- 172.21.15.82:0/539125415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c8068430 con 0x7f89c80aef70 2024-06-02T22:53:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.668+0000 7f89c4ff9640 1 -- 172.21.15.82:0/539125415 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89b8042030 con 0x7f89c80aef70 2024-06-02T22:53:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.668+0000 7f89c4ff9640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f89a806be30 0x7f89a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.668+0000 7f89c4ff9640 1 -- 172.21.15.82:0/539125415 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f89b80ab980 con 0x7f89c80aef70 2024-06-02T22:53:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.668+0000 7f89bffff640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f89a806be30 0x7f89a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.669+0000 7f89bffff640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f89a806be30 0x7f89a806e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f89c81f5700 tx=0x7f89b0007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:26.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.672+0000 7f89c4ff9640 1 -- 172.21.15.82:0/539125415 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f89b807a0b0 con 0x7f89c80aef70 2024-06-02T22:53:26.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.846+0000 7f89cdff9640 1 -- 172.21.15.82:0/539125415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89c80b0730 con 0x7f89c80aef70 2024-06-02T22:53:26.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.848+0000 7f89c4ff9640 1 -- 172.21.15.82:0/539125415 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+18754 (secure 0 0 0) 0x7f89b80799b0 con 0x7f89c80aef70 2024-06-02T22:53:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:26.848 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:53:12.581974+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:56.075878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:57.154913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-06-02T22:53:10.463415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:53:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 -- 172.21.15.82:0/539125415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f89a806be30 msgr2=0x7f89a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f89a806be30 0x7f89a806e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f89c81f5700 tx=0x7f89b0007b50 comp rx=0 tx=0).stop 2024-06-02T22:53:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 -- 172.21.15.82:0/539125415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c80aef70 msgr2=0x7f89c8146590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c80aef70 0x7f89c8146590 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f89b800a940 tx=0x7f89b80046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 -- 172.21.15.82:0/539125415 shutdown_connections 2024-06-02T22:53:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f89a806be30 0x7f89a806e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89c815a870 0x7f89c8158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89c80af3d0 0x7f89c8151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 --2- 172.21.15.82:0/539125415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c80aef70 0x7f89c8146590 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 -- 172.21.15.82:0/539125415 >> 172.21.15.82:0/539125415 conn(0x7f89c80b19f0 msgr2=0x7f89c806de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:26.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 -- 172.21.15.82:0/539125415 shutdown_connections 2024-06-02T22:53:26.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.850+0000 7f89cdff9640 1 -- 172.21.15.82:0/539125415 wait complete. 2024-06-02T22:53:26.861 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T22:53:26.861 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:53:26.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.961+0000 7f386a072640 1 Processor -- start 2024-06-02T22:53:26.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.961+0000 7f386a072640 1 -- start start 2024-06-02T22:53:26.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.961+0000 7f386a072640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f386415f1a0 0x7f38640d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.961+0000 7f386a072640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640cef70 0x7f38640cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.961+0000 7f386a072640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386415f5e0 con 0x7f38640d2680 2024-06-02T22:53:26.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.961+0000 7f386a072640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f38640d13e0 con 0x7f386415f1a0 2024-06-02T22:53:26.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.961+0000 7f386a072640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f38640d0ad0 con 0x7f38640cef70 2024-06-02T22:53:26.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38637fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f38640d2680 0x7f38640d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38178/0 (socket says 172.21.15.82:38178) 2024-06-02T22:53:26.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38637fe640 1 -- 172.21.15.82:0/3724969631 learned_addr learned my addr 172.21.15.82:0/3724969631 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:26.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3979704733 0 0) 0x7f386415f5e0 con 0x7f38640d2680 2024-06-02T22:53:26.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f3863fff640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640cef70 0x7f38640cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f3862ffd640 1 --2- 172.21.15.82:0/3724969631 >> v2:172.21.15.184:3300/0 conn(0x7f386415f1a0 0x7f38640d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3850003520 con 0x7f38640d2680 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3633795425 0 0) 0x7f3850003520 con 0x7f38640d2680 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640cef70 msgr2=0x7f38640cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640cef70 0x7f38640cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 >> v2:172.21.15.184:3300/0 conn(0x7f386415f1a0 msgr2=0x7f38640d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 --2- 172.21.15.82:0/3724969631 >> v2:172.21.15.184:3300/0 conn(0x7f386415f1a0 0x7f38640d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386415f890 con 0x7f38640d2680 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f3854001670 con 0x7f38640d2680 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 >> v1:172.21.15.82:6789/0 conn(0x7f38640d2680 legacy=0x7f38640d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38500039b0 0x7f3850003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3850004800 0x7f3850004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640cef70 0x7f38500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38640d13e0 con 0x7f3850004800 2024-06-02T22:53:26.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f38640d0ad0 con 0x7f38500039b0 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f385000b9c0 con 0x7f38640cef70 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f3862ffd640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3850004800 0x7f3850004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f3863fff640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640cef70 0x7f38500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.962+0000 7f38637fe640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38500039b0 0x7f3850003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.963+0000 7f3862ffd640 1 -- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640cef70 msgr2=0x7f38500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.963+0000 7f3862ffd640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640cef70 0x7f38500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.963+0000 7f3862ffd640 1 -- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38500039b0 msgr2=0x7f3850003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.963+0000 7f3862ffd640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38500039b0 0x7f3850003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.963+0000 7f3862ffd640 1 -- 172.21.15.82:0/3724969631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3850003520 con 0x7f3850004800 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.963+0000 7f38637fe640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38500039b0 0x7f3850003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.963+0000 7f3862ffd640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3850004800 0x7f3850004c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f384c009ac0 tx=0x7f3850005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9cabcde736e12e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.963+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c036070 con 0x7f3850004800 2024-06-02T22:53:26.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.963+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f384c031400 con 0x7f3850004800 2024-06-02T22:53:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.963+0000 7f38627fc640 1 -- 172.21.15.82:0/3724969631 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c009690 con 0x7f3850004800 2024-06-02T22:53:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.964+0000 7f386a072640 1 -- 172.21.15.82:0/3724969631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3850004800 msgr2=0x7f3850004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.964+0000 7f386a072640 1 --2- 172.21.15.82:0/3724969631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3850004800 0x7f3850004c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f384c009ac0 tx=0x7f3850005830 comp rx=0 tx=0).stop 2024-06-02T22:53:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.964+0000 7f3863fff640 1 -- 172.21.15.82:0/3724969631 reap_dead start 2024-06-02T22:53:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.964+0000 7f386a072640 1 -- 172.21.15.82:0/3724969631 shutdown_connections 2024-06-02T22:53:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.964+0000 7f386a072640 1 -- 172.21.15.82:0/3724969631 >> 172.21.15.82:0/3724969631 conn(0x7f386409d3f0 msgr2=0x7f38640d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.964+0000 7f386a072640 1 -- 172.21.15.82:0/3724969631 shutdown_connections 2024-06-02T22:53:26.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.964+0000 7f386a072640 1 -- 172.21.15.82:0/3724969631 wait complete. 2024-06-02T22:53:26.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.965+0000 7f386a072640 1 Processor -- start 2024-06-02T22:53:26.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.965+0000 7f386a072640 1 -- start start 2024-06-02T22:53:26.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f386a072640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3850004800 0x7f3864157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f386a072640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386409e430 0x7f386409e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f386a072640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640c7bf0 0x7f38640c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f386a072640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38640d4f00 con 0x7f386409e430 2024-06-02T22:53:26.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f386a072640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f38640d1070 con 0x7f3850004800 2024-06-02T22:53:26.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f386a072640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f38640d1870 con 0x7f38640c7bf0 2024-06-02T22:53:26.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f3862ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386409e430 0x7f386409e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f3862ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386409e430 0x7f386409e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50062/0 (socket says 172.21.15.82:50062) 2024-06-02T22:53:26.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f3862ffd640 1 -- 172.21.15.82:0/2429244594 learned_addr learned my addr 172.21.15.82:0/2429244594 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f38637fe640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3850004800 0x7f3864157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f3863fff640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640c7bf0 0x7f38640c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f3862ffd640 1 -- 172.21.15.82:0/2429244594 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640c7bf0 msgr2=0x7f38640c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f3862ffd640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640c7bf0 0x7f38640c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f3862ffd640 1 -- 172.21.15.82:0/2429244594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3850004800 msgr2=0x7f3864157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f3862ffd640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3850004800 0x7f3864157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f3862ffd640 1 -- 172.21.15.82:0/2429244594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3864158060 con 0x7f386409e430 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f3863fff640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640c7bf0 0x7f38640c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.966+0000 7f38637fe640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3850004800 0x7f3864157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.967+0000 7f3862ffd640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386409e430 0x7f386409e8b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f384c009ac0 tx=0x7f384c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.967+0000 7f385bfff640 1 -- 172.21.15.82:0/2429244594 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c040020 con 0x7f386409e430 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.967+0000 7f385bfff640 1 -- 172.21.15.82:0/2429244594 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f384c003b40 con 0x7f386409e430 2024-06-02T22:53:26.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.967+0000 7f386a072640 1 -- 172.21.15.82:0/2429244594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3864158340 con 0x7f386409e430 2024-06-02T22:53:26.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.967+0000 7f385bfff640 1 -- 172.21.15.82:0/2429244594 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c036040 con 0x7f386409e430 2024-06-02T22:53:26.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.967+0000 7f386a072640 1 -- 172.21.15.82:0/2429244594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3864158900 con 0x7f386409e430 2024-06-02T22:53:26.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.968+0000 7f386a072640 1 -- 172.21.15.82:0/2429244594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38640c85b0 con 0x7f386409e430 2024-06-02T22:53:26.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.968+0000 7f385bfff640 1 -- 172.21.15.82:0/2429244594 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f384c043020 con 0x7f386409e430 2024-06-02T22:53:26.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.969+0000 7f385bfff640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f384406be60 0x7f384406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:26.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.969+0000 7f385bfff640 1 -- 172.21.15.82:0/2429244594 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f384c0ab3e0 con 0x7f386409e430 2024-06-02T22:53:26.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.969+0000 7f38637fe640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f384406be60 0x7f384406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:26.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.969+0000 7f38637fe640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f384406be60 0x7f384406e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3854000fb0 tx=0x7f3854009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:26.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:26.973+0000 7f385bfff640 1 -- 172.21.15.82:0/2429244594 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f384c04a070 con 0x7f386409e430 2024-06-02T22:53:27.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.184+0000 7f386a072640 1 -- 172.21.15.82:0/2429244594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3864072ec0 con 0x7f386409e430 2024-06-02T22:53:27.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.185+0000 7f385bfff640 1 -- 172.21.15.82:0/2429244594 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5189 (secure 0 0 0) 0x7f3864072ec0 con 0x7f386409e430 2024-06-02T22:53:27.185 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:27.185 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2802926071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2802926071},{"type":"v1","addr":"172.21.15.184:6834","nonce":2802926071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4908,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2538474234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2538474234},{"type":"v1","addr":"172.21.15.82:6836","nonce":2538474234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1604488280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1604488280},{"type":"v1","addr":"172.21.15.82:6837","nonce":1604488280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:58.170722+0000","modified":"2024-06-02T22:53:10.925095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3297362995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":3297362995},{"type":"v1","addr":"172.21.15.184:6835","nonce":3297362995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4929,"qdb_cluster":[4929]},"id":2}]} 2024-06-02T22:53:27.185 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-06-02T22:53:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 -- 172.21.15.82:0/2429244594 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f384406be60 msgr2=0x7f384406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f384406be60 0x7f384406e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3854000fb0 tx=0x7f3854009040 comp rx=0 tx=0).stop 2024-06-02T22:53:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 -- 172.21.15.82:0/2429244594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386409e430 msgr2=0x7f386409e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386409e430 0x7f386409e8b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f384c009ac0 tx=0x7f384c004730 comp rx=0 tx=0).stop 2024-06-02T22:53:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 -- 172.21.15.82:0/2429244594 shutdown_connections 2024-06-02T22:53:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f384406be60 0x7f384406e320 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38640c7bf0 0x7f38640c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386409e430 0x7f386409e8b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 --2- 172.21.15.82:0/2429244594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3850004800 0x7f3864157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 -- 172.21.15.82:0/2429244594 >> 172.21.15.82:0/2429244594 conn(0x7f386409d3f0 msgr2=0x7f38640c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 -- 172.21.15.82:0/2429244594 shutdown_connections 2024-06-02T22:53:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.187+0000 7f386a072640 1 -- 172.21.15.82:0/2429244594 wait complete. 2024-06-02T22:53:27.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:53:27.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.297+0000 7fd073238640 1 Processor -- start 2024-06-02T22:53:27.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.297+0000 7fd073238640 1 -- start start 2024-06-02T22:53:27.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.298+0000 7fd073238640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c06ebf0 0x7fd06c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.298+0000 7fd073238640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd06c0cf640 con 0x7fd06c0cf190 2024-06-02T22:53:27.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.298+0000 7fd073238640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd06c06d130 con 0x7fd06c0ae910 2024-06-02T22:53:27.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.298+0000 7fd073238640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c06d410 con 0x7fd06c06ebf0 2024-06-02T22:53:27.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.298+0000 7fd0717d5640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd06c0cf190 0x7fd06c0acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38180/0 (socket says 172.21.15.82:38180) 2024-06-02T22:53:27.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.298+0000 7fd0717d5640 1 -- 172.21.15.82:0/2197191058 learned_addr learned my addr 172.21.15.82:0/2197191058 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.298+0000 7fd06bfff640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c06ebf0 0x7fd06c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.298+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544103791 0 0) 0x7fd06c0cf640 con 0x7fd06c0cf190 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.298+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd054003520 con 0x7fd06c0cf190 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 864854213 0 0) 0x7fd054003520 con 0x7fd06c0cf190 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c06ebf0 msgr2=0x7fd06c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c06ebf0 0x7fd06c0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 >> v1:172.21.15.184:6789/0 conn(0x7fd06c0ae910 legacy=0x7fd06c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c06d6f0 con 0x7fd06c0cf190 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fd0640019f0 con 0x7fd06c0cf190 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 >> v1:172.21.15.82:6789/0 conn(0x7fd06c0cf190 legacy=0x7fd06c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c06ebf0 0x7fd0540039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd054003f60 0x7fd054004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd054004d40 0x7fd0540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c06d410 con 0x7fd054003f60 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd05400bb50 con 0x7fd054004d40 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd05400df60 con 0x7fd06c06ebf0 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06bfff640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd054003f60 0x7fd054004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd070fd4640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c06ebf0 0x7fd0540039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd0717d5640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd054004d40 0x7fd0540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06bfff640 1 -- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c06ebf0 msgr2=0x7fd0540039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06bfff640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c06ebf0 0x7fd0540039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06bfff640 1 -- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd054004d40 msgr2=0x7fd0540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06bfff640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd054004d40 0x7fd0540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd06bfff640 1 -- 172.21.15.82:0/2197191058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd054003520 con 0x7fd054003f60 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.299+0000 7fd0717d5640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd054004d40 0x7fd0540051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:27.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.300+0000 7fd06bfff640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd054003f60 0x7fd054004800 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd060006bf0 tx=0x7fd054005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4605efab4794fe4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.300+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060040070 con 0x7fd054003f60 2024-06-02T22:53:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.300+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0600336a0 con 0x7fd054003f60 2024-06-02T22:53:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.300+0000 7fd06b7fe640 1 -- 172.21.15.82:0/2197191058 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060009690 con 0x7fd054003f60 2024-06-02T22:53:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.300+0000 7fd073238640 1 -- 172.21.15.82:0/2197191058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd054003f60 msgr2=0x7fd054004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.300+0000 7fd073238640 1 --2- 172.21.15.82:0/2197191058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd054003f60 0x7fd054004800 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd060006bf0 tx=0x7fd054005830 comp rx=0 tx=0).stop 2024-06-02T22:53:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.300+0000 7fd0717d5640 1 -- 172.21.15.82:0/2197191058 reap_dead start 2024-06-02T22:53:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.301+0000 7fd073238640 1 -- 172.21.15.82:0/2197191058 shutdown_connections 2024-06-02T22:53:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.301+0000 7fd073238640 1 -- 172.21.15.82:0/2197191058 >> 172.21.15.82:0/2197191058 conn(0x7fd06c0b19f0 msgr2=0x7fd06c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.301+0000 7fd073238640 1 -- 172.21.15.82:0/2197191058 shutdown_connections 2024-06-02T22:53:27.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.301+0000 7fd073238640 1 -- 172.21.15.82:0/2197191058 wait complete. 2024-06-02T22:53:27.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.302+0000 7fd073238640 1 Processor -- start 2024-06-02T22:53:27.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.302+0000 7fd073238640 1 -- start start 2024-06-02T22:53:27.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd073238640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd054003f60 0x7fd06c09d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd073238640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd06c09bd30 0x7fd06c071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd073238640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c1525d0 0x7fd06c1482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd073238640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c0ad450 con 0x7fd06c09bd30 2024-06-02T22:53:27.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd073238640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c0aecf0 con 0x7fd054003f60 2024-06-02T22:53:27.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd073238640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c0ad5d0 con 0x7fd06c1525d0 2024-06-02T22:53:27.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd06bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd06c09bd30 0x7fd06c071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd06bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd06c09bd30 0x7fd06c071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50086/0 (socket says 172.21.15.82:50086) 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd06bfff640 1 -- 172.21.15.82:0/1242619832 learned_addr learned my addr 172.21.15.82:0/1242619832 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd070fd4640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd054003f60 0x7fd06c09d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd0717d5640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c1525d0 0x7fd06c1482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd06bfff640 1 -- 172.21.15.82:0/1242619832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c1525d0 msgr2=0x7fd06c1482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd06bfff640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c1525d0 0x7fd06c1482d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd06bfff640 1 -- 172.21.15.82:0/1242619832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd054003f60 msgr2=0x7fd06c09d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd06bfff640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd054003f60 0x7fd06c09d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd06bfff640 1 -- 172.21.15.82:0/1242619832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c09c280 con 0x7fd06c09bd30 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd06bfff640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd06c09bd30 0x7fd06c071790 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd06003e040 tx=0x7fd060004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd0697fa640 1 -- 172.21.15.82:0/1242619832 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060040050 con 0x7fd06c09bd30 2024-06-02T22:53:27.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd0697fa640 1 -- 172.21.15.82:0/1242619832 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06004c070 con 0x7fd06c09bd30 2024-06-02T22:53:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd0697fa640 1 -- 172.21.15.82:0/1242619832 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060003a70 con 0x7fd06c09bd30 2024-06-02T22:53:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd073238640 1 -- 172.21.15.82:0/1242619832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06c09c560 con 0x7fd06c09bd30 2024-06-02T22:53:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.303+0000 7fd073238640 1 -- 172.21.15.82:0/1242619832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06c09cb20 con 0x7fd06c09bd30 2024-06-02T22:53:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.305+0000 7fd073238640 1 -- 172.21.15.82:0/1242619832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06c068430 con 0x7fd06c09bd30 2024-06-02T22:53:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.305+0000 7fd0697fa640 1 -- 172.21.15.82:0/1242619832 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd060003c10 con 0x7fd06c09bd30 2024-06-02T22:53:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.305+0000 7fd0697fa640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd05806be30 0x7fd05806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.305+0000 7fd0697fa640 1 -- 172.21.15.82:0/1242619832 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fd0600b3b40 con 0x7fd06c09bd30 2024-06-02T22:53:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.305+0000 7fd070fd4640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd05806be30 0x7fd05806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.306+0000 7fd070fd4640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd05806be30 0x7fd05806e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0017e0 tx=0x7fd05c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:27.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.310+0000 7fd0697fa640 1 -- 172.21.15.82:0/1242619832 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd060055020 con 0x7fd06c09bd30 2024-06-02T22:53:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.518+0000 7fd073238640 1 -- 172.21.15.82:0/1242619832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd06c09dea0 con 0x7fd06c09bd30 2024-06-02T22:53:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.519+0000 7fd0697fa640 1 -- 172.21.15.82:0/1242619832 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5189 (secure 0 0 0) 0x7fd0600044e0 con 0x7fd06c09bd30 2024-06-02T22:53:27.519 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:27.519 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2802926071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2802926071},{"type":"v1","addr":"172.21.15.184:6834","nonce":2802926071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4908,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2538474234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2538474234},{"type":"v1","addr":"172.21.15.82:6836","nonce":2538474234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1604488280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1604488280},{"type":"v1","addr":"172.21.15.82:6837","nonce":1604488280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:52:58.170722+0000","modified":"2024-06-02T22:53:10.925095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3297362995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":3297362995},{"type":"v1","addr":"172.21.15.184:6835","nonce":3297362995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4929,"qdb_cluster":[4929]},"id":2}]} 2024-06-02T22:53:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-06-02T22:53:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 -- 172.21.15.82:0/1242619832 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd05806be30 msgr2=0x7fd05806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd05806be30 0x7fd05806e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0017e0 tx=0x7fd05c009040 comp rx=0 tx=0).stop 2024-06-02T22:53:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 -- 172.21.15.82:0/1242619832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd06c09bd30 msgr2=0x7fd06c071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd06c09bd30 0x7fd06c071790 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd06003e040 tx=0x7fd060004730 comp rx=0 tx=0).stop 2024-06-02T22:53:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 -- 172.21.15.82:0/1242619832 shutdown_connections 2024-06-02T22:53:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd05806be30 0x7fd05806e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd06c1525d0 0x7fd06c1482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd06c09bd30 0x7fd06c071790 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 --2- 172.21.15.82:0/1242619832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd054003f60 0x7fd06c09d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 -- 172.21.15.82:0/1242619832 >> 172.21.15.82:0/1242619832 conn(0x7fd06c0b19f0 msgr2=0x7fd06c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 -- 172.21.15.82:0/1242619832 shutdown_connections 2024-06-02T22:53:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.521+0000 7fd073238640 1 -- 172.21.15.82:0/1242619832 wait complete. 2024-06-02T22:53:27.532 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:53:27.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.632+0000 7f80a3c79640 1 Processor -- start 2024-06-02T22:53:27.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.632+0000 7f80a3c79640 1 -- start start 2024-06-02T22:53:27.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.633+0000 7f80a3c79640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f809c151d40 0x7f809c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.633+0000 7f80a3c79640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f809c0af990 0x7f809c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.633+0000 7f80a3c79640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f809c06cd20 con 0x7f809c06c910 2024-06-02T22:53:27.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.633+0000 7f80a3c79640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f809c15ebe0 con 0x7f809c151d40 2024-06-02T22:53:27.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.633+0000 7f80a3c79640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f809c15eec0 con 0x7f809c0af990 2024-06-02T22:53:27.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.633+0000 7f80a1a15640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f809c151d40 0x7f809c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.633+0000 7f80a2216640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f809c06c910 0x7f809c06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38186/0 (socket says 172.21.15.82:38186) 2024-06-02T22:53:27.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.633+0000 7f80a2216640 1 -- 172.21.15.82:0/1125340872 learned_addr learned my addr 172.21.15.82:0/1125340872 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:27.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.633+0000 7f80a1214640 1 --2- 172.21.15.82:0/1125340872 >> v2:172.21.15.184:3300/0 conn(0x7f809c0af990 0x7f809c06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.634+0000 7f80a1a15640 1 -- 172.21.15.82:0/1125340872 >> v2:172.21.15.184:3300/0 conn(0x7f809c0af990 msgr2=0x7f809c06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.634+0000 7f80a1a15640 1 --2- 172.21.15.82:0/1125340872 >> v2:172.21.15.184:3300/0 conn(0x7f809c0af990 0x7f809c06c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.634+0000 7f80a1a15640 1 -- 172.21.15.82:0/1125340872 >> v1:172.21.15.82:6789/0 conn(0x7f809c06c910 legacy=0x7f809c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.634+0000 7f80a1a15640 1 -- 172.21.15.82:0/1125340872 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c15f1a0 con 0x7f809c151d40 2024-06-02T22:53:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.634+0000 7f80a0a13640 1 -- 172.21.15.82:0/1125340872 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2460408699 0 0) 0x7f8094001490 con 0x7f809c06c910 2024-06-02T22:53:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.634+0000 7f80a1214640 1 --2- 172.21.15.82:0/1125340872 >> v2:172.21.15.184:3300/0 conn(0x7f809c0af990 0x7f809c06c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.634+0000 7f80a1a15640 1 --2- 172.21.15.82:0/1125340872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c151d40 0x7f809c15bed0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f809c070ee0 tx=0x7f809802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b275da1fe4b2317f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.634+0000 7f80a0a13640 1 -- 172.21.15.82:0/1125340872 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098037070 con 0x7f809c151d40 2024-06-02T22:53:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.634+0000 7f80a0a13640 1 -- 172.21.15.82:0/1125340872 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8098032440 con 0x7f809c151d40 2024-06-02T22:53:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.634+0000 7f80a0a13640 1 -- 172.21.15.82:0/1125340872 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098032810 con 0x7f809c151d40 2024-06-02T22:53:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.635+0000 7f80a3c79640 1 -- 172.21.15.82:0/1125340872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c151d40 msgr2=0x7f809c15bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.635+0000 7f80a3c79640 1 --2- 172.21.15.82:0/1125340872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c151d40 0x7f809c15bed0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f809c070ee0 tx=0x7f809802a1a0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.635+0000 7f80a3c79640 1 -- 172.21.15.82:0/1125340872 shutdown_connections 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.635+0000 7f80a3c79640 1 --2- 172.21.15.82:0/1125340872 >> v2:172.21.15.184:3300/0 conn(0x7f809c0af990 0x7f809c06c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.635+0000 7f80a3c79640 1 --2- 172.21.15.82:0/1125340872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c151d40 0x7f809c15bed0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.635+0000 7f80a3c79640 1 -- 172.21.15.82:0/1125340872 >> 172.21.15.82:0/1125340872 conn(0x7f809c071850 msgr2=0x7f809c071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.635+0000 7f80a3c79640 1 -- 172.21.15.82:0/1125340872 shutdown_connections 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.635+0000 7f80a3c79640 1 -- 172.21.15.82:0/1125340872 wait complete. 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.636+0000 7f80a3c79640 1 Processor -- start 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.636+0000 7f80a3c79640 1 -- start start 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a3c79640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f809c06c910 0x7f809c1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a3c79640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0af990 0x7f809c143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a3c79640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f809c151d40 0x7f809c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a3c79640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f809c152120 con 0x7f809c0af990 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a3c79640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f809c15f760 con 0x7f809c06c910 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a3c79640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f809c1522a0 con 0x7f809c151d40 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a1214640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0af990 0x7f809c143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a1214640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0af990 0x7f809c143f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50108/0 (socket says 172.21.15.82:50108) 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a1214640 1 -- 172.21.15.82:0/883033095 learned_addr learned my addr 172.21.15.82:0/883033095 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a1214640 1 -- 172.21.15.82:0/883033095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f809c151d40 msgr2=0x7f809c159e90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a1214640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f809c151d40 0x7f809c159e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a1214640 1 -- 172.21.15.82:0/883033095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f809c06c910 msgr2=0x7f809c1524b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a1214640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f809c06c910 0x7f809c1524b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.637+0000 7f80a1214640 1 -- 172.21.15.82:0/883033095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c1444d0 con 0x7f809c0af990 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.638+0000 7f80a1214640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0af990 0x7f809c143f90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f808c00e810 tx=0x7f808c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.638+0000 7f80927fc640 1 -- 172.21.15.82:0/883033095 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c00f040 con 0x7f809c0af990 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.638+0000 7f80927fc640 1 -- 172.21.15.82:0/883033095 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f808c004030 con 0x7f809c0af990 2024-06-02T22:53:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.638+0000 7f80a3c79640 1 -- 172.21.15.82:0/883033095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809c15c540 con 0x7f809c0af990 2024-06-02T22:53:27.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.638+0000 7f80927fc640 1 -- 172.21.15.82:0/883033095 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c004400 con 0x7f809c0af990 2024-06-02T22:53:27.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.638+0000 7f80a3c79640 1 -- 172.21.15.82:0/883033095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809c153010 con 0x7f809c0af990 2024-06-02T22:53:27.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.639+0000 7f80a3c79640 1 -- 172.21.15.82:0/883033095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809c0b2100 con 0x7f809c0af990 2024-06-02T22:53:27.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.639+0000 7f80927fc640 1 -- 172.21.15.82:0/883033095 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f808c00c6d0 con 0x7f809c0af990 2024-06-02T22:53:27.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.640+0000 7f80927fc640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f808006be60 0x7f808006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.640+0000 7f80927fc640 1 -- 172.21.15.82:0/883033095 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f808c08aee0 con 0x7f809c0af990 2024-06-02T22:53:27.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.640+0000 7f80a1a15640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f808006be60 0x7f808006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.640+0000 7f80a1a15640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f808006be60 0x7f808006e320 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8098034000 tx=0x7f809802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:27.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.644+0000 7f80927fc640 1 -- 172.21.15.82:0/883033095 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f809c0b2100 con 0x7f809c0af990 2024-06-02T22:53:27.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.820+0000 7f80a3c79640 1 -- 172.21.15.82:0/883033095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f809c068ad0 con 0x7f809c0af990 2024-06-02T22:53:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.822+0000 7f80927fc640 1 -- 172.21.15.82:0/883033095 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+18754 (secure 0 0 0) 0x7f809c1444d0 con 0x7f809c0af990 2024-06-02T22:53:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:27.822 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:53:12.581974+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:52:56.075878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-02T22:52:57.154913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-06-02T22:53:10.463415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 -- 172.21.15.82:0/883033095 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f808006be60 msgr2=0x7f808006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f808006be60 0x7f808006e320 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8098034000 tx=0x7f809802e000 comp rx=0 tx=0).stop 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 -- 172.21.15.82:0/883033095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0af990 msgr2=0x7f809c143f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0af990 0x7f809c143f90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f808c00e810 tx=0x7f808c00ecd0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 -- 172.21.15.82:0/883033095 shutdown_connections 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f808006be60 0x7f808006e320 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f809c151d40 0x7f809c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c0af990 0x7f809c143f90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 --2- 172.21.15.82:0/883033095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f809c06c910 0x7f809c1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 -- 172.21.15.82:0/883033095 >> 172.21.15.82:0/883033095 conn(0x7f809c071850 msgr2=0x7f809c0b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 -- 172.21.15.82:0/883033095 shutdown_connections 2024-06-02T22:53:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.824+0000 7f80a3c79640 1 -- 172.21.15.82:0/883033095 wait complete. 2024-06-02T22:53:27.835 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-02T22:53:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.936+0000 7f428e5c8640 1 Processor -- start 2024-06-02T22:53:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.936+0000 7f428e5c8640 1 -- start start 2024-06-02T22:53:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428e5c8640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f428815f1a0 0x7f42880d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428e5c8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42880cef70 0x7f42880cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428e5c8640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f428815f5e0 con 0x7f42880d2680 2024-06-02T22:53:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428e5c8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f42880d13e0 con 0x7f42880cef70 2024-06-02T22:53:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428e5c8640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f42880d0ad0 con 0x7f428815f1a0 2024-06-02T22:53:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428cb65640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42880cef70 0x7f42880cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428cb65640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42880cef70 0x7f42880cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50120/0 (socket says 172.21.15.82:50120) 2024-06-02T22:53:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428cb65640 1 -- 172.21.15.82:0/3141155082 learned_addr learned my addr 172.21.15.82:0/3141155082 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f42877fe640 1 --2- 172.21.15.82:0/3141155082 >> v2:172.21.15.184:3300/0 conn(0x7f428815f1a0 0x7f42880d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428cb65640 1 -- 172.21.15.82:0/3141155082 >> v2:172.21.15.184:3300/0 conn(0x7f428815f1a0 msgr2=0x7f42880d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428cb65640 1 --2- 172.21.15.82:0/3141155082 >> v2:172.21.15.184:3300/0 conn(0x7f428815f1a0 0x7f42880d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428cb65640 1 -- 172.21.15.82:0/3141155082 >> v1:172.21.15.184:6789/0 conn(0x7f42880d2680 legacy=0x7f42880d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f428cb65640 1 -- 172.21.15.82:0/3141155082 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428815f890 con 0x7f42880cef70 2024-06-02T22:53:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.937+0000 7f42877fe640 1 --2- 172.21.15.82:0/3141155082 >> v2:172.21.15.184:3300/0 conn(0x7f428815f1a0 0x7f42880d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.938+0000 7f428cb65640 1 --2- 172.21.15.82:0/3141155082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42880cef70 0x7f42880cf3c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42880d1560 tx=0x7f428002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da64548378432904 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.938+0000 7f4286ffd640 1 -- 172.21.15.82:0/3141155082 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280036070 con 0x7f42880cef70 2024-06-02T22:53:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.938+0000 7f4286ffd640 1 -- 172.21.15.82:0/3141155082 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4280031600 con 0x7f42880cef70 2024-06-02T22:53:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.938+0000 7f4286ffd640 1 -- 172.21.15.82:0/3141155082 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42800319d0 con 0x7f42880cef70 2024-06-02T22:53:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.939+0000 7f428e5c8640 1 -- 172.21.15.82:0/3141155082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42880cef70 msgr2=0x7f42880cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.939+0000 7f428e5c8640 1 --2- 172.21.15.82:0/3141155082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42880cef70 0x7f42880cf3c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42880d1560 tx=0x7f428002a6d0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.939+0000 7f428e5c8640 1 -- 172.21.15.82:0/3141155082 shutdown_connections 2024-06-02T22:53:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.939+0000 7f428e5c8640 1 --2- 172.21.15.82:0/3141155082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42880cef70 0x7f42880cf3c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.939+0000 7f428e5c8640 1 --2- 172.21.15.82:0/3141155082 >> v2:172.21.15.184:3300/0 conn(0x7f428815f1a0 0x7f42880d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.939+0000 7f428e5c8640 1 -- 172.21.15.82:0/3141155082 >> 172.21.15.82:0/3141155082 conn(0x7f428809d3f0 msgr2=0x7f42880d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.939+0000 7f428e5c8640 1 -- 172.21.15.82:0/3141155082 shutdown_connections 2024-06-02T22:53:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.939+0000 7f428e5c8640 1 -- 172.21.15.82:0/3141155082 wait complete. 2024-06-02T22:53:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.940+0000 7f428e5c8640 1 Processor -- start 2024-06-02T22:53:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.940+0000 7f428e5c8640 1 -- start start 2024-06-02T22:53:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f428e5c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42880cef70 0x7f42880b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f428e5c8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42880d2680 0x7f42880cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f428e5c8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f428815f1a0 0x7f42880b9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f428e5c8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f42880d4f00 con 0x7f42880cef70 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f428e5c8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f42880d1070 con 0x7f42880d2680 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f428e5c8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f42880d1870 con 0x7f428815f1a0 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f4287fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42880cef70 0x7f42880b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f4287fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42880cef70 0x7f42880b7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50132/0 (socket says 172.21.15.82:50132) 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f4287fff640 1 -- 172.21.15.82:0/522102228 learned_addr learned my addr 172.21.15.82:0/522102228 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f42877fe640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42880d2680 0x7f42880cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f428cb65640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f428815f1a0 0x7f42880b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f4287fff640 1 -- 172.21.15.82:0/522102228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f428815f1a0 msgr2=0x7f42880b9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f4287fff640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f428815f1a0 0x7f42880b9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f4287fff640 1 -- 172.21.15.82:0/522102228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42880d2680 msgr2=0x7f42880cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f4287fff640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42880d2680 0x7f42880cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f4287fff640 1 -- 172.21.15.82:0/522102228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42880b85a0 con 0x7f42880cef70 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f428cb65640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f428815f1a0 0x7f42880b9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.941+0000 7f4287fff640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42880cef70 0x7f42880b7ea0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f427800c430 tx=0x7f427800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.942+0000 7f4284ff9640 1 -- 172.21.15.82:0/522102228 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278011790 con 0x7f42880cef70 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.942+0000 7f4284ff9640 1 -- 172.21.15.82:0/522102228 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4278017070 con 0x7f42880cef70 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.942+0000 7f428e5c8640 1 -- 172.21.15.82:0/522102228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42880b8880 con 0x7f42880cef70 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.942+0000 7f4284ff9640 1 -- 172.21.15.82:0/522102228 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278011bb0 con 0x7f42880cef70 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.942+0000 7f428e5c8640 1 -- 172.21.15.82:0/522102228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42880b8e40 con 0x7f42880cef70 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.943+0000 7f428e5c8640 1 -- 172.21.15.82:0/522102228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4288068430 con 0x7f42880cef70 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.943+0000 7f4284ff9640 1 -- 172.21.15.82:0/522102228 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f427801c460 con 0x7f42880cef70 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.944+0000 7f4284ff9640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f427406be30 0x7f427406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.944+0000 7f42877fe640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f427406be30 0x7f427406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.944+0000 7f4284ff9640 1 -- 172.21.15.82:0/522102228 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f427808af90 con 0x7f42880cef70 2024-06-02T22:53:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.944+0000 7f42877fe640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f427406be30 0x7f427406e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f428815c250 tx=0x7f427c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:27.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:27.948+0000 7f4284ff9640 1 -- 172.21.15.82:0/522102228 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f42780596c0 con 0x7f42880cef70 2024-06-02T22:53:28.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.155+0000 7f428e5c8640 1 -- 172.21.15.82:0/522102228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f42880d41a0 con 0x7f42880cef70 2024-06-02T22:53:28.156 INFO:tasks.ceph.mon.a.smithi082.stderr:2024-06-02T22:53:28.156+0000 7fc5cceb2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T22:53:28.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.157+0000 7f4284ff9640 1 -- 172.21.15.82:0/522102228 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f4278058fc0 con 0x7f42880cef70 2024-06-02T22:53:28.158 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-02T22:53:28.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 -- 172.21.15.82:0/522102228 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f427406be30 msgr2=0x7f427406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:28.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f427406be30 0x7f427406e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f428815c250 tx=0x7f427c008040 comp rx=0 tx=0).stop 2024-06-02T22:53:28.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 -- 172.21.15.82:0/522102228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42880cef70 msgr2=0x7f42880b7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:28.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42880cef70 0x7f42880b7ea0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f427800c430 tx=0x7f427800c8f0 comp rx=0 tx=0).stop 2024-06-02T22:53:28.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 -- 172.21.15.82:0/522102228 shutdown_connections 2024-06-02T22:53:28.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f427406be30 0x7f427406e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f428815f1a0 0x7f42880b9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42880d2680 0x7f42880cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 --2- 172.21.15.82:0/522102228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42880cef70 0x7f42880b7ea0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 -- 172.21.15.82:0/522102228 >> 172.21.15.82:0/522102228 conn(0x7f428809d3f0 msgr2=0x7f42880c9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 -- 172.21.15.82:0/522102228 shutdown_connections 2024-06-02T22:53:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.160+0000 7f428e5c8640 1 -- 172.21.15.82:0/522102228 wait complete. 2024-06-02T22:53:28.163 INFO:tasks.ceph.mds.b.smithi184.stderr: -4440> 2024-06-02T22:52:51.940+0000 7f52a6c11640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6834/0: (98) Address already in use 2024-06-02T22:53:28.164 INFO:tasks.ceph.mds.b.smithi184.stderr: -3151> 2024-06-02T22:53:03.810+0000 7f52a0c05640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T22:53:28.172 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-02T22:53:28.195 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2024-06-02T22:53:28.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.275+0000 7f9cb8293640 1 Processor -- start 2024-06-02T22:53:28.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.275+0000 7f9cb8293640 1 -- start start 2024-06-02T22:53:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb8293640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9cb00b3b40 0x7f9cb00b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb8293640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 0x7f9cb00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb8293640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb015c870 con 0x7f9cb00d0020 2024-06-02T22:53:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb8293640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f9cb015cb50 con 0x7f9cb00b3b40 2024-06-02T22:53:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb8293640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb015ce30 con 0x7f9cb00b48e0 2024-06-02T22:53:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb602f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9cb00b3b40 0x7f9cb00b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:28.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb602f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9cb00b3b40 0x7f9cb00b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50134/0 (socket says 172.21.15.82:50134) 2024-06-02T22:53:28.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb602f640 1 -- 172.21.15.82:0/3194396046 learned_addr learned my addr 172.21.15.82:0/3194396046 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:28.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb582e640 1 --2- 172.21.15.82:0/3194396046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 0x7f9cb00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:28.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb602f640 1 -- 172.21.15.82:0/3194396046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 msgr2=0x7f9cb00b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:28.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb602f640 1 --2- 172.21.15.82:0/3194396046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 0x7f9cb00b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:28.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb602f640 1 -- 172.21.15.82:0/3194396046 >> v1:172.21.15.184:6789/0 conn(0x7f9cb00d0020 legacy=0x7f9cb006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:28.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb602f640 1 -- 172.21.15.82:0/3194396046 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb015d110 con 0x7f9cb00b3b40 2024-06-02T22:53:28.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.276+0000 7f9cb582e640 1 --2- 172.21.15.82:0/3194396046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 0x7f9cb00b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:28.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.277+0000 7f9cb602f640 1 --2- 172.21.15.82:0/3194396046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb00b3b40 0x7f9cb00b2bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009870 tx=0x7f9cac02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1793fcaf8eb062 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:28.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.277+0000 7f9cb502d640 1 -- 172.21.15.82:0/3194396046 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac037070 con 0x7f9cb00b3b40 2024-06-02T22:53:28.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.277+0000 7f9cb502d640 1 -- 172.21.15.82:0/3194396046 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cac032440 con 0x7f9cb00b3b40 2024-06-02T22:53:28.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.277+0000 7f9cb502d640 1 -- 172.21.15.82:0/3194396046 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac032810 con 0x7f9cb00b3b40 2024-06-02T22:53:28.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.278+0000 7f9cb8293640 1 -- 172.21.15.82:0/3194396046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb00b3b40 msgr2=0x7f9cb00b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:28.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.278+0000 7f9cb8293640 1 --2- 172.21.15.82:0/3194396046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb00b3b40 0x7f9cb00b2bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009870 tx=0x7f9cac02a210 comp rx=0 tx=0).stop 2024-06-02T22:53:28.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.278+0000 7f9cb8293640 1 -- 172.21.15.82:0/3194396046 shutdown_connections 2024-06-02T22:53:28.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.278+0000 7f9cb8293640 1 --2- 172.21.15.82:0/3194396046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 0x7f9cb00b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:28.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.278+0000 7f9cb8293640 1 --2- 172.21.15.82:0/3194396046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb00b3b40 0x7f9cb00b2bf0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:28.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.278+0000 7f9cb8293640 1 -- 172.21.15.82:0/3194396046 >> 172.21.15.82:0/3194396046 conn(0x7f9cb00b1d10 msgr2=0x7f9cb00b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:28.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.278+0000 7f9cb8293640 1 -- 172.21.15.82:0/3194396046 shutdown_connections 2024-06-02T22:53:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.278+0000 7f9cb8293640 1 -- 172.21.15.82:0/3194396046 wait complete. 2024-06-02T22:53:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.279+0000 7f9cb8293640 1 Processor -- start 2024-06-02T22:53:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.279+0000 7f9cb8293640 1 -- start start 2024-06-02T22:53:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb8293640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cb00b3b40 0x7f9cb009bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb8293640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 0x7f9cb01e23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb8293640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb00d0020 0x7f9cb01f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:28.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb8293640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb015c490 con 0x7f9cb00d0020 2024-06-02T22:53:28.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb8293640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb00b3f20 con 0x7f9cb00b3b40 2024-06-02T22:53:28.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb8293640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb015c610 con 0x7f9cb00b48e0 2024-06-02T22:53:28.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb6830640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb00d0020 0x7f9cb01f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:28.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb6830640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb00d0020 0x7f9cb01f1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50150/0 (socket says 172.21.15.82:50150) 2024-06-02T22:53:28.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb6830640 1 -- 172.21.15.82:0/3513858928 learned_addr learned my addr 172.21.15.82:0/3513858928 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb602f640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cb00b3b40 0x7f9cb009bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb582e640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 0x7f9cb01e23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb6830640 1 -- 172.21.15.82:0/3513858928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 msgr2=0x7f9cb01e23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb6830640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 0x7f9cb01e23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb6830640 1 -- 172.21.15.82:0/3513858928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cb00b3b40 msgr2=0x7f9cb009bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb6830640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cb00b3b40 0x7f9cb009bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb6830640 1 -- 172.21.15.82:0/3513858928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb009c300 con 0x7f9cb00d0020 2024-06-02T22:53:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb602f640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cb00b3b40 0x7f9cb009bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb582e640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 0x7f9cb01e23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb6830640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb00d0020 0x7f9cb01f1610 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800c780 tx=0x7f9ca800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9ca6ffd640 1 -- 172.21.15.82:0/3513858928 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8004b60 con 0x7f9cb00d0020 2024-06-02T22:53:28.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9ca6ffd640 1 -- 172.21.15.82:0/3513858928 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca8004d00 con 0x7f9cb00d0020 2024-06-02T22:53:28.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb8293640 1 -- 172.21.15.82:0/3513858928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb009c5e0 con 0x7f9cb00d0020 2024-06-02T22:53:28.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9ca6ffd640 1 -- 172.21.15.82:0/3513858928 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca800aa90 con 0x7f9cb00d0020 2024-06-02T22:53:28.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.280+0000 7f9cb8293640 1 -- 172.21.15.82:0/3513858928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb009cba0 con 0x7f9cb00d0020 2024-06-02T22:53:28.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.281+0000 7f9cb8293640 1 -- 172.21.15.82:0/3513858928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb00b3250 con 0x7f9cb00d0020 2024-06-02T22:53:28.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.282+0000 7f9ca6ffd640 1 -- 172.21.15.82:0/3513858928 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ca800ac30 con 0x7f9cb00d0020 2024-06-02T22:53:28.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.282+0000 7f9ca6ffd640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c9406be60 0x7f9c9406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:28.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.282+0000 7f9cb602f640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c9406be60 0x7f9c9406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:28.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.282+0000 7f9ca6ffd640 1 -- 172.21.15.82:0/3513858928 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6582+0+0 (secure 0 0 0) 0x7f9ca808b6e0 con 0x7f9cb00d0020 2024-06-02T22:53:28.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.283+0000 7f9cb602f640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c9406be60 0x7f9c9406e320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9cac034000 tx=0x7f9cac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:28.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.287+0000 7f9ca6ffd640 1 -- 172.21.15.82:0/3513858928 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9cb00b3250 con 0x7f9cb00d0020 2024-06-02T22:53:28.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:28.496+0000 7f9cb8293640 1 -- 172.21.15.82:0/3513858928 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9cb014a300 con 0x7f9cb00d0020 2024-06-02T22:53:29.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.158+0000 7f9ca6ffd640 1 -- 172.21.15.82:0/3513858928 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f9ca8059db0 con 0x7f9cb00d0020 2024-06-02T22:53:29.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 -- 172.21.15.82:0/3513858928 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c9406be60 msgr2=0x7f9c9406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:29.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c9406be60 0x7f9c9406e320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9cac034000 tx=0x7f9cac02e000 comp rx=0 tx=0).stop 2024-06-02T22:53:29.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 -- 172.21.15.82:0/3513858928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb00d0020 msgr2=0x7f9cb01f1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:29.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb00d0020 0x7f9cb01f1610 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800c780 tx=0x7f9ca800cc40 comp rx=0 tx=0).stop 2024-06-02T22:53:29.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 -- 172.21.15.82:0/3513858928 shutdown_connections 2024-06-02T22:53:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f9c9406be60 0x7f9c9406e320 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cb00d0020 0x7f9cb01f1610 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb00b48e0 0x7f9cb01e23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 --2- 172.21.15.82:0/3513858928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cb00b3b40 0x7f9cb009bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 -- 172.21.15.82:0/3513858928 >> 172.21.15.82:0/3513858928 conn(0x7f9cb00b1d10 msgr2=0x7f9cb00b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 -- 172.21.15.82:0/3513858928 shutdown_connections 2024-06-02T22:53:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.161+0000 7f9cb8293640 1 -- 172.21.15.82:0/3513858928 wait complete. 2024-06-02T22:53:29.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-02T22:53:29.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.280+0000 7f9009a12640 1 Processor -- start 2024-06-02T22:53:29.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.280+0000 7f9009a12640 1 -- start start 2024-06-02T22:53:29.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.281+0000 7f9009a12640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f90040b4430 0x7f90040d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:29.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.281+0000 7f9009a12640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f900409b690 con 0x7f900415e380 2024-06-02T22:53:29.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.281+0000 7f9009a12640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90040d1130 con 0x7f900409aa10 2024-06-02T22:53:29.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.281+0000 7f9009a12640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f900415e760 con 0x7f90040b4430 2024-06-02T22:53:29.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.281+0000 7f8ffa7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f90040b4430 0x7f90040d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:29.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.281+0000 7f9002ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f900415e380 0x7f900406ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38198/0 (socket says 172.21.15.82:38198) 2024-06-02T22:53:29.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.281+0000 7f9002ffd640 1 -- 172.21.15.82:0/482493815 learned_addr learned my addr 172.21.15.82:0/482493815 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:29.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.282+0000 7f8ffa7fc640 1 -- 172.21.15.82:0/482493815 >> v1:172.21.15.184:6789/0 conn(0x7f900409aa10 legacy=0x7f90040cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:29.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.282+0000 7f8ffa7fc640 1 -- 172.21.15.82:0/482493815 >> v1:172.21.15.82:6789/0 conn(0x7f900415e380 legacy=0x7f900406ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:29.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.282+0000 7f8ffa7fc640 1 -- 172.21.15.82:0/482493815 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900406f4f0 con 0x7f90040b4430 2024-06-02T22:53:29.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.282+0000 7f90027fc640 1 -- 172.21.15.82:0/482493815 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828886157 0 0) 0x7f900409b690 con 0x7f900415e380 2024-06-02T22:53:29.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.282+0000 7f8ffa7fc640 1 --2- 172.21.15.82:0/482493815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90040b4430 0x7f90040d0ac0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0097a0 tx=0x7f8fec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6efc5c49b82e03d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:29.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.283+0000 7f90027fc640 1 -- 172.21.15.82:0/482493815 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec037070 con 0x7f90040b4430 2024-06-02T22:53:29.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.283+0000 7f90027fc640 1 -- 172.21.15.82:0/482493815 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec032440 con 0x7f90040b4430 2024-06-02T22:53:29.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.283+0000 7f90027fc640 1 -- 172.21.15.82:0/482493815 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec032810 con 0x7f90040b4430 2024-06-02T22:53:29.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.283+0000 7f9009a12640 1 -- 172.21.15.82:0/482493815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90040b4430 msgr2=0x7f90040d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:29.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.283+0000 7f9009a12640 1 --2- 172.21.15.82:0/482493815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90040b4430 0x7f90040d0ac0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0097a0 tx=0x7f8fec02a1e0 comp rx=0 tx=0).stop 2024-06-02T22:53:29.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.283+0000 7f9009a12640 1 -- 172.21.15.82:0/482493815 shutdown_connections 2024-06-02T22:53:29.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.283+0000 7f9009a12640 1 --2- 172.21.15.82:0/482493815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90040b4430 0x7f90040d0ac0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:29.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.283+0000 7f9009a12640 1 -- 172.21.15.82:0/482493815 >> 172.21.15.82:0/482493815 conn(0x7f90040b3910 msgr2=0x7f90040b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:29.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.283+0000 7f9009a12640 1 -- 172.21.15.82:0/482493815 shutdown_connections 2024-06-02T22:53:29.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.283+0000 7f9009a12640 1 -- 172.21.15.82:0/482493815 wait complete. 2024-06-02T22:53:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.284+0000 7f9009a12640 1 Processor -- start 2024-06-02T22:53:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.285+0000 7f9009a12640 1 -- start start 2024-06-02T22:53:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.285+0000 7f9009a12640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f900409aa10 0x7f900415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.285+0000 7f9009a12640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90040b4430 0x7f90040c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.285+0000 7f9009a12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f900415e380 0x7f90040c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.285+0000 7f9009a12640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f90040706e0 con 0x7f900415e380 2024-06-02T22:53:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.285+0000 7f9009a12640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f900406fb40 con 0x7f900409aa10 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.285+0000 7f9009a12640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f90040ccb80 con 0x7f90040b4430 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.285+0000 7f90037fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f900415e380 0x7f90040c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.285+0000 7f90037fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f900415e380 0x7f90040c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50176/0 (socket says 172.21.15.82:50176) 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.285+0000 7f90037fe640 1 -- 172.21.15.82:0/538907806 learned_addr learned my addr 172.21.15.82:0/538907806 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f8ffa7fc640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90040b4430 0x7f90040c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f9002ffd640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f900409aa10 0x7f900415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f90037fe640 1 -- 172.21.15.82:0/538907806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90040b4430 msgr2=0x7f90040c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f90037fe640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90040b4430 0x7f90040c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f90037fe640 1 -- 172.21.15.82:0/538907806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f900409aa10 msgr2=0x7f900415cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f90037fe640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f900409aa10 0x7f900415cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f90037fe640 1 -- 172.21.15.82:0/538907806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90040b6ab0 con 0x7f900415e380 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f9002ffd640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f900409aa10 0x7f900415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:29.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f90037fe640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f900415e380 0x7f90040c8280 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c7b0 tx=0x7f8ffc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:29.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f9000ff9640 1 -- 172.21.15.82:0/538907806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc004b60 con 0x7f900415e380 2024-06-02T22:53:29.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f9000ff9640 1 -- 172.21.15.82:0/538907806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ffc004d00 con 0x7f900415e380 2024-06-02T22:53:29.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f9009a12640 1 -- 172.21.15.82:0/538907806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90040b64f0 con 0x7f900415e380 2024-06-02T22:53:29.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f9000ff9640 1 -- 172.21.15.82:0/538907806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc00aa90 con 0x7f900415e380 2024-06-02T22:53:29.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.286+0000 7f9009a12640 1 -- 172.21.15.82:0/538907806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90040c8f90 con 0x7f900415e380 2024-06-02T22:53:29.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.287+0000 7f9009a12640 1 -- 172.21.15.82:0/538907806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9004068540 con 0x7f900415e380 2024-06-02T22:53:29.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.287+0000 7f9000ff9640 1 -- 172.21.15.82:0/538907806 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ffc00ac30 con 0x7f900415e380 2024-06-02T22:53:29.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.288+0000 7f9000ff9640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8fe406be30 0x7f8fe406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:29.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.288+0000 7f9000ff9640 1 -- 172.21.15.82:0/538907806 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6582+0+0 (secure 0 0 0) 0x7f8ffc08b3e0 con 0x7f900415e380 2024-06-02T22:53:29.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.288+0000 7f9002ffd640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8fe406be30 0x7f8fe406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:29.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.288+0000 7f9002ffd640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8fe406be30 0x7f8fe406e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4000f60 tx=0x7f8ff4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:29.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.292+0000 7f9000ff9640 1 -- 172.21.15.82:0/538907806 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8ffc020070 con 0x7f900415e380 2024-06-02T22:53:29.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:29.463+0000 7f9009a12640 1 -- 172.21.15.82:0/538907806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f90040753c0 con 0x7f900415e380 2024-06-02T22:53:30.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.160+0000 7f9000ff9640 1 -- 172.21.15.82:0/538907806 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) ==== 181+0+0 (secure 0 0 0) 0x7f8ffc059ab0 con 0x7f900415e380 2024-06-02T22:53:30.161 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2024-06-02T22:53:30.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 -- 172.21.15.82:0/538907806 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8fe406be30 msgr2=0x7f8fe406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:30.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8fe406be30 0x7f8fe406e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4000f60 tx=0x7f8ff4009040 comp rx=0 tx=0).stop 2024-06-02T22:53:30.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 -- 172.21.15.82:0/538907806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f900415e380 msgr2=0x7f90040c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:30.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f900415e380 0x7f90040c8280 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c7b0 tx=0x7f8ffc00cc70 comp rx=0 tx=0).stop 2024-06-02T22:53:30.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 -- 172.21.15.82:0/538907806 shutdown_connections 2024-06-02T22:53:30.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8fe406be30 0x7f8fe406e2f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f900415e380 0x7f90040c8280 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90040b4430 0x7f90040c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 --2- 172.21.15.82:0/538907806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f900409aa10 0x7f900415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 -- 172.21.15.82:0/538907806 >> 172.21.15.82:0/538907806 conn(0x7f90040b3910 msgr2=0x7f900406ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:30.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 -- 172.21.15.82:0/538907806 shutdown_connections 2024-06-02T22:53:30.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.163+0000 7f9009a12640 1 -- 172.21.15.82:0/538907806 wait complete. 2024-06-02T22:53:30.177 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-02T22:53:30.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.283+0000 7f24946b2640 1 Processor -- start 2024-06-02T22:53:30.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.283+0000 7f24946b2640 1 -- start start 2024-06-02T22:53:30.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f24946b2640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f248c0ccd30 0x7f248c166db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f24946b2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f248c0722a0 con 0x7f248c15c740 2024-06-02T22:53:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f24946b2640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f248c072570 con 0x7f248c15be50 2024-06-02T22:53:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f24946b2640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f248c0b3020 con 0x7f248c0ccd30 2024-06-02T22:53:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f2491c4d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f248c15c740 0x7f248c0cc620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38206/0 (socket says 172.21.15.82:38206) 2024-06-02T22:53:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f2491c4d640 1 -- 172.21.15.82:0/2442295507 learned_addr learned my addr 172.21.15.82:0/2442295507 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f2492c4f640 1 --2- 172.21.15.82:0/2442295507 >> v2:172.21.15.184:3300/0 conn(0x7f248c0ccd30 0x7f248c166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315787482 0 0) 0x7f248c0722a0 con 0x7f248c15c740 2024-06-02T22:53:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2478003520 con 0x7f248c15c740 2024-06-02T22:53:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4115249417 0 0) 0x7f2478003520 con 0x7f248c15c740 2024-06-02T22:53:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 >> v2:172.21.15.184:3300/0 conn(0x7f248c0ccd30 msgr2=0x7f248c166db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f249144c640 1 --2- 172.21.15.82:0/2442295507 >> v2:172.21.15.184:3300/0 conn(0x7f248c0ccd30 0x7f248c166db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 >> v1:172.21.15.184:6789/0 conn(0x7f248c15be50 legacy=0x7f248c071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c072850 con 0x7f248c15c740 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f247c001670 con 0x7f248c15c740 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.284+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 >> v1:172.21.15.82:6789/0 conn(0x7f248c15c740 legacy=0x7f248c0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f249144c640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24780039b0 0x7f2478003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f249144c640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2478004800 0x7f2478004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f249144c640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24780051c0 0x7f247800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f248c0b3020 con 0x7f2478004800 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f247800c060 con 0x7f24780051c0 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f247800c260 con 0x7f24780039b0 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f2491c4d640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2478004800 0x7f2478004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f2492c4f640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24780051c0 0x7f247800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f249244e640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24780039b0 0x7f2478003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f2491c4d640 1 -- 172.21.15.82:0/2442295507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24780039b0 msgr2=0x7f2478003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f2491c4d640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24780039b0 0x7f2478003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f2491c4d640 1 -- 172.21.15.82:0/2442295507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24780051c0 msgr2=0x7f247800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f2491c4d640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24780051c0 0x7f247800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f2492c4f640 1 -- 172.21.15.82:0/2442295507 reap_dead start 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f2491c4d640 1 -- 172.21.15.82:0/2442295507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2478003520 con 0x7f2478004800 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.285+0000 7f249244e640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24780039b0 0x7f2478003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.286+0000 7f2491c4d640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2478004800 0x7f2478004c80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c240 tx=0x7f2478005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc72adaae808270b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.286+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c007cf0 con 0x7f2478004800 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.286+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c005af0 con 0x7f2478004800 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.286+0000 7f249144c640 1 -- 172.21.15.82:0/2442295507 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c007070 con 0x7f2478004800 2024-06-02T22:53:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.286+0000 7f24946b2640 1 -- 172.21.15.82:0/2442295507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2478004800 msgr2=0x7f2478004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.286+0000 7f24946b2640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2478004800 0x7f2478004c80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c240 tx=0x7f2478005830 comp rx=0 tx=0).stop 2024-06-02T22:53:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.286+0000 7f24946b2640 1 -- 172.21.15.82:0/2442295507 shutdown_connections 2024-06-02T22:53:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.286+0000 7f24946b2640 1 --2- 172.21.15.82:0/2442295507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2478004800 0x7f2478004c80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.286+0000 7f24946b2640 1 -- 172.21.15.82:0/2442295507 >> 172.21.15.82:0/2442295507 conn(0x7f248c0b1980 msgr2=0x7f248c0b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.286+0000 7f24946b2640 1 -- 172.21.15.82:0/2442295507 shutdown_connections 2024-06-02T22:53:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.286+0000 7f24946b2640 1 -- 172.21.15.82:0/2442295507 wait complete. 2024-06-02T22:53:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.287+0000 7f24946b2640 1 Processor -- start 2024-06-02T22:53:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.288+0000 7f24946b2640 1 -- start start 2024-06-02T22:53:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.288+0000 7f24946b2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2478004800 0x7f248c1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.288+0000 7f24946b2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f248c09aa10 0x7f248c0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.288+0000 7f24946b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f248c0b04e0 0x7f248c09c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.288+0000 7f24946b2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f248c15c230 con 0x7f248c0b04e0 2024-06-02T22:53:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.288+0000 7f24946b2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f248c072e10 con 0x7f2478004800 2024-06-02T22:53:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.288+0000 7f24946b2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f248c15c3b0 con 0x7f248c09aa10 2024-06-02T22:53:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.288+0000 7f2492c4f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f248c0b04e0 0x7f248c09c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.288+0000 7f2492c4f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f248c0b04e0 0x7f248c09c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50186/0 (socket says 172.21.15.82:50186) 2024-06-02T22:53:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.288+0000 7f2492c4f640 1 -- 172.21.15.82:0/4093455617 learned_addr learned my addr 172.21.15.82:0/4093455617 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f249244e640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2478004800 0x7f248c1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f2491c4d640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f248c09aa10 0x7f248c0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f2492c4f640 1 -- 172.21.15.82:0/4093455617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f248c09aa10 msgr2=0x7f248c0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f2492c4f640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f248c09aa10 0x7f248c0affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f2492c4f640 1 -- 172.21.15.82:0/4093455617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2478004800 msgr2=0x7f248c1495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f2492c4f640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2478004800 0x7f248c1495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f2492c4f640 1 -- 172.21.15.82:0/4093455617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c1f5080 con 0x7f248c0b04e0 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f2491c4d640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f248c09aa10 0x7f248c0affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f2492c4f640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f248c0b04e0 0x7f248c09c410 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f248c073130 tx=0x7f248400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f2482ffd640 1 -- 172.21.15.82:0/4093455617 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248400fce0 con 0x7f248c0b04e0 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f2482ffd640 1 -- 172.21.15.82:0/4093455617 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248400fe80 con 0x7f248c0b04e0 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f24946b2640 1 -- 172.21.15.82:0/4093455617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248c1f5360 con 0x7f248c0b04e0 2024-06-02T22:53:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f2482ffd640 1 -- 172.21.15.82:0/4093455617 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484015670 con 0x7f248c0b04e0 2024-06-02T22:53:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.289+0000 7f24946b2640 1 -- 172.21.15.82:0/4093455617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248c1f5920 con 0x7f248c0b04e0 2024-06-02T22:53:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.290+0000 7f24946b2640 1 -- 172.21.15.82:0/4093455617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248c068540 con 0x7f248c0b04e0 2024-06-02T22:53:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.290+0000 7f2482ffd640 1 -- 172.21.15.82:0/4093455617 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2484015810 con 0x7f248c0b04e0 2024-06-02T22:53:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.291+0000 7f2482ffd640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f247006be30 0x7f247006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.291+0000 7f249244e640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f247006be30 0x7f247006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.291+0000 7f2482ffd640 1 -- 172.21.15.82:0/4093455617 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6144+0+0 (secure 0 0 0) 0x7f248408bf30 con 0x7f248c0b04e0 2024-06-02T22:53:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.291+0000 7f249244e640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f247006be30 0x7f247006e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2488000c00 tx=0x7f2488009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:30.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.295+0000 7f2482ffd640 1 -- 172.21.15.82:0/4093455617 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2484019030 con 0x7f248c0b04e0 2024-06-02T22:53:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:30.471+0000 7f24946b2640 1 -- 172.21.15.82:0/4093455617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f248c0b2c80 con 0x7f248c0b04e0 2024-06-02T22:53:31.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.161+0000 7f2482ffd640 1 -- 172.21.15.82:0/4093455617 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) ==== 169+0+0 (secure 0 0 0) 0x7f2484010040 con 0x7f248c0b04e0 2024-06-02T22:53:31.162 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2024-06-02T22:53:31.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.163+0000 7f24946b2640 1 -- 172.21.15.82:0/4093455617 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f247006be30 msgr2=0x7f247006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:31.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.163+0000 7f24946b2640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f247006be30 0x7f247006e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2488000c00 tx=0x7f2488009040 comp rx=0 tx=0).stop 2024-06-02T22:53:31.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.163+0000 7f24946b2640 1 -- 172.21.15.82:0/4093455617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f248c0b04e0 msgr2=0x7f248c09c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:31.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.163+0000 7f24946b2640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f248c0b04e0 0x7f248c09c410 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f248c073130 tx=0x7f248400f1b0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.164+0000 7f24946b2640 1 -- 172.21.15.82:0/4093455617 shutdown_connections 2024-06-02T22:53:31.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.164+0000 7f24946b2640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f247006be30 0x7f247006e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.164+0000 7f24946b2640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f248c0b04e0 0x7f248c09c410 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.164+0000 7f24946b2640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f248c09aa10 0x7f248c0affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.164+0000 7f24946b2640 1 --2- 172.21.15.82:0/4093455617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2478004800 0x7f248c1495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.164+0000 7f24946b2640 1 -- 172.21.15.82:0/4093455617 >> 172.21.15.82:0/4093455617 conn(0x7f248c0b1980 msgr2=0x7f248c15e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:31.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.164+0000 7f24946b2640 1 -- 172.21.15.82:0/4093455617 shutdown_connections 2024-06-02T22:53:31.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.164+0000 7f24946b2640 1 -- 172.21.15.82:0/4093455617 wait complete. 2024-06-02T22:53:31.179 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2024-06-02T22:53:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.284+0000 7fef6eaba640 1 Processor -- start 2024-06-02T22:53:31.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.284+0000 7fef6eaba640 1 -- start start 2024-06-02T22:53:31.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.285+0000 7fef6eaba640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef680d49f0 0x7fef680d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.285+0000 7fef6eaba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef6815ec90 con 0x7fef6815e670 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.285+0000 7fef6eaba640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef6815ef70 con 0x7fef680d0e00 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.285+0000 7fef6eaba640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fef6815fa50 con 0x7fef680d49f0 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.285+0000 7fef6c856640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fef6815e670 0x7fef680d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34854/0 (socket says 172.21.15.82:34854) 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.285+0000 7fef6c856640 1 -- 172.21.15.82:0/2463825644 learned_addr learned my addr 172.21.15.82:0/2463825644 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.286+0000 7fef6d057640 1 --2- 172.21.15.82:0/2463825644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef680d49f0 0x7fef680d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.286+0000 7fef677fe640 1 -- 172.21.15.82:0/2463825644 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708104669 0 0) 0x7fef6815ec90 con 0x7fef6815e670 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.286+0000 7fef677fe640 1 -- 172.21.15.82:0/2463825644 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef50003520 con 0x7fef6815e670 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.286+0000 7fef677fe640 1 -- 172.21.15.82:0/2463825644 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341278613 0 0) 0x7fef6815ef70 con 0x7fef680d0e00 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.286+0000 7fef677fe640 1 -- 172.21.15.82:0/2463825644 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef6815ec90 con 0x7fef680d0e00 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.286+0000 7fef677fe640 1 -- 172.21.15.82:0/2463825644 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1106903673 0 0) 0x7fef50003520 con 0x7fef6815e670 2024-06-02T22:53:31.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.286+0000 7fef6d057640 1 -- 172.21.15.82:0/2463825644 >> v1:172.21.15.184:6789/0 conn(0x7fef680d0e00 legacy=0x7fef680cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:31.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.286+0000 7fef6d057640 1 -- 172.21.15.82:0/2463825644 >> v1:172.21.15.82:6789/0 conn(0x7fef6815e670 legacy=0x7fef680d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:31.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.286+0000 7fef6d057640 1 -- 172.21.15.82:0/2463825644 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6815f250 con 0x7fef680d49f0 2024-06-02T22:53:31.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.287+0000 7fef6d057640 1 --2- 172.21.15.82:0/2463825644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef680d49f0 0x7fef680d1f30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef600097d0 tx=0x7fef6002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fc7b8406304a665 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:31.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.287+0000 7fef677fe640 1 -- 172.21.15.82:0/2463825644 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60037070 con 0x7fef680d49f0 2024-06-02T22:53:31.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.287+0000 7fef677fe640 1 -- 172.21.15.82:0/2463825644 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6002acc0 con 0x7fef680d49f0 2024-06-02T22:53:31.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.287+0000 7fef677fe640 1 -- 172.21.15.82:0/2463825644 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef580019f0 con 0x7fef680d49f0 2024-06-02T22:53:31.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.287+0000 7fef6eaba640 1 -- 172.21.15.82:0/2463825644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef680d49f0 msgr2=0x7fef680d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:31.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.287+0000 7fef6eaba640 1 --2- 172.21.15.82:0/2463825644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef680d49f0 0x7fef680d1f30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef600097d0 tx=0x7fef6002a230 comp rx=0 tx=0).stop 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.287+0000 7fef6eaba640 1 -- 172.21.15.82:0/2463825644 shutdown_connections 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.287+0000 7fef6eaba640 1 --2- 172.21.15.82:0/2463825644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef680d49f0 0x7fef680d1f30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.287+0000 7fef6eaba640 1 -- 172.21.15.82:0/2463825644 >> 172.21.15.82:0/2463825644 conn(0x7fef6809d400 msgr2=0x7fef680d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.287+0000 7fef6eaba640 1 -- 172.21.15.82:0/2463825644 shutdown_connections 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.287+0000 7fef6eaba640 1 -- 172.21.15.82:0/2463825644 wait complete. 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.289+0000 7fef6eaba640 1 Processor -- start 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.289+0000 7fef6eaba640 1 -- start start 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.289+0000 7fef6eaba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef680d0e00 0x7fef681f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.289+0000 7fef6eaba640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef680d49f0 0x7fef6815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.289+0000 7fef6eaba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef6815e670 0x7fef6815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.289+0000 7fef6eaba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef6815ea50 con 0x7fef680d0e00 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6eaba640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fef680d2470 con 0x7fef6815e670 2024-06-02T22:53:31.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6eaba640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fef680d4ea0 con 0x7fef680d49f0 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6c856640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef680d0e00 0x7fef681f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6c856640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef680d0e00 0x7fef681f37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55602/0 (socket says 172.21.15.82:55602) 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6c856640 1 -- 172.21.15.82:0/2058790671 learned_addr learned my addr 172.21.15.82:0/2058790671 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6d057640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef6815e670 0x7fef6815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef67fff640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef680d49f0 0x7fef6815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6c856640 1 -- 172.21.15.82:0/2058790671 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef680d49f0 msgr2=0x7fef6815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6c856640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef680d49f0 0x7fef6815b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6c856640 1 -- 172.21.15.82:0/2058790671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef6815e670 msgr2=0x7fef6815b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6c856640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef6815e670 0x7fef6815b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6c856640 1 -- 172.21.15.82:0/2058790671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef680c9d80 con 0x7fef680d0e00 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6c856640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef680d0e00 0x7fef681f37b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fef58001f90 tx=0x7fef5800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef657fa640 1 -- 172.21.15.82:0/2058790671 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef58017070 con 0x7fef680d0e00 2024-06-02T22:53:31.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef657fa640 1 -- 172.21.15.82:0/2058790671 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef58012400 con 0x7fef680d0e00 2024-06-02T22:53:31.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6eaba640 1 -- 172.21.15.82:0/2058790671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef680ca060 con 0x7fef680d0e00 2024-06-02T22:53:31.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef657fa640 1 -- 172.21.15.82:0/2058790671 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef580127f0 con 0x7fef680d0e00 2024-06-02T22:53:31.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.290+0000 7fef6eaba640 1 -- 172.21.15.82:0/2058790671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef680ca620 con 0x7fef680d0e00 2024-06-02T22:53:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.291+0000 7fef6eaba640 1 -- 172.21.15.82:0/2058790671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef68068540 con 0x7fef680d0e00 2024-06-02T22:53:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.292+0000 7fef657fa640 1 -- 172.21.15.82:0/2058790671 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef5801a070 con 0x7fef680d0e00 2024-06-02T22:53:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.292+0000 7fef657fa640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef5406be30 0x7fef5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.292+0000 7fef657fa640 1 -- 172.21.15.82:0/2058790671 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5730+0+0 (secure 0 0 0) 0x7fef5808adc0 con 0x7fef680d0e00 2024-06-02T22:53:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.292+0000 7fef67fff640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef5406be30 0x7fef5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:31.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.293+0000 7fef67fff640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef5406be30 0x7fef5406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fef68160010 tx=0x7fef5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:31.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.297+0000 7fef657fa640 1 -- 172.21.15.82:0/2058790671 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fef580591c0 con 0x7fef680d0e00 2024-06-02T22:53:31.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:31.475+0000 7fef6eaba640 1 -- 172.21.15.82:0/2058790671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) -- 0x7fef68159ee0 con 0x7fef680d0e00 2024-06-02T22:53:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.178+0000 7fef657fa640 1 -- 172.21.15.82:0/2058790671 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v45) ==== 160+0+0 (secure 0 0 0) 0x7fef5805d4c0 con 0x7fef680d0e00 2024-06-02T22:53:32.178 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'data_new' removed 2024-06-02T22:53:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 -- 172.21.15.82:0/2058790671 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef5406be30 msgr2=0x7fef5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef5406be30 0x7fef5406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fef68160010 tx=0x7fef5c009040 comp rx=0 tx=0).stop 2024-06-02T22:53:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 -- 172.21.15.82:0/2058790671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef680d0e00 msgr2=0x7fef681f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef680d0e00 0x7fef681f37b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fef58001f90 tx=0x7fef5800cf90 comp rx=0 tx=0).stop 2024-06-02T22:53:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 -- 172.21.15.82:0/2058790671 shutdown_connections 2024-06-02T22:53:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fef5406be30 0x7fef5406e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef6815e670 0x7fef6815b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef680d49f0 0x7fef6815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 --2- 172.21.15.82:0/2058790671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef680d0e00 0x7fef681f37b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 -- 172.21.15.82:0/2058790671 >> 172.21.15.82:0/2058790671 conn(0x7fef6809d400 msgr2=0x7fef680d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 -- 172.21.15.82:0/2058790671 shutdown_connections 2024-06-02T22:53:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.181+0000 7fef6eaba640 1 -- 172.21.15.82:0/2058790671 wait complete. 2024-06-02T22:53:32.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-02T22:53:32.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.301+0000 7ff7e264c640 1 Processor -- start 2024-06-02T22:53:32.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.301+0000 7ff7e264c640 1 -- start start 2024-06-02T22:53:32.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7e264c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff7dc0d0020 0x7ff7dc0d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7e264c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7dc06e1f0 0x7ff7dc06e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7e264c640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7dc155700 con 0x7ff7dc155320 2024-06-02T22:53:32.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7e264c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff7dc0d09c0 con 0x7ff7dc0d0020 2024-06-02T22:53:32.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7e264c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff7dc15b6b0 con 0x7ff7dc06e1f0 2024-06-02T22:53:32.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7db7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff7dc0d0020 0x7ff7dc0d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7db7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff7dc0d0020 0x7ff7dc0d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55612/0 (socket says 172.21.15.82:55612) 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7db7fe640 1 -- 172.21.15.82:0/2328171934 learned_addr learned my addr 172.21.15.82:0/2328171934 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7e0be9640 1 --2- 172.21.15.82:0/2328171934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7dc06e1f0 0x7ff7dc06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7db7fe640 1 -- 172.21.15.82:0/2328171934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7dc06e1f0 msgr2=0x7ff7dc06e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7db7fe640 1 --2- 172.21.15.82:0/2328171934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7dc06e1f0 0x7ff7dc06e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7db7fe640 1 -- 172.21.15.82:0/2328171934 >> v1:172.21.15.184:6789/0 conn(0x7ff7dc155320 legacy=0x7ff7dc0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.302+0000 7ff7db7fe640 1 -- 172.21.15.82:0/2328171934 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc15b990 con 0x7ff7dc0d0020 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.303+0000 7ff7db7fe640 1 --2- 172.21.15.82:0/2328171934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc0d0020 0x7ff7dc0d0480 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000bb10 tx=0x7ff7d002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317f1564d6af9444 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.303+0000 7ff7daffd640 1 -- 172.21.15.82:0/2328171934 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0036020 con 0x7ff7dc0d0020 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.303+0000 7ff7daffd640 1 -- 172.21.15.82:0/2328171934 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d0032820 con 0x7ff7dc0d0020 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.303+0000 7ff7daffd640 1 -- 172.21.15.82:0/2328171934 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0032bf0 con 0x7ff7dc0d0020 2024-06-02T22:53:32.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.304+0000 7ff7e264c640 1 -- 172.21.15.82:0/2328171934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc0d0020 msgr2=0x7ff7dc0d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:32.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.304+0000 7ff7e264c640 1 --2- 172.21.15.82:0/2328171934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc0d0020 0x7ff7dc0d0480 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000bb10 tx=0x7ff7d002c920 comp rx=0 tx=0).stop 2024-06-02T22:53:32.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.304+0000 7ff7e264c640 1 -- 172.21.15.82:0/2328171934 shutdown_connections 2024-06-02T22:53:32.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.304+0000 7ff7e264c640 1 --2- 172.21.15.82:0/2328171934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7dc06e1f0 0x7ff7dc06e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.304+0000 7ff7e264c640 1 --2- 172.21.15.82:0/2328171934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc0d0020 0x7ff7dc0d0480 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.304+0000 7ff7e264c640 1 -- 172.21.15.82:0/2328171934 >> 172.21.15.82:0/2328171934 conn(0x7ff7dc0b1d10 msgr2=0x7ff7dc0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:32.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.304+0000 7ff7e264c640 1 -- 172.21.15.82:0/2328171934 shutdown_connections 2024-06-02T22:53:32.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.304+0000 7ff7e264c640 1 -- 172.21.15.82:0/2328171934 wait complete. 2024-06-02T22:53:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.305+0000 7ff7e264c640 1 Processor -- start 2024-06-02T22:53:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.305+0000 7ff7e264c640 1 -- start start 2024-06-02T22:53:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e264c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7dc06e1f0 0x7ff7dc0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e264c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7dc0d0020 0x7ff7dc0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e264c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc155320 0x7ff7dc15ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e264c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc06ebc0 con 0x7ff7dc155320 2024-06-02T22:53:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e264c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc15bf50 con 0x7ff7dc0d0020 2024-06-02T22:53:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e264c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff7dc157780 con 0x7ff7dc06e1f0 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e0be9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc155320 0x7ff7dc15ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e0be9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc155320 0x7ff7dc15ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55616/0 (socket says 172.21.15.82:55616) 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e0be9640 1 -- 172.21.15.82:0/2512673541 learned_addr learned my addr 172.21.15.82:0/2512673541 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7db7fe640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7dc0d0020 0x7ff7dc0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7dbfff640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7dc06e1f0 0x7ff7dc0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e0be9640 1 -- 172.21.15.82:0/2512673541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7dc06e1f0 msgr2=0x7ff7dc0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e0be9640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7dc06e1f0 0x7ff7dc0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e0be9640 1 -- 172.21.15.82:0/2512673541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7dc0d0020 msgr2=0x7ff7dc0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e0be9640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7dc0d0020 0x7ff7dc0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e0be9640 1 -- 172.21.15.82:0/2512673541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc14dc70 con 0x7ff7dc155320 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.306+0000 7ff7e0be9640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc155320 0x7ff7dc15ce80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4007e60 tx=0x7ff7d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.307+0000 7ff7d8ff9640 1 -- 172.21.15.82:0/2512673541 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4014420 con 0x7ff7dc155320 2024-06-02T22:53:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.307+0000 7ff7d8ff9640 1 -- 172.21.15.82:0/2512673541 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d4019070 con 0x7ff7dc155320 2024-06-02T22:53:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.307+0000 7ff7e264c640 1 -- 172.21.15.82:0/2512673541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7dc0ccd10 con 0x7ff7dc155320 2024-06-02T22:53:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.307+0000 7ff7d8ff9640 1 -- 172.21.15.82:0/2512673541 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4014820 con 0x7ff7dc155320 2024-06-02T22:53:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.307+0000 7ff7e264c640 1 -- 172.21.15.82:0/2512673541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7dc0cd2d0 con 0x7ff7dc155320 2024-06-02T22:53:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.308+0000 7ff7e264c640 1 -- 172.21.15.82:0/2512673541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7dc0683c0 con 0x7ff7dc155320 2024-06-02T22:53:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.308+0000 7ff7d8ff9640 1 -- 172.21.15.82:0/2512673541 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7d40149c0 con 0x7ff7dc155320 2024-06-02T22:53:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.308+0000 7ff7d8ff9640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff7c806be60 0x7ff7c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.308+0000 7ff7d8ff9640 1 -- 172.21.15.82:0/2512673541 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7ff7d408b390 con 0x7ff7dc155320 2024-06-02T22:53:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.308+0000 7ff7dbfff640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff7c806be60 0x7ff7c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.309+0000 7ff7dbfff640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff7c806be60 0x7ff7c806e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc157500 tx=0x7ff7cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:32.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.313+0000 7ff7d8ff9640 1 -- 172.21.15.82:0/2512673541 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff7d4059f40 con 0x7ff7dc155320 2024-06-02T22:53:32.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.486+0000 7ff7e264c640 1 -- 172.21.15.82:0/2512673541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff7dc15a6f0 con 0x7ff7dc155320 2024-06-02T22:53:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.490+0000 7ff7d8ff9640 1 -- 172.21.15.82:0/2512673541 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7ff7d4059840 con 0x7ff7dc155320 2024-06-02T22:53:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 -- 172.21.15.82:0/2512673541 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff7c806be60 msgr2=0x7ff7c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff7c806be60 0x7ff7c806e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc157500 tx=0x7ff7cc009040 comp rx=0 tx=0).stop 2024-06-02T22:53:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 -- 172.21.15.82:0/2512673541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc155320 msgr2=0x7ff7dc15ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc155320 0x7ff7dc15ce80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4007e60 tx=0x7ff7d400e4b0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 -- 172.21.15.82:0/2512673541 shutdown_connections 2024-06-02T22:53:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff7c806be60 0x7ff7c806e320 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7dc155320 0x7ff7dc15ce80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7dc0d0020 0x7ff7dc0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 --2- 172.21.15.82:0/2512673541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7dc06e1f0 0x7ff7dc0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 -- 172.21.15.82:0/2512673541 >> 172.21.15.82:0/2512673541 conn(0x7ff7dc0b1d10 msgr2=0x7ff7dc0afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 -- 172.21.15.82:0/2512673541 shutdown_connections 2024-06-02T22:53:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.492+0000 7ff7e264c640 1 -- 172.21.15.82:0/2512673541 wait complete. 2024-06-02T22:53:32.503 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-06-02T22:53:32.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.604+0000 7f595aae1640 1 Processor -- start 2024-06-02T22:53:32.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.604+0000 7f595aae1640 1 -- start start 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.605+0000 7f595aae1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f595406ebf0 0x7f59540cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.605+0000 7f595aae1640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f59540cf190 0x7f59540acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.605+0000 7f595aae1640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59540cf600 con 0x7f59540ae910 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.605+0000 7f595aae1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f595406d130 con 0x7f595406ebf0 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.605+0000 7f595aae1640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f595406d410 con 0x7f59540cf190 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.605+0000 7f5953fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f595406ebf0 0x7f59540cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.605+0000 7f5953fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f595406ebf0 0x7f59540cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55626/0 (socket says 172.21.15.82:55626) 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.605+0000 7f5953fff640 1 -- 172.21.15.82:0/3980837793 learned_addr learned my addr 172.21.15.82:0/3980837793 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.605+0000 7f595907e640 1 --2- 172.21.15.82:0/3980837793 >> v2:172.21.15.184:3300/0 conn(0x7f59540cf190 0x7f59540acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.606+0000 7f5953fff640 1 -- 172.21.15.82:0/3980837793 >> v2:172.21.15.184:3300/0 conn(0x7f59540cf190 msgr2=0x7f59540acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.606+0000 7f5953fff640 1 --2- 172.21.15.82:0/3980837793 >> v2:172.21.15.184:3300/0 conn(0x7f59540cf190 0x7f59540acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.606+0000 7f5953fff640 1 -- 172.21.15.82:0/3980837793 >> v1:172.21.15.184:6789/0 conn(0x7f59540ae910 legacy=0x7f595406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:32.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.606+0000 7f5953fff640 1 -- 172.21.15.82:0/3980837793 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595406d6f0 con 0x7f595406ebf0 2024-06-02T22:53:32.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.606+0000 7f5953fff640 1 --2- 172.21.15.82:0/3980837793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f595406ebf0 0x7f59540cec50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f595406dcb0 tx=0x7f594802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68797b18dd1cd1fd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:32.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.606+0000 7f59537fe640 1 -- 172.21.15.82:0/3980837793 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948032710 con 0x7f595406ebf0 2024-06-02T22:53:32.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.606+0000 7f59537fe640 1 -- 172.21.15.82:0/3980837793 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59480328b0 con 0x7f595406ebf0 2024-06-02T22:53:32.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.606+0000 7f59537fe640 1 -- 172.21.15.82:0/3980837793 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948032ca0 con 0x7f595406ebf0 2024-06-02T22:53:32.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.607+0000 7f595aae1640 1 -- 172.21.15.82:0/3980837793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f595406ebf0 msgr2=0x7f59540cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:32.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.607+0000 7f595aae1640 1 --2- 172.21.15.82:0/3980837793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f595406ebf0 0x7f59540cec50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f595406dcb0 tx=0x7f594802c850 comp rx=0 tx=0).stop 2024-06-02T22:53:32.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.607+0000 7f595aae1640 1 -- 172.21.15.82:0/3980837793 shutdown_connections 2024-06-02T22:53:32.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.607+0000 7f595aae1640 1 --2- 172.21.15.82:0/3980837793 >> v2:172.21.15.184:3300/0 conn(0x7f59540cf190 0x7f59540acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.607+0000 7f595aae1640 1 --2- 172.21.15.82:0/3980837793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f595406ebf0 0x7f59540cec50 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.607+0000 7f595aae1640 1 -- 172.21.15.82:0/3980837793 >> 172.21.15.82:0/3980837793 conn(0x7f59540b19f0 msgr2=0x7f59540b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:32.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.607+0000 7f595aae1640 1 -- 172.21.15.82:0/3980837793 shutdown_connections 2024-06-02T22:53:32.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.607+0000 7f595aae1640 1 -- 172.21.15.82:0/3980837793 wait complete. 2024-06-02T22:53:32.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.608+0000 7f595aae1640 1 Processor -- start 2024-06-02T22:53:32.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.608+0000 7f595aae1640 1 -- start start 2024-06-02T22:53:32.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f595aae1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595406ebf0 0x7f59541f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f595aae1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59540ae910 0x7f5954157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f595aae1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59540cf190 0x7f5954157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f595aae1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f59540ad280 con 0x7f59540ae910 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f595aae1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f59540aecf0 con 0x7f59540cf190 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f595aae1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f59540ad400 con 0x7f595406ebf0 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f5953fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59540ae910 0x7f5954157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f5953fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59540ae910 0x7f5954157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55632/0 (socket says 172.21.15.82:55632) 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f5953fff640 1 -- 172.21.15.82:0/2498615908 learned_addr learned my addr 172.21.15.82:0/2498615908 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f595907e640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59540cf190 0x7f5954157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f595887d640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595406ebf0 0x7f59541f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f5953fff640 1 -- 172.21.15.82:0/2498615908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595406ebf0 msgr2=0x7f59541f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f5953fff640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595406ebf0 0x7f59541f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f5953fff640 1 -- 172.21.15.82:0/2498615908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59540cf190 msgr2=0x7f5954157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f5953fff640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59540cf190 0x7f5954157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f5953fff640 1 -- 172.21.15.82:0/2498615908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5954147d80 con 0x7f59540ae910 2024-06-02T22:53:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.609+0000 7f595907e640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59540cf190 0x7f5954157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:32.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.610+0000 7f5953fff640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59540ae910 0x7f5954157210 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f594802c890 tx=0x7f59480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:32.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.610+0000 7f59517fa640 1 -- 172.21.15.82:0/2498615908 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948003810 con 0x7f59540ae910 2024-06-02T22:53:32.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.610+0000 7f59517fa640 1 -- 172.21.15.82:0/2498615908 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5948043070 con 0x7f59540ae910 2024-06-02T22:53:32.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.610+0000 7f59517fa640 1 -- 172.21.15.82:0/2498615908 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948003c10 con 0x7f59540ae910 2024-06-02T22:53:32.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.610+0000 7f595aae1640 1 -- 172.21.15.82:0/2498615908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5954157d80 con 0x7f59540ae910 2024-06-02T22:53:32.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.610+0000 7f595aae1640 1 -- 172.21.15.82:0/2498615908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5954158340 con 0x7f59540ae910 2024-06-02T22:53:32.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.611+0000 7f595aae1640 1 -- 172.21.15.82:0/2498615908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5954068430 con 0x7f59540ae910 2024-06-02T22:53:32.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.611+0000 7f59517fa640 1 -- 172.21.15.82:0/2498615908 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f594803d070 con 0x7f59540ae910 2024-06-02T22:53:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.612+0000 7f59517fa640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f594006be30 0x7f594006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.612+0000 7f59517fa640 1 -- 172.21.15.82:0/2498615908 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f59480abad0 con 0x7f59540ae910 2024-06-02T22:53:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.612+0000 7f595887d640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f594006be30 0x7f594006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.612+0000 7f595887d640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f594006be30 0x7f594006e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5944004ea0 tx=0x7f5944009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:32.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.616+0000 7f59517fa640 1 -- 172.21.15.82:0/2498615908 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f594807a710 con 0x7f59540ae910 2024-06-02T22:53:32.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:32.856+0000 7f595aae1640 1 -- 172.21.15.82:0/2498615908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) -- 0x7f595406e3e0 con 0x7f59540ae910 2024-06-02T22:53:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.180+0000 7f59517fa640 1 -- 172.21.15.82:0/2498615908 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v100) ==== 147+0+0 (secure 0 0 0) 0x7f594807a010 con 0x7f59540ae910 2024-06-02T22:53:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 -- 172.21.15.82:0/2498615908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f594006be30 msgr2=0x7f594006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f594006be30 0x7f594006e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5944004ea0 tx=0x7f5944009040 comp rx=0 tx=0).stop 2024-06-02T22:53:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 -- 172.21.15.82:0/2498615908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59540ae910 msgr2=0x7f5954157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59540ae910 0x7f5954157210 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f594802c890 tx=0x7f59480046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 -- 172.21.15.82:0/2498615908 shutdown_connections 2024-06-02T22:53:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f594006be30 0x7f594006e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59540cf190 0x7f5954157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59540ae910 0x7f5954157210 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 --2- 172.21.15.82:0/2498615908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f595406ebf0 0x7f59541f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 -- 172.21.15.82:0/2498615908 >> 172.21.15.82:0/2498615908 conn(0x7f59540b19f0 msgr2=0x7f59540ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 -- 172.21.15.82:0/2498615908 shutdown_connections 2024-06-02T22:53:33.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.182+0000 7f595aae1640 1 -- 172.21.15.82:0/2498615908 wait complete. 2024-06-02T22:53:33.194 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2024-06-02T22:53:33.194 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-06-02T22:53:33.195 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:53:33.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.294+0000 7f5d886b3640 1 Processor -- start 2024-06-02T22:53:33.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.294+0000 7f5d886b3640 1 -- start start 2024-06-02T22:53:33.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d886b3640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5d800ae910 0x7f5d8006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d886b3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5d8006ea20 0x7f5d800cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d886b3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8006d130 con 0x7f5d800cf190 2024-06-02T22:53:33.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d886b3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5d8006ee90 con 0x7f5d8006ea20 2024-06-02T22:53:33.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d886b3640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f5d8006d410 con 0x7f5d800ae910 2024-06-02T22:53:33.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d85c4e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5d8006ea20 0x7f5d800cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d85c4e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5d8006ea20 0x7f5d800cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55634/0 (socket says 172.21.15.82:55634) 2024-06-02T22:53:33.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d85c4e640 1 -- 172.21.15.82:0/446744113 learned_addr learned my addr 172.21.15.82:0/446744113 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:33.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d86c50640 1 --1- 172.21.15.82:0/446744113 >> v1:172.21.15.82:6789/0 conn(0x7f5d800cf190 0x7f5d8015ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34866/0 (socket says 172.21.15.82:34866) 2024-06-02T22:53:33.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d85c4e640 1 -- 172.21.15.82:0/446744113 >> v2:172.21.15.184:3300/0 conn(0x7f5d800ae910 msgr2=0x7f5d8006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:33.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d85c4e640 1 --2- 172.21.15.82:0/446744113 >> v2:172.21.15.184:3300/0 conn(0x7f5d800ae910 0x7f5d8006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d85c4e640 1 -- 172.21.15.82:0/446744113 >> v1:172.21.15.82:6789/0 conn(0x7f5d800cf190 legacy=0x7f5d8015ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d85c4e640 1 -- 172.21.15.82:0/446744113 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8006d6f0 con 0x7f5d8006ea20 2024-06-02T22:53:33.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.295+0000 7f5d8544d640 1 -- 172.21.15.82:0/446744113 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2850813176 0 0) 0x7f5d8006d130 con 0x7f5d800cf190 2024-06-02T22:53:33.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.296+0000 7f5d85c4e640 1 --2- 172.21.15.82:0/446744113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d8006ea20 0x7f5d800cec50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5d800750b0 tx=0x7f5d7002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c96589972cdf0e9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:33.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.296+0000 7f5d8544d640 1 -- 172.21.15.82:0/446744113 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70037070 con 0x7f5d8006ea20 2024-06-02T22:53:33.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.296+0000 7f5d8544d640 1 -- 172.21.15.82:0/446744113 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d70032440 con 0x7f5d8006ea20 2024-06-02T22:53:33.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.296+0000 7f5d8544d640 1 -- 172.21.15.82:0/446744113 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70032810 con 0x7f5d8006ea20 2024-06-02T22:53:33.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.296+0000 7f5d886b3640 1 -- 172.21.15.82:0/446744113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d8006ea20 msgr2=0x7f5d800cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.296+0000 7f5d886b3640 1 --2- 172.21.15.82:0/446744113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d8006ea20 0x7f5d800cec50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5d800750b0 tx=0x7f5d7002a1e0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.297+0000 7f5d886b3640 1 -- 172.21.15.82:0/446744113 shutdown_connections 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.297+0000 7f5d886b3640 1 --2- 172.21.15.82:0/446744113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d8006ea20 0x7f5d800cec50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.297+0000 7f5d886b3640 1 --2- 172.21.15.82:0/446744113 >> v2:172.21.15.184:3300/0 conn(0x7f5d800ae910 0x7f5d8006e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.297+0000 7f5d886b3640 1 -- 172.21.15.82:0/446744113 >> 172.21.15.82:0/446744113 conn(0x7f5d800b19f0 msgr2=0x7f5d800b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.297+0000 7f5d886b3640 1 -- 172.21.15.82:0/446744113 shutdown_connections 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.297+0000 7f5d886b3640 1 -- 172.21.15.82:0/446744113 wait complete. 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.298+0000 7f5d886b3640 1 Processor -- start 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.298+0000 7f5d886b3640 1 -- start start 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.298+0000 7f5d886b3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d8006ea20 0x7f5d801f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.298+0000 7f5d886b3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d800ae910 0x7f5d8015db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.298+0000 7f5d886b3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d800cf190 0x7f5d801f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.298+0000 7f5d886b3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d800aecf0 con 0x7f5d8006ea20 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.298+0000 7f5d886b3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5d800cf5e0 con 0x7f5d800ae910 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.298+0000 7f5d886b3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5d800add50 con 0x7f5d800cf190 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d8644f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d8006ea20 0x7f5d801f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d8644f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d8006ea20 0x7f5d801f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55638/0 (socket says 172.21.15.82:55638) 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d8644f640 1 -- 172.21.15.82:0/2126751485 learned_addr learned my addr 172.21.15.82:0/2126751485 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d8644f640 1 -- 172.21.15.82:0/2126751485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d800cf190 msgr2=0x7f5d801f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d8644f640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d800cf190 0x7f5d801f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d8644f640 1 -- 172.21.15.82:0/2126751485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d800ae910 msgr2=0x7f5d8015db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d8644f640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d800ae910 0x7f5d8015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d8644f640 1 -- 172.21.15.82:0/2126751485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8015e1b0 con 0x7f5d8006ea20 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d8644f640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d8006ea20 0x7f5d801f51a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00b4d0 tx=0x7f5d7c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d76ffd640 1 -- 172.21.15.82:0/2126751485 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c014070 con 0x7f5d8006ea20 2024-06-02T22:53:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d76ffd640 1 -- 172.21.15.82:0/2126751485 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7c010870 con 0x7f5d8006ea20 2024-06-02T22:53:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d76ffd640 1 -- 172.21.15.82:0/2126751485 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c010c60 con 0x7f5d8006ea20 2024-06-02T22:53:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d886b3640 1 -- 172.21.15.82:0/2126751485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d801e5f50 con 0x7f5d8006ea20 2024-06-02T22:53:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.299+0000 7f5d886b3640 1 -- 172.21.15.82:0/2126751485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d801e6510 con 0x7f5d8006ea20 2024-06-02T22:53:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.300+0000 7f5d886b3640 1 -- 172.21.15.82:0/2126751485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d80068430 con 0x7f5d8006ea20 2024-06-02T22:53:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.301+0000 7f5d76ffd640 1 -- 172.21.15.82:0/2126751485 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d7c017070 con 0x7f5d8006ea20 2024-06-02T22:53:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.301+0000 7f5d76ffd640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5d6406be30 0x7f5d6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.301+0000 7f5d76ffd640 1 -- 172.21.15.82:0/2126751485 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f5d7c08ab70 con 0x7f5d8006ea20 2024-06-02T22:53:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.301+0000 7f5d85c4e640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5d6406be30 0x7f5d6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.301+0000 7f5d85c4e640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5d6406be30 0x7f5d6406e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5d70034000 tx=0x7f5d7002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.305+0000 7f5d76ffd640 1 -- 172.21.15.82:0/2126751485 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5d7c059690 con 0x7f5d8006ea20 2024-06-02T22:53:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.479+0000 7f5d886b3640 1 -- 172.21.15.82:0/2126751485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d801e9340 con 0x7f5d8006ea20 2024-06-02T22:53:33.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.480+0000 7f5d76ffd640 1 -- 172.21.15.82:0/2126751485 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+13295 (secure 0 0 0) 0x7f5d7c058f90 con 0x7f5d8006ea20 2024-06-02T22:53:33.479 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:33.480 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":45,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:53:32.172447+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6835/3297362995":"2024-06-03T22:53:28.158051+0000","172.21.15.184:6833/3297362995":"2024-06-03T22:53:28.158051+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:53:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.481+0000 7f5d886b3640 1 -- 172.21.15.82:0/2126751485 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5d6406be30 msgr2=0x7f5d6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.481+0000 7f5d886b3640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5d6406be30 0x7f5d6406e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5d70034000 tx=0x7f5d7002c000 comp rx=0 tx=0).stop 2024-06-02T22:53:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.481+0000 7f5d886b3640 1 -- 172.21.15.82:0/2126751485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d8006ea20 msgr2=0x7f5d801f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.481+0000 7f5d886b3640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d8006ea20 0x7f5d801f51a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00b4d0 tx=0x7f5d7c00b990 comp rx=0 tx=0).stop 2024-06-02T22:53:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.481+0000 7f5d886b3640 1 -- 172.21.15.82:0/2126751485 shutdown_connections 2024-06-02T22:53:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.481+0000 7f5d886b3640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5d6406be30 0x7f5d6406e2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.481+0000 7f5d886b3640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d800cf190 0x7f5d801f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.481+0000 7f5d886b3640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d800ae910 0x7f5d8015db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.481+0000 7f5d886b3640 1 --2- 172.21.15.82:0/2126751485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d8006ea20 0x7f5d801f51a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.481+0000 7f5d886b3640 1 -- 172.21.15.82:0/2126751485 >> 172.21.15.82:0/2126751485 conn(0x7f5d800b19f0 msgr2=0x7f5d8015a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.482+0000 7f5d886b3640 1 -- 172.21.15.82:0/2126751485 shutdown_connections 2024-06-02T22:53:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.482+0000 7f5d886b3640 1 -- 172.21.15.82:0/2126751485 wait complete. 2024-06-02T22:53:33.493 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T22:51:51.853867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T22:53:33.494 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T22:53:33.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.596+0000 7f437dd42640 1 Processor -- start 2024-06-02T22:53:33.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.596+0000 7f437dd42640 1 -- start start 2024-06-02T22:53:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f437dd42640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43780d08f0 0x7f43780b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f437dd42640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f43780cf360 0x7f43780d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f437dd42640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43780cf8a0 con 0x7f43780d0cd0 2024-06-02T22:53:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f437dd42640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f43780d1c80 con 0x7f43780d08f0 2024-06-02T22:53:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f437dd42640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f43780cfb80 con 0x7f43780cf360 2024-06-02T22:53:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f43777fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43780d08f0 0x7f43780b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f43777fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43780d08f0 0x7f43780b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55642/0 (socket says 172.21.15.82:55642) 2024-06-02T22:53:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f43777fe640 1 -- 172.21.15.82:0/2806117971 learned_addr learned my addr 172.21.15.82:0/2806117971 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f43777fe640 1 -- 172.21.15.82:0/2806117971 >> v2:172.21.15.184:3300/0 conn(0x7f43780cf360 msgr2=0x7f43780d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f4377fff640 1 --2- 172.21.15.82:0/2806117971 >> v2:172.21.15.184:3300/0 conn(0x7f43780cf360 0x7f43780d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f43777fe640 1 --2- 172.21.15.82:0/2806117971 >> v2:172.21.15.184:3300/0 conn(0x7f43780cf360 0x7f43780d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f43777fe640 1 -- 172.21.15.82:0/2806117971 >> v1:172.21.15.184:6789/0 conn(0x7f43780d0cd0 legacy=0x7f43780cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f43777fe640 1 -- 172.21.15.82:0/2806117971 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43780cfe60 con 0x7f43780d08f0 2024-06-02T22:53:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.597+0000 7f4377fff640 1 --2- 172.21.15.82:0/2806117971 >> v2:172.21.15.184:3300/0 conn(0x7f43780cf360 0x7f43780d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.598+0000 7f43777fe640 1 --2- 172.21.15.82:0/2806117971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43780d08f0 0x7f43780b3800 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4368009870 tx=0x7f436802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8686be1fd6743cc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.598+0000 7f43767fc640 1 -- 172.21.15.82:0/2806117971 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368037070 con 0x7f43780d08f0 2024-06-02T22:53:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.598+0000 7f43767fc640 1 -- 172.21.15.82:0/2806117971 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4368032440 con 0x7f43780d08f0 2024-06-02T22:53:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.598+0000 7f43767fc640 1 -- 172.21.15.82:0/2806117971 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368032810 con 0x7f43780d08f0 2024-06-02T22:53:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.598+0000 7f437dd42640 1 -- 172.21.15.82:0/2806117971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43780d08f0 msgr2=0x7f43780b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.598+0000 7f437dd42640 1 --2- 172.21.15.82:0/2806117971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43780d08f0 0x7f43780b3800 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4368009870 tx=0x7f436802a270 comp rx=0 tx=0).stop 2024-06-02T22:53:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.599+0000 7f437dd42640 1 -- 172.21.15.82:0/2806117971 shutdown_connections 2024-06-02T22:53:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.599+0000 7f437dd42640 1 --2- 172.21.15.82:0/2806117971 >> v2:172.21.15.184:3300/0 conn(0x7f43780cf360 0x7f43780d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.599+0000 7f437dd42640 1 --2- 172.21.15.82:0/2806117971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43780d08f0 0x7f43780b3800 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.599+0000 7f437dd42640 1 -- 172.21.15.82:0/2806117971 >> 172.21.15.82:0/2806117971 conn(0x7f437809d3c0 msgr2=0x7f43780d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.599+0000 7f437dd42640 1 -- 172.21.15.82:0/2806117971 shutdown_connections 2024-06-02T22:53:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.599+0000 7f437dd42640 1 -- 172.21.15.82:0/2806117971 wait complete. 2024-06-02T22:53:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.600+0000 7f437dd42640 1 Processor -- start 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.600+0000 7f437dd42640 1 -- start start 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f437dd42640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43780cf360 0x7f4378158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f437dd42640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43780d08f0 0x7f4378157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f437dd42640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43780d0cd0 0x7f437815f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f437dd42640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f43780d1180 con 0x7f43780d0cd0 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f437dd42640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f43780b50c0 con 0x7f43780cf360 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f437dd42640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f43780b4a60 con 0x7f43780d08f0 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f4377fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43780d0cd0 0x7f437815f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f4377fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43780d0cd0 0x7f437815f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55644/0 (socket says 172.21.15.82:55644) 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f4377fff640 1 -- 172.21.15.82:0/2707221128 learned_addr learned my addr 172.21.15.82:0/2707221128 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f43777fe640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43780cf360 0x7f4378158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f4376ffd640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43780d08f0 0x7f4378157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f4377fff640 1 -- 172.21.15.82:0/2707221128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43780d08f0 msgr2=0x7f4378157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f4377fff640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43780d08f0 0x7f4378157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f4377fff640 1 -- 172.21.15.82:0/2707221128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43780cf360 msgr2=0x7f4378158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f4377fff640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43780cf360 0x7f4378158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f4377fff640 1 -- 172.21.15.82:0/2707221128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43781596a0 con 0x7f43780d0cd0 2024-06-02T22:53:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f4377fff640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43780d0cd0 0x7f437815f1b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f437000cf20 tx=0x7f437000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f435ffff640 1 -- 172.21.15.82:0/2707221128 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437001a070 con 0x7f43780d0cd0 2024-06-02T22:53:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f435ffff640 1 -- 172.21.15.82:0/2707221128 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f437000d840 con 0x7f43780d0cd0 2024-06-02T22:53:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f437dd42640 1 -- 172.21.15.82:0/2707221128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4378159980 con 0x7f43780d0cd0 2024-06-02T22:53:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.601+0000 7f435ffff640 1 -- 172.21.15.82:0/2707221128 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437000dc30 con 0x7f43780d0cd0 2024-06-02T22:53:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.602+0000 7f437dd42640 1 -- 172.21.15.82:0/2707221128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43780cc590 con 0x7f43780d0cd0 2024-06-02T22:53:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.603+0000 7f437dd42640 1 -- 172.21.15.82:0/2707221128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43780683c0 con 0x7f43780d0cd0 2024-06-02T22:53:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.603+0000 7f435ffff640 1 -- 172.21.15.82:0/2707221128 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f437001d070 con 0x7f43780d0cd0 2024-06-02T22:53:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.603+0000 7f435ffff640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f436406be30 0x7f436406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.604+0000 7f43777fe640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f436406be30 0x7f436406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.604+0000 7f435ffff640 1 -- 172.21.15.82:0/2707221128 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f437008b460 con 0x7f43780d0cd0 2024-06-02T22:53:33.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.604+0000 7f43777fe640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f436406be30 0x7f436406e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4368034000 tx=0x7f436802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:33.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.608+0000 7f435ffff640 1 -- 172.21.15.82:0/2707221128 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f43700599c0 con 0x7f43780d0cd0 2024-06-02T22:53:33.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.783+0000 7f437dd42640 1 -- 172.21.15.82:0/2707221128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f43780d1730 con 0x7f43780d0cd0 2024-06-02T22:53:33.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.784+0000 7f435ffff640 1 -- 172.21.15.82:0/2707221128 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) ==== 93+0+10 (secure 0 0 0) 0x7f437005dcc0 con 0x7f43780d0cd0 2024-06-02T22:53:33.784 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-06-02T22:53:33.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 -- 172.21.15.82:0/2707221128 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f436406be30 msgr2=0x7f436406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f436406be30 0x7f436406e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4368034000 tx=0x7f436802e000 comp rx=0 tx=0).stop 2024-06-02T22:53:33.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 -- 172.21.15.82:0/2707221128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43780d0cd0 msgr2=0x7f437815f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43780d0cd0 0x7f437815f1b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f437000cf20 tx=0x7f437000a7d0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 -- 172.21.15.82:0/2707221128 shutdown_connections 2024-06-02T22:53:33.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f436406be30 0x7f436406e2f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43780d0cd0 0x7f437815f1b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43780d08f0 0x7f4378157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 --2- 172.21.15.82:0/2707221128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43780cf360 0x7f4378158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 -- 172.21.15.82:0/2707221128 >> 172.21.15.82:0/2707221128 conn(0x7f437809d3c0 msgr2=0x7f43780b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:33.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 -- 172.21.15.82:0/2707221128 shutdown_connections 2024-06-02T22:53:33.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.786+0000 7f437dd42640 1 -- 172.21.15.82:0/2707221128 wait complete. 2024-06-02T22:53:33.797 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-06-02T22:53:33.887 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:53:33.889 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:53:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.897+0000 7f69fdc7b640 1 Processor -- start 2024-06-02T22:53:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.897+0000 7f69fdc7b640 1 -- start start 2024-06-02T22:53:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69fdc7b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80b46d0 0x7f69f8071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69fdc7b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f8072820 con 0x7f69f80cc6d0 2024-06-02T22:53:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69fdc7b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f8072b00 con 0x7f69f80721a0 2024-06-02T22:53:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69fdc7b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f69f8072de0 con 0x7f69f80b46d0 2024-06-02T22:53:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69f77fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f69f80cc6d0 0x7f69f80ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34870/0 (socket says 172.21.15.82:34870) 2024-06-02T22:53:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69f77fe640 1 -- 172.21.15.82:0/3688156089 learned_addr learned my addr 172.21.15.82:0/3688156089 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69f6ffd640 1 --2- 172.21.15.82:0/3688156089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80b46d0 0x7f69f8071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69f67fc640 1 -- 172.21.15.82:0/3688156089 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4202272114 0 0) 0x7f69f8072820 con 0x7f69f80cc6d0 2024-06-02T22:53:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69f67fc640 1 -- 172.21.15.82:0/3688156089 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e0003520 con 0x7f69f80cc6d0 2024-06-02T22:53:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69f67fc640 1 -- 172.21.15.82:0/3688156089 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786458210 0 0) 0x7f69f8072b00 con 0x7f69f80721a0 2024-06-02T22:53:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69f6ffd640 1 -- 172.21.15.82:0/3688156089 >> v1:172.21.15.184:6789/0 conn(0x7f69f80721a0 legacy=0x7f69f8165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69f6ffd640 1 -- 172.21.15.82:0/3688156089 >> v1:172.21.15.82:6789/0 conn(0x7f69f80cc6d0 legacy=0x7f69f80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.898+0000 7f69f6ffd640 1 -- 172.21.15.82:0/3688156089 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f80b31a0 con 0x7f69f80b46d0 2024-06-02T22:53:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.899+0000 7f69f6ffd640 1 --2- 172.21.15.82:0/3688156089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80b46d0 0x7f69f8071c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097d0 tx=0x7f69ec02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5440f4d318101b03 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.899+0000 7f69f67fc640 1 -- 172.21.15.82:0/3688156089 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec037070 con 0x7f69f80b46d0 2024-06-02T22:53:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.899+0000 7f69f67fc640 1 -- 172.21.15.82:0/3688156089 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec032440 con 0x7f69f80b46d0 2024-06-02T22:53:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.899+0000 7f69f67fc640 1 -- 172.21.15.82:0/3688156089 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec032810 con 0x7f69f80b46d0 2024-06-02T22:53:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.900+0000 7f69fdc7b640 1 -- 172.21.15.82:0/3688156089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80b46d0 msgr2=0x7f69f8071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.900+0000 7f69fdc7b640 1 --2- 172.21.15.82:0/3688156089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80b46d0 0x7f69f8071c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097d0 tx=0x7f69ec02a210 comp rx=0 tx=0).stop 2024-06-02T22:53:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.900+0000 7f69fdc7b640 1 -- 172.21.15.82:0/3688156089 shutdown_connections 2024-06-02T22:53:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.900+0000 7f69fdc7b640 1 --2- 172.21.15.82:0/3688156089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80b46d0 0x7f69f8071c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.900+0000 7f69fdc7b640 1 -- 172.21.15.82:0/3688156089 >> 172.21.15.82:0/3688156089 conn(0x7f69f80b19f0 msgr2=0x7f69f80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.900+0000 7f69fdc7b640 1 -- 172.21.15.82:0/3688156089 shutdown_connections 2024-06-02T22:53:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.900+0000 7f69fdc7b640 1 -- 172.21.15.82:0/3688156089 wait complete. 2024-06-02T22:53:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.901+0000 7f69fdc7b640 1 Processor -- start 2024-06-02T22:53:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.901+0000 7f69fdc7b640 1 -- start start 2024-06-02T22:53:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69fdc7b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f80721a0 0x7f69f8152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69fdc7b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69f80b46d0 0x7f69f80afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69fdc7b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80cc6d0 0x7f69f8158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69fdc7b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8167350 con 0x7f69f80721a0 2024-06-02T22:53:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69fdc7b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8159f60 con 0x7f69f80b46d0 2024-06-02T22:53:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69fdc7b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f69f81674d0 con 0x7f69f80cc6d0 2024-06-02T22:53:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f80721a0 0x7f69f8152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f80721a0 0x7f69f8152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55660/0 (socket says 172.21.15.82:55660) 2024-06-02T22:53:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f77fe640 1 -- 172.21.15.82:0/764384212 learned_addr learned my addr 172.21.15.82:0/764384212 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f6ffd640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69f80b46d0 0x7f69f80afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f7fff640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80cc6d0 0x7f69f8158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f77fe640 1 -- 172.21.15.82:0/764384212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80cc6d0 msgr2=0x7f69f8158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f77fe640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80cc6d0 0x7f69f8158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f77fe640 1 -- 172.21.15.82:0/764384212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69f80b46d0 msgr2=0x7f69f80afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f77fe640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69f80b46d0 0x7f69f80afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f77fe640 1 -- 172.21.15.82:0/764384212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f8157f20 con 0x7f69f80721a0 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f7fff640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80cc6d0 0x7f69f8158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.902+0000 7f69f77fe640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f80721a0 0x7f69f8152890 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f69e800c430 tx=0x7f69e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.903+0000 7f69dffff640 1 -- 172.21.15.82:0/764384212 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8017070 con 0x7f69f80721a0 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.903+0000 7f69dffff640 1 -- 172.21.15.82:0/764384212 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69e8005ce0 con 0x7f69f80721a0 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.903+0000 7f69fdc7b640 1 -- 172.21.15.82:0/764384212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f8158200 con 0x7f69f80721a0 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.903+0000 7f69dffff640 1 -- 172.21.15.82:0/764384212 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e80072f0 con 0x7f69f80721a0 2024-06-02T22:53:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.903+0000 7f69fdc7b640 1 -- 172.21.15.82:0/764384212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f81587c0 con 0x7f69f80721a0 2024-06-02T22:53:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.904+0000 7f69fdc7b640 1 -- 172.21.15.82:0/764384212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f8068430 con 0x7f69f80721a0 2024-06-02T22:53:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.904+0000 7f69dffff640 1 -- 172.21.15.82:0/764384212 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69e801a070 con 0x7f69f80721a0 2024-06-02T22:53:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.905+0000 7f69dffff640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f69e406be30 0x7f69e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.905+0000 7f69f6ffd640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f69e406be30 0x7f69e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.905+0000 7f69dffff640 1 -- 172.21.15.82:0/764384212 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f69e808a0b0 con 0x7f69f80721a0 2024-06-02T22:53:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.905+0000 7f69f6ffd640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f69e406be30 0x7f69e406e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f69ec034000 tx=0x7f69ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:33.909+0000 7f69dffff640 1 -- 172.21.15.82:0/764384212 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f69e8058610 con 0x7f69f80721a0 2024-06-02T22:53:34.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.153+0000 7f69fdc7b640 1 -- 172.21.15.82:0/764384212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) -- 0x7f69f8157310 con 0x7f69f80721a0 2024-06-02T22:53:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.187+0000 7f69dffff640 1 -- 172.21.15.82:0/764384212 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v101) ==== 137+0+0 (secure 0 0 0) 0x7f69e805c910 con 0x7f69f80721a0 2024-06-02T22:53:34.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 -- 172.21.15.82:0/764384212 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f69e406be30 msgr2=0x7f69e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:34.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f69e406be30 0x7f69e406e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f69ec034000 tx=0x7f69ec02e000 comp rx=0 tx=0).stop 2024-06-02T22:53:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 -- 172.21.15.82:0/764384212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f80721a0 msgr2=0x7f69f8152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f80721a0 0x7f69f8152890 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f69e800c430 tx=0x7f69e800c8f0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 -- 172.21.15.82:0/764384212 shutdown_connections 2024-06-02T22:53:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f69e406be30 0x7f69e406e2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69f80cc6d0 0x7f69f8158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69f80b46d0 0x7f69f80afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 --2- 172.21.15.82:0/764384212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69f80721a0 0x7f69f8152890 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 -- 172.21.15.82:0/764384212 >> 172.21.15.82:0/764384212 conn(0x7f69f80b19f0 msgr2=0x7f69f80ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 -- 172.21.15.82:0/764384212 shutdown_connections 2024-06-02T22:53:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.189+0000 7f69fdc7b640 1 -- 172.21.15.82:0/764384212 wait complete. 2024-06-02T22:53:34.201 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-02T22:53:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.303+0000 7f401fa7d640 1 Processor -- start 2024-06-02T22:53:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.303+0000 7f401fa7d640 1 -- start start 2024-06-02T22:53:34.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.304+0000 7f401fa7d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40180b3b40 0x7f40180b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.304+0000 7f401fa7d640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f40180b48e0 0x7f40180b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.304+0000 7f401fa7d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f401815c870 con 0x7f40180d0020 2024-06-02T22:53:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.304+0000 7f401fa7d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f401815cb50 con 0x7f40180b3b40 2024-06-02T22:53:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.304+0000 7f401fa7d640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f401815ce30 con 0x7f40180b48e0 2024-06-02T22:53:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.304+0000 7f401d819640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40180b3b40 0x7f40180b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.304+0000 7f401d819640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f40180b3b40 0x7f40180b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55674/0 (socket says 172.21.15.82:55674) 2024-06-02T22:53:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.304+0000 7f401d819640 1 -- 172.21.15.82:0/4165597473 learned_addr learned my addr 172.21.15.82:0/4165597473 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.304+0000 7f401d018640 1 --2- 172.21.15.82:0/4165597473 >> v2:172.21.15.184:3300/0 conn(0x7f40180b48e0 0x7f40180b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.305+0000 7f401d819640 1 -- 172.21.15.82:0/4165597473 >> v2:172.21.15.184:3300/0 conn(0x7f40180b48e0 msgr2=0x7f40180b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.305+0000 7f401d819640 1 --2- 172.21.15.82:0/4165597473 >> v2:172.21.15.184:3300/0 conn(0x7f40180b48e0 0x7f40180b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.305+0000 7f401d819640 1 -- 172.21.15.82:0/4165597473 >> v1:172.21.15.184:6789/0 conn(0x7f40180d0020 legacy=0x7f401806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.305+0000 7f401d819640 1 -- 172.21.15.82:0/4165597473 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401815d110 con 0x7f40180b3b40 2024-06-02T22:53:34.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.305+0000 7f401d018640 1 --2- 172.21.15.82:0/4165597473 >> v2:172.21.15.184:3300/0 conn(0x7f40180b48e0 0x7f40180b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.305+0000 7f401d819640 1 --2- 172.21.15.82:0/4165597473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40180b3b40 0x7f40180b2bf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f40180b52e0 tx=0x7f401402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf6836f848572af server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.305+0000 7f401c817640 1 -- 172.21.15.82:0/4165597473 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014037070 con 0x7f40180b3b40 2024-06-02T22:53:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.305+0000 7f401c817640 1 -- 172.21.15.82:0/4165597473 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4014032440 con 0x7f40180b3b40 2024-06-02T22:53:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.305+0000 7f401c817640 1 -- 172.21.15.82:0/4165597473 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014032810 con 0x7f40180b3b40 2024-06-02T22:53:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.306+0000 7f401fa7d640 1 -- 172.21.15.82:0/4165597473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40180b3b40 msgr2=0x7f40180b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.306+0000 7f401fa7d640 1 --2- 172.21.15.82:0/4165597473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40180b3b40 0x7f40180b2bf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f40180b52e0 tx=0x7f401402a230 comp rx=0 tx=0).stop 2024-06-02T22:53:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.306+0000 7f401fa7d640 1 -- 172.21.15.82:0/4165597473 shutdown_connections 2024-06-02T22:53:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.306+0000 7f401fa7d640 1 --2- 172.21.15.82:0/4165597473 >> v2:172.21.15.184:3300/0 conn(0x7f40180b48e0 0x7f40180b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.306+0000 7f401fa7d640 1 --2- 172.21.15.82:0/4165597473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40180b3b40 0x7f40180b2bf0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.306+0000 7f401fa7d640 1 -- 172.21.15.82:0/4165597473 >> 172.21.15.82:0/4165597473 conn(0x7f40180b1d10 msgr2=0x7f40180b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.306+0000 7f401fa7d640 1 -- 172.21.15.82:0/4165597473 shutdown_connections 2024-06-02T22:53:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.306+0000 7f401fa7d640 1 -- 172.21.15.82:0/4165597473 wait complete. 2024-06-02T22:53:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.307+0000 7f401fa7d640 1 Processor -- start 2024-06-02T22:53:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.307+0000 7f401fa7d640 1 -- start start 2024-06-02T22:53:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401fa7d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40180b3b40 0x7f401814aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401fa7d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40180b48e0 0x7f4018158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401fa7d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40180d0020 0x7f401809cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401fa7d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f401815c490 con 0x7f40180b3b40 2024-06-02T22:53:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401fa7d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f40180b3f20 con 0x7f40180d0020 2024-06-02T22:53:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401fa7d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f401815c610 con 0x7f40180b48e0 2024-06-02T22:53:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401d819640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40180b3b40 0x7f401814aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401d819640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40180b3b40 0x7f401814aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55676/0 (socket says 172.21.15.82:55676) 2024-06-02T22:53:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401d819640 1 -- 172.21.15.82:0/3503181636 learned_addr learned my addr 172.21.15.82:0/3503181636 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401d018640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40180b48e0 0x7f4018158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401e01a640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40180d0020 0x7f401809cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401d819640 1 -- 172.21.15.82:0/3503181636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40180b48e0 msgr2=0x7f4018158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401d819640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40180b48e0 0x7f4018158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401d819640 1 -- 172.21.15.82:0/3503181636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40180d0020 msgr2=0x7f401809cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401d819640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40180d0020 0x7f401809cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.308+0000 7f401d819640 1 -- 172.21.15.82:0/3503181636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4018158e50 con 0x7f40180b3b40 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.309+0000 7f401d819640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40180b3b40 0x7f401814aee0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4014000c00 tx=0x7f40140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.309+0000 7f400e7fc640 1 -- 172.21.15.82:0/3503181636 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014041020 con 0x7f40180b3b40 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.309+0000 7f400e7fc640 1 -- 172.21.15.82:0/3503181636 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4014030970 con 0x7f40180b3b40 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.309+0000 7f401fa7d640 1 -- 172.21.15.82:0/3503181636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401809d730 con 0x7f40180b3b40 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.309+0000 7f400e7fc640 1 -- 172.21.15.82:0/3503181636 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014037040 con 0x7f40180b3b40 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.309+0000 7f401fa7d640 1 -- 172.21.15.82:0/3503181636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40181e6bd0 con 0x7f40180b3b40 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.310+0000 7f401fa7d640 1 -- 172.21.15.82:0/3503181636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40180683c0 con 0x7f40180b3b40 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.310+0000 7f400e7fc640 1 -- 172.21.15.82:0/3503181636 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4014044020 con 0x7f40180b3b40 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.310+0000 7f400e7fc640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.311+0000 7f400e7fc640 1 -- 172.21.15.82:0/3503181636 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f40140ab6a0 con 0x7f40180b3b40 2024-06-02T22:53:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.311+0000 7f401d018640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.311+0000 7f401d018640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f40180b0da0 tx=0x7f4008008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.315+0000 7f400e7fc640 1 -- 172.21.15.82:0/3503181636 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f401404b030 con 0x7f40180b3b40 2024-06-02T22:53:34.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.490+0000 7f401fa7d640 1 -- 172.21.15.82:0/3503181636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f40180cc9f0 con 0x7f40180b3b40 2024-06-02T22:53:34.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.494+0000 7f400e7fc640 1 -- 172.21.15.82:0/3503181636 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f401407a250 con 0x7f40180b3b40 2024-06-02T22:53:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 -- 172.21.15.82:0/3503181636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ffc06be30 msgr2=0x7f3ffc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f40180b0da0 tx=0x7f4008008040 comp rx=0 tx=0).stop 2024-06-02T22:53:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 -- 172.21.15.82:0/3503181636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40180b3b40 msgr2=0x7f401814aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40180b3b40 0x7f401814aee0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4014000c00 tx=0x7f40140046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 -- 172.21.15.82:0/3503181636 shutdown_connections 2024-06-02T22:53:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40180d0020 0x7f401809cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40180b48e0 0x7f4018158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 --2- 172.21.15.82:0/3503181636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40180b3b40 0x7f401814aee0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 -- 172.21.15.82:0/3503181636 >> 172.21.15.82:0/3503181636 conn(0x7f40180b1d10 msgr2=0x7f40180b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 -- 172.21.15.82:0/3503181636 shutdown_connections 2024-06-02T22:53:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.496+0000 7f401fa7d640 1 -- 172.21.15.82:0/3503181636 wait complete. 2024-06-02T22:53:34.506 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-02T22:53:34.507 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T22:53:34.544 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T22:53:34.591 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-02T22:53:34.592 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:34.592 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:34.607 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17664 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T22:53:34.608 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:53:34.608 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:34.626 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14652 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T22:53:34.626 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:34.626 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:34.663 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17664 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T22:53:34.663 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:53:34.663 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:34.683 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14652 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T22:53:34.683 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-02T22:53:34.683 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:53:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.803+0000 7fcb0fb89640 1 Processor -- start 2024-06-02T22:53:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.803+0000 7fcb0fb89640 1 -- start start 2024-06-02T22:53:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.804+0000 7fcb0fb89640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb080cc6d0 0x7fcb080ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.804+0000 7fcb0fb89640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb08071c60 0x7fcb080720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.804+0000 7fcb0fb89640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb080ccff0 con 0x7fcb080b36c0 2024-06-02T22:53:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.804+0000 7fcb0fb89640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fcb08072820 con 0x7fcb080cc6d0 2024-06-02T22:53:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.804+0000 7fcb0fb89640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fcb08072b00 con 0x7fcb08071c60 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.804+0000 7fcb0d925640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb080cc6d0 0x7fcb080ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.804+0000 7fcb0d925640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb080cc6d0 0x7fcb080ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55692/0 (socket says 172.21.15.82:55692) 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.804+0000 7fcb0d925640 1 -- 172.21.15.82:0/4136084655 learned_addr learned my addr 172.21.15.82:0/4136084655 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.805+0000 7fcb0d124640 1 --2- 172.21.15.82:0/4136084655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb08071c60 0x7fcb080720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.805+0000 7fcb0d925640 1 -- 172.21.15.82:0/4136084655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb08071c60 msgr2=0x7fcb080720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.805+0000 7fcb0d925640 1 --2- 172.21.15.82:0/4136084655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb08071c60 0x7fcb080720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.805+0000 7fcb0d925640 1 -- 172.21.15.82:0/4136084655 >> v1:172.21.15.184:6789/0 conn(0x7fcb080b36c0 legacy=0x7fcb080b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.805+0000 7fcb0d925640 1 -- 172.21.15.82:0/4136084655 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb08072de0 con 0x7fcb080cc6d0 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.805+0000 7fcb0d925640 1 --2- 172.21.15.82:0/4136084655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb080cc6d0 0x7fcb080ccab0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009870 tx=0x7fcaf802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62afddde056069a5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.806+0000 7fcb0c923640 1 -- 172.21.15.82:0/4136084655 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8037070 con 0x7fcb080cc6d0 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.806+0000 7fcb0c923640 1 -- 172.21.15.82:0/4136084655 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf8032440 con 0x7fcb080cc6d0 2024-06-02T22:53:34.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.806+0000 7fcb0c923640 1 -- 172.21.15.82:0/4136084655 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8032810 con 0x7fcb080cc6d0 2024-06-02T22:53:34.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.806+0000 7fcb0fb89640 1 -- 172.21.15.82:0/4136084655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb080cc6d0 msgr2=0x7fcb080ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:34.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.806+0000 7fcb0fb89640 1 --2- 172.21.15.82:0/4136084655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb080cc6d0 0x7fcb080ccab0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009870 tx=0x7fcaf802a210 comp rx=0 tx=0).stop 2024-06-02T22:53:34.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.806+0000 7fcb0fb89640 1 -- 172.21.15.82:0/4136084655 shutdown_connections 2024-06-02T22:53:34.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.806+0000 7fcb0fb89640 1 --2- 172.21.15.82:0/4136084655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb08071c60 0x7fcb080720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.806+0000 7fcb0fb89640 1 --2- 172.21.15.82:0/4136084655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb080cc6d0 0x7fcb080ccab0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.806+0000 7fcb0fb89640 1 -- 172.21.15.82:0/4136084655 >> 172.21.15.82:0/4136084655 conn(0x7fcb080b19f0 msgr2=0x7fcb080b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:34.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.806+0000 7fcb0fb89640 1 -- 172.21.15.82:0/4136084655 shutdown_connections 2024-06-02T22:53:34.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.806+0000 7fcb0fb89640 1 -- 172.21.15.82:0/4136084655 wait complete. 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.807+0000 7fcb0fb89640 1 Processor -- start 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.807+0000 7fcb0fb89640 1 -- start start 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0fb89640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb08071c60 0x7fcb080cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0fb89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb080b36c0 0x7fcb080d0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0fb89640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb080cc6d0 0x7fcb08153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0fb89640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb08159f60 con 0x7fcb080b36c0 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0fb89640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0815c890 con 0x7fcb08071c60 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0fb89640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fcb080b4240 con 0x7fcb080cc6d0 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0d124640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb080b36c0 0x7fcb080d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0d124640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb080b36c0 0x7fcb080d0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55708/0 (socket says 172.21.15.82:55708) 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0d124640 1 -- 172.21.15.82:0/119291236 learned_addr learned my addr 172.21.15.82:0/119291236 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:34.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0e126640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb080cc6d0 0x7fcb08153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0d925640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb08071c60 0x7fcb080cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0d124640 1 -- 172.21.15.82:0/119291236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb080cc6d0 msgr2=0x7fcb08153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0d124640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb080cc6d0 0x7fcb08153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0d124640 1 -- 172.21.15.82:0/119291236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb08071c60 msgr2=0x7fcb080cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0d124640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb08071c60 0x7fcb080cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0d124640 1 -- 172.21.15.82:0/119291236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb080d0a80 con 0x7fcb080b36c0 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0e126640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb080cc6d0 0x7fcb08153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.808+0000 7fcb0d925640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb08071c60 0x7fcb080cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.809+0000 7fcb0d124640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb080b36c0 0x7fcb080d0540 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00d800 tx=0x7fcafc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.809+0000 7fcb067fc640 1 -- 172.21.15.82:0/119291236 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00b6c0 con 0x7fcb080b36c0 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.809+0000 7fcb067fc640 1 -- 172.21.15.82:0/119291236 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcafc019070 con 0x7fcb080b36c0 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.809+0000 7fcb0fb89640 1 -- 172.21.15.82:0/119291236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb080cf1c0 con 0x7fcb080b36c0 2024-06-02T22:53:34.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.809+0000 7fcb067fc640 1 -- 172.21.15.82:0/119291236 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00ba80 con 0x7fcb080b36c0 2024-06-02T22:53:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.809+0000 7fcb0fb89640 1 -- 172.21.15.82:0/119291236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb080ce400 con 0x7fcb080b36c0 2024-06-02T22:53:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.810+0000 7fcb0fb89640 1 -- 172.21.15.82:0/119291236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb08068430 con 0x7fcb080b36c0 2024-06-02T22:53:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.810+0000 7fcb067fc640 1 -- 172.21.15.82:0/119291236 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcafc00bc20 con 0x7fcb080b36c0 2024-06-02T22:53:34.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.811+0000 7fcb067fc640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcaf406be30 0x7fcaf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:34.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.811+0000 7fcb0d925640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcaf406be30 0x7fcaf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:34.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.811+0000 7fcb067fc640 1 -- 172.21.15.82:0/119291236 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fcafc08b130 con 0x7fcb080b36c0 2024-06-02T22:53:34.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.811+0000 7fcb0d925640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcaf406be30 0x7fcaf406e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8034000 tx=0x7fcaf802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:34.816+0000 7fcb067fc640 1 -- 172.21.15.82:0/119291236 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcafc059ce0 con 0x7fcb080b36c0 2024-06-02T22:53:35.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.025+0000 7fcb0fb89640 1 -- 172.21.15.82:0/119291236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb0809dd00 con 0x7fcb080b36c0 2024-06-02T22:53:35.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.025+0000 7fcb067fc640 1 -- 172.21.15.82:0/119291236 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3875 (secure 0 0 0) 0x7fcafc0595e0 con 0x7fcb080b36c0 2024-06-02T22:53:35.026 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:35.026 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2802926071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2802926071},{"type":"v1","addr":"172.21.15.184:6834","nonce":2802926071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4796,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/2432600475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":2432600475},{"type":"v1","addr":"172.21.15.184:6835","nonce":2432600475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":4908,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2538474234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2538474234},{"type":"v1","addr":"172.21.15.82:6836","nonce":2538474234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1604488280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1604488280},{"type":"v1","addr":"172.21.15.82:6837","nonce":1604488280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-06-02T22:53:35.026 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 19 2024-06-02T22:53:35.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.027+0000 7fcb0fb89640 1 -- 172.21.15.82:0/119291236 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcaf406be30 msgr2=0x7fcaf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:35.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.027+0000 7fcb0fb89640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcaf406be30 0x7fcaf406e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8034000 tx=0x7fcaf802e000 comp rx=0 tx=0).stop 2024-06-02T22:53:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.027+0000 7fcb0fb89640 1 -- 172.21.15.82:0/119291236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb080b36c0 msgr2=0x7fcb080d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.027+0000 7fcb0fb89640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb080b36c0 0x7fcb080d0540 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00d800 tx=0x7fcafc00dcc0 comp rx=0 tx=0).stop 2024-06-02T22:53:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.027+0000 7fcb0fb89640 1 -- 172.21.15.82:0/119291236 shutdown_connections 2024-06-02T22:53:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.027+0000 7fcb0fb89640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcaf406be30 0x7fcaf406e2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.027+0000 7fcb0fb89640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb080cc6d0 0x7fcb08153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.027+0000 7fcb0fb89640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb080b36c0 0x7fcb080d0540 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.027+0000 7fcb0fb89640 1 --2- 172.21.15.82:0/119291236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb08071c60 0x7fcb080cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.027+0000 7fcb0fb89640 1 -- 172.21.15.82:0/119291236 >> 172.21.15.82:0/119291236 conn(0x7fcb080b19f0 msgr2=0x7fcb0815df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.028+0000 7fcb0fb89640 1 -- 172.21.15.82:0/119291236 shutdown_connections 2024-06-02T22:53:35.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.028+0000 7fcb0fb89640 1 -- 172.21.15.82:0/119291236 wait complete. 2024-06-02T22:53:35.038 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-02T22:53:35.039 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-02T22:53:35.039 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-02T22:53:35.039 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:53:35.039 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-02T22:53:35.039 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-02T22:53:35.039 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-02T22:53:35.040 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:53:35.040 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-02T22:53:35.040 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-02T22:53:35.040 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-02T22:53:35.040 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:53:35.040 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-02T22:53:35.040 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-02T22:53:35.040 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-02T22:53:35.041 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:53:35.049 INFO:tasks.ceph.mds.a:Stopped 2024-06-02T22:53:35.049 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-02T22:53:35.050 INFO:tasks.ceph.mds.c:Stopped 2024-06-02T22:53:35.051 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-02T22:53:35.052 INFO:tasks.ceph.mds.b:Stopped 2024-06-02T22:53:35.053 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-02T22:53:35.053 INFO:tasks.ceph.mds.d:Stopped 2024-06-02T22:53:35.054 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-02T22:53:35.092 INFO:tasks.ceph.mds.a:Started 2024-06-02T22:53:35.093 DEBUG:teuthology.parallel:result is None 2024-06-02T22:53:35.093 INFO:tasks.ceph.mds.c:Started 2024-06-02T22:53:35.093 DEBUG:teuthology.parallel:result is None 2024-06-02T22:53:35.095 INFO:tasks.ceph.mds.b:Started 2024-06-02T22:53:35.095 DEBUG:teuthology.parallel:result is None 2024-06-02T22:53:35.096 INFO:tasks.ceph.mds.d:Started 2024-06-02T22:53:35.096 DEBUG:teuthology.parallel:result is None 2024-06-02T22:53:35.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-02T22:53:35.168 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2024-06-02T22:53:35.169 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2024-06-02T22:53:35.177 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2024-06-02T22:53:35.177 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2024-06-02T22:53:35.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.204+0000 7fbb7fd16640 1 Processor -- start 2024-06-02T22:53:35.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.204+0000 7fbb7fd16640 1 -- start start 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.205+0000 7fbb7fd16640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb780d2680 0x7fbb7815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.205+0000 7fbb7fd16640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbb780d1fc0 0x7fbb780d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.205+0000 7fbb7fd16640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb780d2fa0 con 0x7fbb78161fa0 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.205+0000 7fbb7fd16640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbb780cff80 con 0x7fbb780d2680 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.205+0000 7fbb7fd16640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fbb780d13e0 con 0x7fbb780d1fc0 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.205+0000 7fbb7dab2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb780d2680 0x7fbb7815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.205+0000 7fbb7dab2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb780d2680 0x7fbb7815f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55746/0 (socket says 172.21.15.82:55746) 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.205+0000 7fbb7dab2640 1 -- 172.21.15.82:0/3017823320 learned_addr learned my addr 172.21.15.82:0/3017823320 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.205+0000 7fbb7dab2640 1 -- 172.21.15.82:0/3017823320 >> v2:172.21.15.184:3300/0 conn(0x7fbb780d1fc0 msgr2=0x7fbb780d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.205+0000 7fbb7dab2640 1 --2- 172.21.15.82:0/3017823320 >> v2:172.21.15.184:3300/0 conn(0x7fbb780d1fc0 0x7fbb780d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.205+0000 7fbb7dab2640 1 -- 172.21.15.82:0/3017823320 >> v1:172.21.15.184:6789/0 conn(0x7fbb78161fa0 legacy=0x7fbb781623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:35.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.206+0000 7fbb7dab2640 1 -- 172.21.15.82:0/3017823320 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb780d0ad0 con 0x7fbb780d2680 2024-06-02T22:53:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.206+0000 7fbb7dab2640 1 --2- 172.21.15.82:0/3017823320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb780d2680 0x7fbb7815f1a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbb780c7960 tx=0x7fbb7002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a76b91ee712611 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.206+0000 7fbb7cab0640 1 -- 172.21.15.82:0/3017823320 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70036070 con 0x7fbb780d2680 2024-06-02T22:53:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.206+0000 7fbb7cab0640 1 -- 172.21.15.82:0/3017823320 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb70031600 con 0x7fbb780d2680 2024-06-02T22:53:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.206+0000 7fbb7cab0640 1 -- 172.21.15.82:0/3017823320 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb700319d0 con 0x7fbb780d2680 2024-06-02T22:53:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.207+0000 7fbb7fd16640 1 -- 172.21.15.82:0/3017823320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb780d2680 msgr2=0x7fbb7815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.207+0000 7fbb7fd16640 1 --2- 172.21.15.82:0/3017823320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb780d2680 0x7fbb7815f1a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbb780c7960 tx=0x7fbb7002a6f0 comp rx=0 tx=0).stop 2024-06-02T22:53:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.207+0000 7fbb7fd16640 1 -- 172.21.15.82:0/3017823320 shutdown_connections 2024-06-02T22:53:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.207+0000 7fbb7fd16640 1 --2- 172.21.15.82:0/3017823320 >> v2:172.21.15.184:3300/0 conn(0x7fbb780d1fc0 0x7fbb780d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.207+0000 7fbb7fd16640 1 --2- 172.21.15.82:0/3017823320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb780d2680 0x7fbb7815f1a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:35.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.207+0000 7fbb7fd16640 1 -- 172.21.15.82:0/3017823320 >> 172.21.15.82:0/3017823320 conn(0x7fbb7809d3f0 msgr2=0x7fbb780d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.207+0000 7fbb7fd16640 1 -- 172.21.15.82:0/3017823320 shutdown_connections 2024-06-02T22:53:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.207+0000 7fbb7fd16640 1 -- 172.21.15.82:0/3017823320 wait complete. 2024-06-02T22:53:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.208+0000 7fbb7fd16640 1 Processor -- start 2024-06-02T22:53:35.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.208+0000 7fbb7fd16640 1 -- start start 2024-06-02T22:53:35.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7fd16640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb780d1fc0 0x7fbb780b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7fd16640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb780d2680 0x7fbb78159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7fd16640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb78161fa0 0x7fbb7815c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7fd16640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb780d1070 con 0x7fbb780d1fc0 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7fd16640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb780d0d90 con 0x7fbb78161fa0 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7fd16640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbb780d2400 con 0x7fbb780d2680 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7dab2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb780d1fc0 0x7fbb780b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7dab2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb780d1fc0 0x7fbb780b97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55754/0 (socket says 172.21.15.82:55754) 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7dab2640 1 -- 172.21.15.82:0/1127588296 learned_addr learned my addr 172.21.15.82:0/1127588296 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7dab2640 1 -- 172.21.15.82:0/1127588296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb780d2680 msgr2=0x7fbb78159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7d2b1640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb780d2680 0x7fbb78159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7dab2640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb780d2680 0x7fbb78159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7dab2640 1 -- 172.21.15.82:0/1127588296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb78161fa0 msgr2=0x7fbb7815c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:35.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7dab2640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb78161fa0 0x7fbb7815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:35.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.209+0000 7fbb7dab2640 1 -- 172.21.15.82:0/1127588296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7815a470 con 0x7fbb780d1fc0 2024-06-02T22:53:35.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.210+0000 7fbb7dab2640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb780d1fc0 0x7fbb780b97f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbb70034040 tx=0x7fbb70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:35.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.210+0000 7fbb767fc640 1 -- 172.21.15.82:0/1127588296 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70041020 con 0x7fbb780d1fc0 2024-06-02T22:53:35.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.210+0000 7fbb767fc640 1 -- 172.21.15.82:0/1127588296 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb70007800 con 0x7fbb780d1fc0 2024-06-02T22:53:35.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.210+0000 7fbb7fd16640 1 -- 172.21.15.82:0/1127588296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb780b7050 con 0x7fbb780d1fc0 2024-06-02T22:53:35.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.210+0000 7fbb767fc640 1 -- 172.21.15.82:0/1127588296 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70036040 con 0x7fbb780d1fc0 2024-06-02T22:53:35.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.210+0000 7fbb7fd16640 1 -- 172.21.15.82:0/1127588296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb780ccd10 con 0x7fbb780d1fc0 2024-06-02T22:53:35.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.211+0000 7fbb7fd16640 1 -- 172.21.15.82:0/1127588296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb78068430 con 0x7fbb780d1fc0 2024-06-02T22:53:35.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.211+0000 7fbb767fc640 1 -- 172.21.15.82:0/1127588296 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb70044020 con 0x7fbb780d1fc0 2024-06-02T22:53:35.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.212+0000 7fbb767fc640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb6406be60 0x7fbb6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:35.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.212+0000 7fbb7d2b1640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb6406be60 0x7fbb6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:35.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.212+0000 7fbb767fc640 1 -- 172.21.15.82:0/1127588296 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fbb700abb30 con 0x7fbb780d1fc0 2024-06-02T22:53:35.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.212+0000 7fbb7d2b1640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb6406be60 0x7fbb6406e320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb78073160 tx=0x7fbb6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:35.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.216+0000 7fbb767fc640 1 -- 172.21.15.82:0/1127588296 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbb7004b030 con 0x7fbb780d1fc0 2024-06-02T22:53:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:35.400+0000 7fbb7fd16640 1 -- 172.21.15.82:0/1127588296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fbb780d0270 con 0x7fbb780d1fc0 2024-06-02T22:53:36.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.201+0000 7fbb767fc640 1 -- 172.21.15.82:0/1127588296 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) ==== 97+0+0 (secure 0 0 0) 0x7fbb7007a7a0 con 0x7fbb780d1fc0 2024-06-02T22:53:36.201 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2024-06-02T22:53:36.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 -- 172.21.15.82:0/1127588296 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb6406be60 msgr2=0x7fbb6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb6406be60 0x7fbb6406e320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb78073160 tx=0x7fbb6c008040 comp rx=0 tx=0).stop 2024-06-02T22:53:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 -- 172.21.15.82:0/1127588296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb780d1fc0 msgr2=0x7fbb780b97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb780d1fc0 0x7fbb780b97f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbb70034040 tx=0x7fbb70004a40 comp rx=0 tx=0).stop 2024-06-02T22:53:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 -- 172.21.15.82:0/1127588296 shutdown_connections 2024-06-02T22:53:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb6406be60 0x7fbb6406e320 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb78161fa0 0x7fbb7815c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb780d2680 0x7fbb78159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 --2- 172.21.15.82:0/1127588296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb780d1fc0 0x7fbb780b97f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 -- 172.21.15.82:0/1127588296 >> 172.21.15.82:0/1127588296 conn(0x7fbb7809d3f0 msgr2=0x7fbb780b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 -- 172.21.15.82:0/1127588296 shutdown_connections 2024-06-02T22:53:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.204+0000 7fbb7fd16640 1 -- 172.21.15.82:0/1127588296 wait complete. 2024-06-02T22:53:36.217 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-02T22:53:36.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.324+0000 7fa7f924d640 1 Processor -- start 2024-06-02T22:53:36.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.324+0000 7fa7f924d640 1 -- start start 2024-06-02T22:53:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.325+0000 7fa7f924d640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa7f41618e0 0x7fa7f40cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.325+0000 7fa7f924d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f40d2c20 0x7fa7f40b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.325+0000 7fa7f924d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f40d03e0 con 0x7fa7f4161cc0 2024-06-02T22:53:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.325+0000 7fa7f924d640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fa7f40b4130 con 0x7fa7f41618e0 2024-06-02T22:53:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.325+0000 7fa7f924d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f40d0100 con 0x7fa7f40d2c20 2024-06-02T22:53:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.325+0000 7fa7ea59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa7f4161cc0 0x7fa7f40d2510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34878/0 (socket says 172.21.15.82:34878) 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.325+0000 7fa7ea59c640 1 -- 172.21.15.82:0/1194656441 learned_addr learned my addr 172.21.15.82:0/1194656441 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.325+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2157794017 0 0) 0x7fa7f40d03e0 con 0x7fa7f4161cc0 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7e0003520 con 0x7fa7f4161cc0 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f2d9d640 1 --2- 172.21.15.82:0/1194656441 >> v2:172.21.15.184:3300/0 conn(0x7fa7f41618e0 0x7fa7f40cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f359e640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f40d2c20 0x7fa7f40b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1093843675 0 0) 0x7fa7e0003520 con 0x7fa7f4161cc0 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f40d2c20 msgr2=0x7fa7f40b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f40d2c20 0x7fa7f40b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 >> v2:172.21.15.184:3300/0 conn(0x7fa7f41618e0 msgr2=0x7fa7f40cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 --2- 172.21.15.82:0/1194656441 >> v2:172.21.15.184:3300/0 conn(0x7fa7f41618e0 0x7fa7f40cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f40b3ae0 con 0x7fa7f4161cc0 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fa7dc001670 con 0x7fa7f4161cc0 2024-06-02T22:53:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 >> v1:172.21.15.82:6789/0 conn(0x7fa7f4161cc0 legacy=0x7fa7f40d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7e00039b0 0x7fa7e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f40d2c20 0x7fa7e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e0004d40 0x7fa7e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f40b4130 con 0x7fa7e00039b0 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f40d0100 con 0x7fa7e0004d40 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa7e000bac0 con 0x7fa7f40d2c20 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f2d9d640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7e00039b0 0x7fa7e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f359e640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e0004d40 0x7fa7e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7ea59c640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f40d2c20 0x7fa7e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f2d9d640 1 -- 172.21.15.82:0/1194656441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f40d2c20 msgr2=0x7fa7e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f2d9d640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f40d2c20 0x7fa7e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f2d9d640 1 -- 172.21.15.82:0/1194656441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e0004d40 msgr2=0x7fa7e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f2d9d640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e0004d40 0x7fa7e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.326+0000 7fa7f2d9d640 1 -- 172.21.15.82:0/1194656441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e0003520 con 0x7fa7e00039b0 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.327+0000 7fa7f2d9d640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7e00039b0 0x7fa7e0003dd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400ba30 tx=0x7fa7e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836637e54a28a985 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.327+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4030070 con 0x7fa7e00039b0 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.327+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e402ae10 con 0x7fa7e00039b0 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.327+0000 7fa7f259c640 1 -- 172.21.15.82:0/1194656441 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400b600 con 0x7fa7e00039b0 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.327+0000 7fa7f924d640 1 -- 172.21.15.82:0/1194656441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7e00039b0 msgr2=0x7fa7e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.327+0000 7fa7f924d640 1 --2- 172.21.15.82:0/1194656441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7e00039b0 0x7fa7e0003dd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400ba30 tx=0x7fa7e0005830 comp rx=0 tx=0).stop 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.328+0000 7fa7f359e640 1 -- 172.21.15.82:0/1194656441 reap_dead start 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.328+0000 7fa7f924d640 1 -- 172.21.15.82:0/1194656441 shutdown_connections 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.328+0000 7fa7f924d640 1 -- 172.21.15.82:0/1194656441 >> 172.21.15.82:0/1194656441 conn(0x7fa7f409d410 msgr2=0x7fa7f40d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.328+0000 7fa7f924d640 1 -- 172.21.15.82:0/1194656441 shutdown_connections 2024-06-02T22:53:36.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.328+0000 7fa7f924d640 1 -- 172.21.15.82:0/1194656441 wait complete. 2024-06-02T22:53:36.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.329+0000 7fa7f924d640 1 Processor -- start 2024-06-02T22:53:36.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.329+0000 7fa7f924d640 1 -- start start 2024-06-02T22:53:36.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7f924d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e00039b0 0x7fa7f40cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7f924d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f40ca6d0 0x7fa7f41f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7f924d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f41f7a60 0x7fa7f41f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7f924d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f40cfec0 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7f924d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f40cfd40 con 0x7fa7e00039b0 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7f924d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f40d4cd0 con 0x7fa7f41f7a60 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7ea59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f40ca6d0 0x7fa7f41f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7ea59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f40ca6d0 0x7fa7f41f7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55770/0 (socket says 172.21.15.82:55770) 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7ea59c640 1 -- 172.21.15.82:0/3607980569 learned_addr learned my addr 172.21.15.82:0/3607980569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7f2d9d640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e00039b0 0x7fa7f40cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7f359e640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f41f7a60 0x7fa7f41f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7ea59c640 1 -- 172.21.15.82:0/3607980569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f41f7a60 msgr2=0x7fa7f41f3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7ea59c640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f41f7a60 0x7fa7f41f3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7ea59c640 1 -- 172.21.15.82:0/3607980569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e00039b0 msgr2=0x7fa7f40cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7ea59c640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e00039b0 0x7fa7f40cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7ea59c640 1 -- 172.21.15.82:0/3607980569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f40c9970 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7f359e640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f41f7a60 0x7fa7f41f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.330+0000 7fa7ea59c640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f40ca6d0 0x7fa7f41f7520 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00e840 tx=0x7fa7dc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.331+0000 7fa7ebfff640 1 -- 172.21.15.82:0/3607980569 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00c8d0 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.331+0000 7fa7ebfff640 1 -- 172.21.15.82:0/3607980569 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7dc018070 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.331+0000 7fa7f924d640 1 -- 172.21.15.82:0/3607980569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f41f4c90 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.331+0000 7fa7ebfff640 1 -- 172.21.15.82:0/3607980569 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00ccb0 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.331+0000 7fa7f924d640 1 -- 172.21.15.82:0/3607980569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f40c9ed0 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.332+0000 7fa7f924d640 1 -- 172.21.15.82:0/3607980569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f4068430 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.332+0000 7fa7ebfff640 1 -- 172.21.15.82:0/3607980569 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7dc01d460 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.332+0000 7fa7ebfff640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa7d406be30 0x7fa7d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.332+0000 7fa7ebfff640 1 -- 172.21.15.82:0/3607980569 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7fa7dc08aba0 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.332+0000 7fa7f2d9d640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa7d406be30 0x7fa7d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.333+0000 7fa7f2d9d640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa7d406be30 0x7fa7d406e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400ba00 tx=0x7fa7e4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:36.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.337+0000 7fa7ebfff640 1 -- 172.21.15.82:0/3607980569 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa7f40c9970 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.577+0000 7fa7f924d640 1 -- 172.21.15.82:0/3607980569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa7f41f7e40 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.577+0000 7fa7ebfff640 1 -- 172.21.15.82:0/3607980569 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5298 (secure 0 0 0) 0x7fa7dc059710 con 0x7fa7f40ca6d0 2024-06-02T22:53:36.579 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:36.579 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:53:36.579 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2024-06-02T22:53:36.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.579 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2024-06-02T22:53:36.579 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xm0JTKCBAAndEAxOeEeclgFu+ITHYS5g==", 2024-06-02T22:53:36.579 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.579 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:53:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-06-02T22:53:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-06-02T22:53:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2024-06-02T22:53:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmuZhxFRAA/Sj+Z2Hh0XmmMLB27h+SgA==", 2024-06-02T22:53:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:53:36.580 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-06-02T22:53:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-06-02T22:53:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2024-06-02T22:53:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmYVVpEBAA+49UXndP6JiF1dcwkBFqlw==", 2024-06-02T22:53:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:53:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-06-02T22:53:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmf4THHBAAXUhfYk2mRNxtPj5B4HHVZQ==", 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.583 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2024-06-02T22:53:36.583 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBd91xmEasoOhAAn6YZXmsI4CVreLyIC30o4Q==", 2024-06-02T22:53:36.583 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.583 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:53:36.583 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:53:36.583 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.583 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.583 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBg91xmJdkfORAA0rRjyHkrw/mK6gUgZvQNBA==", 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBj91xmeTPxNhAAooQjxmZuy8trF6vOdHJTiA==", 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.584 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBm91xmcjbGNRAAuvxHJk3NYqJ6qFVwfN4pTg==", 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBs91xmCHjaORAA3dKnGKAZH64lFFq2rkReiA==", 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBv91xmaeZ7OBAAs12vs2Jp8AB/3/Pjp3fHEQ==", 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.586 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBy91xmTfXNNhAAXYTITs5gu0klkjGHWW4s2Q==", 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQB191xm/2M9NRAAg194AhFY+9WbbJ/9DufSMw==", 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g==", 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:53:36.588 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw pool=cephfs_data" 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmDhLEKRAA9fyng5JM+1I/MYHEX3ITgw==", 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2024-06-02T22:53:36.589 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xm352MJhAAEMeMOG4RTRYcbQU3S3v2MA==", 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmxPxRLxAAO6UAflCnHzmvq4DrYZfTKg==", 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBZ91xm3be1JBAA4askgNcaQ2jlpYOcLYeQAQ==", 2024-06-02T22:53:36.591 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xm8/dxBRAAav4Fr7WoUlsnw8abkaZlTA==", 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:36.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.593 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2024-06-02T22:53:36.593 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBa91xmnhQdARAAmNiCMML2eHb0wcNAW45Fyw==", 2024-06-02T22:53:36.593 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-06-02T22:53:36.593 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2024-06-02T22:53:36.593 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2024-06-02T22:53:36.593 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-06-02T22:53:36.593 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.593 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.593 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-02T22:53:36.593 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:53:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 -- 172.21.15.82:0/3607980569 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa7d406be30 msgr2=0x7fa7d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa7d406be30 0x7fa7d406e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400ba00 tx=0x7fa7e4030000 comp rx=0 tx=0).stop 2024-06-02T22:53:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 -- 172.21.15.82:0/3607980569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f40ca6d0 msgr2=0x7fa7f41f7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f40ca6d0 0x7fa7f41f7520 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00e840 tx=0x7fa7dc00ed00 comp rx=0 tx=0).stop 2024-06-02T22:53:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 -- 172.21.15.82:0/3607980569 shutdown_connections 2024-06-02T22:53:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa7d406be30 0x7fa7d406e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7f41f7a60 0x7fa7f41f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7f40ca6d0 0x7fa7f41f7520 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 --2- 172.21.15.82:0/3607980569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e00039b0 0x7fa7f40cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 -- 172.21.15.82:0/3607980569 >> 172.21.15.82:0/3607980569 conn(0x7fa7f409d410 msgr2=0x7fa7f40d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:36.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 -- 172.21.15.82:0/3607980569 shutdown_connections 2024-06-02T22:53:36.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.579+0000 7fa7f924d640 1 -- 172.21.15.82:0/3607980569 wait complete. 2024-06-02T22:53:36.596 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-02T22:53:36.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.695+0000 7f861ade3640 1 Processor -- start 2024-06-02T22:53:36.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.695+0000 7f861ade3640 1 -- start start 2024-06-02T22:53:36.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.696+0000 7f861ade3640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f86140d2680 0x7f861415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.696+0000 7f861ade3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86140d0ad0 con 0x7f86140d1fc0 2024-06-02T22:53:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.696+0000 7f861ade3640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f861415f890 con 0x7f86140cef70 2024-06-02T22:53:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.696+0000 7f861ade3640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f86140d13e0 con 0x7f86140d2680 2024-06-02T22:53:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.696+0000 7f860bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f86140d1fc0 0x7f86140d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34892/0 (socket says 172.21.15.82:34892) 2024-06-02T22:53:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.696+0000 7f860bfff640 1 -- 172.21.15.82:0/179329833 learned_addr learned my addr 172.21.15.82:0/179329833 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161813488 0 0) 0x7f86140d0ad0 con 0x7f86140d1fc0 2024-06-02T22:53:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85fc003520 con 0x7f86140d1fc0 2024-06-02T22:53:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f8618b7f640 1 --2- 172.21.15.82:0/179329833 >> v2:172.21.15.184:3300/0 conn(0x7f86140d2680 0x7f861415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1069052409 0 0) 0x7f85fc003520 con 0x7f86140d1fc0 2024-06-02T22:53:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 >> v2:172.21.15.184:3300/0 conn(0x7f86140d2680 msgr2=0x7f861415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 --2- 172.21.15.82:0/179329833 >> v2:172.21.15.184:3300/0 conn(0x7f86140d2680 0x7f861415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 >> v1:172.21.15.184:6789/0 conn(0x7f86140cef70 legacy=0x7f86140cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86140d0d90 con 0x7f86140d1fc0 2024-06-02T22:53:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f8604001670 con 0x7f86140d1fc0 2024-06-02T22:53:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 >> v1:172.21.15.82:6789/0 conn(0x7f86140d1fc0 legacy=0x7f86140d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85fc0039b0 0x7f85fc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85fc004800 0x7f85fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc005210 0x7f85fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86140d13e0 con 0x7f85fc005210 2024-06-02T22:53:36.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc00c140 con 0x7f85fc0039b0 2024-06-02T22:53:36.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f85fc00c340 con 0x7f85fc004800 2024-06-02T22:53:36.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f8619380640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc005210 0x7f85fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f8618b7f640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85fc0039b0 0x7f85fc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860bfff640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85fc004800 0x7f85fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f8619380640 1 -- 172.21.15.82:0/179329833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85fc004800 msgr2=0x7f85fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:36.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f8619380640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85fc004800 0x7f85fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f8619380640 1 -- 172.21.15.82:0/179329833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85fc0039b0 msgr2=0x7f85fc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f8619380640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85fc0039b0 0x7f85fc003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f8619380640 1 -- 172.21.15.82:0/179329833 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85fc003520 con 0x7f85fc005210 2024-06-02T22:53:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.697+0000 7f860bfff640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85fc004800 0x7f85fc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.698+0000 7f8619380640 1 -- 172.21.15.82:0/179329833 reap_dead start 2024-06-02T22:53:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.698+0000 7f8619380640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc005210 0x7f85fc00b9c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f860c001e50 tx=0x7f85fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb8e8f7ecaefae server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.698+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c001a70 con 0x7f85fc005210 2024-06-02T22:53:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.698+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f860c003970 con 0x7f85fc005210 2024-06-02T22:53:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.698+0000 7f860b7fe640 1 -- 172.21.15.82:0/179329833 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c003d60 con 0x7f85fc005210 2024-06-02T22:53:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.699+0000 7f861ade3640 1 -- 172.21.15.82:0/179329833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc005210 msgr2=0x7f85fc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.699+0000 7f861ade3640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc005210 0x7f85fc00b9c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f860c001e50 tx=0x7f85fc005830 comp rx=0 tx=0).stop 2024-06-02T22:53:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.699+0000 7f861ade3640 1 -- 172.21.15.82:0/179329833 shutdown_connections 2024-06-02T22:53:36.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.699+0000 7f861ade3640 1 --2- 172.21.15.82:0/179329833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc005210 0x7f85fc00b9c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.699+0000 7f861ade3640 1 -- 172.21.15.82:0/179329833 >> 172.21.15.82:0/179329833 conn(0x7f861409d3f0 msgr2=0x7f86140d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:36.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.699+0000 7f861ade3640 1 -- 172.21.15.82:0/179329833 shutdown_connections 2024-06-02T22:53:36.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.699+0000 7f861ade3640 1 -- 172.21.15.82:0/179329833 wait complete. 2024-06-02T22:53:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.700+0000 7f861ade3640 1 Processor -- start 2024-06-02T22:53:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.700+0000 7f861ade3640 1 -- start start 2024-06-02T22:53:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f861ade3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85fc005210 0x7f861414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f861ade3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86141f44f0 0x7f861409eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f861ade3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861409f530 0x7f86141f8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f861ade3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86140d4f00 con 0x7f86141f44f0 2024-06-02T22:53:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f861ade3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f86140d2400 con 0x7f861409f530 2024-06-02T22:53:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f861ade3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f86140d1870 con 0x7f85fc005210 2024-06-02T22:53:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f860bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86141f44f0 0x7f861409eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f860bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86141f44f0 0x7f861409eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55796/0 (socket says 172.21.15.82:55796) 2024-06-02T22:53:36.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f860bfff640 1 -- 172.21.15.82:0/3146321014 learned_addr learned my addr 172.21.15.82:0/3146321014 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:36.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f8618b7f640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85fc005210 0x7f861414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f8619380640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861409f530 0x7f86141f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f860bfff640 1 -- 172.21.15.82:0/3146321014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85fc005210 msgr2=0x7f861414dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f860bfff640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85fc005210 0x7f861414dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f860bfff640 1 -- 172.21.15.82:0/3146321014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861409f530 msgr2=0x7f86141f8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f860bfff640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861409f530 0x7f86141f8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f860bfff640 1 -- 172.21.15.82:0/3146321014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861414e1c0 con 0x7f86141f44f0 2024-06-02T22:53:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f8619380640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861409f530 0x7f86141f8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.701+0000 7f860bfff640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86141f44f0 0x7f861409eff0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f860400e7f0 tx=0x7f860400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.702+0000 7f86097fa640 1 -- 172.21.15.82:0/3146321014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860400c8d0 con 0x7f86141f44f0 2024-06-02T22:53:36.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.702+0000 7f86097fa640 1 -- 172.21.15.82:0/3146321014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8604018070 con 0x7f86141f44f0 2024-06-02T22:53:36.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.702+0000 7f861ade3640 1 -- 172.21.15.82:0/3146321014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861409e190 con 0x7f86141f44f0 2024-06-02T22:53:36.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.702+0000 7f86097fa640 1 -- 172.21.15.82:0/3146321014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860400cc70 con 0x7f86141f44f0 2024-06-02T22:53:36.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.702+0000 7f861ade3640 1 -- 172.21.15.82:0/3146321014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f861409e750 con 0x7f86141f44f0 2024-06-02T22:53:36.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.703+0000 7f861ade3640 1 -- 172.21.15.82:0/3146321014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8614068430 con 0x7f86141f44f0 2024-06-02T22:53:36.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.703+0000 7f86097fa640 1 -- 172.21.15.82:0/3146321014 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f860401d460 con 0x7f86141f44f0 2024-06-02T22:53:36.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.704+0000 7f86097fa640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f860006be60 0x7f860006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.704+0000 7f86097fa640 1 -- 172.21.15.82:0/3146321014 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7f860408ab60 con 0x7f86141f44f0 2024-06-02T22:53:36.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.704+0000 7f8618b7f640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f860006be60 0x7f860006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.704+0000 7f8618b7f640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f860006be60 0x7f860006e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f86140a1e40 tx=0x7f8610008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:36.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.708+0000 7f86097fa640 1 -- 172.21.15.82:0/3146321014 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f861414e1c0 con 0x7f86141f44f0 2024-06-02T22:53:36.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.885+0000 7f861ade3640 1 -- 172.21.15.82:0/3146321014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f861409f910 con 0x7f86141f44f0 2024-06-02T22:53:36.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.885+0000 7f86097fa640 1 -- 172.21.15.82:0/3146321014 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) ==== 84+0+65 (secure 0 0 0) 0x7f86040596d0 con 0x7f86141f44f0 2024-06-02T22:53:36.885 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-06-02T22:53:36.886 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-02T22:53:36.886 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2024-06-02T22:53:36.886 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2024-06-02T22:53:36.886 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-06-02T22:53:36.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.887+0000 7f861ade3640 1 -- 172.21.15.82:0/3146321014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f860006be60 msgr2=0x7f860006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.887+0000 7f861ade3640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f860006be60 0x7f860006e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f86140a1e40 tx=0x7f8610008040 comp rx=0 tx=0).stop 2024-06-02T22:53:36.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.887+0000 7f861ade3640 1 -- 172.21.15.82:0/3146321014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86141f44f0 msgr2=0x7f861409eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.887+0000 7f861ade3640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86141f44f0 0x7f861409eff0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f860400e7f0 tx=0x7f860400ecb0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.887+0000 7f861ade3640 1 -- 172.21.15.82:0/3146321014 shutdown_connections 2024-06-02T22:53:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.887+0000 7f861ade3640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f860006be60 0x7f860006e320 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.887+0000 7f861ade3640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f861409f530 0x7f86141f8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.887+0000 7f861ade3640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86141f44f0 0x7f861409eff0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.887+0000 7f861ade3640 1 --2- 172.21.15.82:0/3146321014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85fc005210 0x7f861414dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.888+0000 7f861ade3640 1 -- 172.21.15.82:0/3146321014 >> 172.21.15.82:0/3146321014 conn(0x7f861409d3f0 msgr2=0x7f861415a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.888+0000 7f861ade3640 1 -- 172.21.15.82:0/3146321014 shutdown_connections 2024-06-02T22:53:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:36.888+0000 7f861ade3640 1 -- 172.21.15.82:0/3146321014 wait complete. 2024-06-02T22:53:36.898 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T22:53:36.898 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T22:53:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.001+0000 7fb3d4c5d640 1 Processor -- start 2024-06-02T22:53:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.001+0000 7fb3d4c5d640 1 -- start start 2024-06-02T22:53:37.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.002+0000 7fb3d4c5d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3d015a810 0x7fb3d00b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.002+0000 7fb3d4c5d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3d00af420 0x7fb3d00b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.002+0000 7fb3d4c5d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3d0073270 con 0x7fb3d00cd170 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.002+0000 7fb3d4c5d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d00ce560 con 0x7fb3d015a810 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.002+0000 7fb3d4c5d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d00b4e30 con 0x7fb3d00af420 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.002+0000 7fb3ce59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3d015a810 0x7fb3d00b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.002+0000 7fb3ce59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3d015a810 0x7fb3d00b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55808/0 (socket says 172.21.15.82:55808) 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.002+0000 7fb3ced9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb3d00cd170 0x7fb3d015e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34894/0 (socket says 172.21.15.82:34894) 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.002+0000 7fb3ce59c640 1 -- 172.21.15.82:0/1463335269 learned_addr learned my addr 172.21.15.82:0/1463335269 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.003+0000 7fb3ce59c640 1 -- 172.21.15.82:0/1463335269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3d00af420 msgr2=0x7fb3d00b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.003+0000 7fb3ce59c640 1 --2- 172.21.15.82:0/1463335269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3d00af420 0x7fb3d00b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.003+0000 7fb3ce59c640 1 -- 172.21.15.82:0/1463335269 >> v1:172.21.15.82:6789/0 conn(0x7fb3d00cd170 legacy=0x7fb3d015e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.003+0000 7fb3cd59a640 1 -- 172.21.15.82:0/1463335269 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923634594 0 0) 0x7fb3d0073270 con 0x7fb3d00cd170 2024-06-02T22:53:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.003+0000 7fb3ce59c640 1 -- 172.21.15.82:0/1463335269 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d015abf0 con 0x7fb3d015a810 2024-06-02T22:53:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.003+0000 7fb3ce59c640 1 --2- 172.21.15.82:0/1463335269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3d015a810 0x7fb3d00b43b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009870 tx=0x7fb3c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70daecd6a67bf582 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.003+0000 7fb3cd59a640 1 -- 172.21.15.82:0/1463335269 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0037070 con 0x7fb3d015a810 2024-06-02T22:53:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.004+0000 7fb3cd59a640 1 -- 172.21.15.82:0/1463335269 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c0032440 con 0x7fb3d015a810 2024-06-02T22:53:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.004+0000 7fb3cd59a640 1 -- 172.21.15.82:0/1463335269 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0032810 con 0x7fb3d015a810 2024-06-02T22:53:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.004+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/1463335269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3d015a810 msgr2=0x7fb3d00b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.004+0000 7fb3d4c5d640 1 --2- 172.21.15.82:0/1463335269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3d015a810 0x7fb3d00b43b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009870 tx=0x7fb3c002a270 comp rx=0 tx=0).stop 2024-06-02T22:53:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.004+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/1463335269 shutdown_connections 2024-06-02T22:53:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.004+0000 7fb3d4c5d640 1 --2- 172.21.15.82:0/1463335269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3d00af420 0x7fb3d00b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.004+0000 7fb3d4c5d640 1 --2- 172.21.15.82:0/1463335269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3d015a810 0x7fb3d00b43b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.004+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/1463335269 >> 172.21.15.82:0/1463335269 conn(0x7fb3d00b1980 msgr2=0x7fb3d00b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.004+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/1463335269 shutdown_connections 2024-06-02T22:53:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.004+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/1463335269 wait complete. 2024-06-02T22:53:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.005+0000 7fb3d4c5d640 1 Processor -- start 2024-06-02T22:53:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3d4c5d640 1 -- start start 2024-06-02T22:53:37.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3d4c5d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3d00af420 0x7fb3d0145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:37.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3d4c5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3d00cd170 0x7fb3d015be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:37.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3d4c5d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3d015a810 0x7fb3d01f8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3d4c5d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d00ced70 con 0x7fb3d00cd170 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3d4c5d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d00cea90 con 0x7fb3d015a810 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3d4c5d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d00cf050 con 0x7fb3d00af420 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3cdd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3d00cd170 0x7fb3d015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3cdd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3d00cd170 0x7fb3d015be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55824/0 (socket says 172.21.15.82:55824) 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3cdd9b640 1 -- 172.21.15.82:0/215697725 learned_addr learned my addr 172.21.15.82:0/215697725 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3ce59c640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3d00af420 0x7fb3d0145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.006+0000 7fb3ced9d640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3d015a810 0x7fb3d01f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3cdd9b640 1 -- 172.21.15.82:0/215697725 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3d00af420 msgr2=0x7fb3d0145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3cdd9b640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3d00af420 0x7fb3d0145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3cdd9b640 1 -- 172.21.15.82:0/215697725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3d015a810 msgr2=0x7fb3d01f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3cdd9b640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3d015a810 0x7fb3d01f8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3cdd9b640 1 -- 172.21.15.82:0/215697725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d0155ec0 con 0x7fb3d00cd170 2024-06-02T22:53:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3ce59c640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3d00af420 0x7fb3d0145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3cdd9b640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3d00cd170 0x7fb3d015be20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400b410 tx=0x7fb3c400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3beffd640 1 -- 172.21.15.82:0/215697725 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4015020 con 0x7fb3d00cd170 2024-06-02T22:53:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3beffd640 1 -- 172.21.15.82:0/215697725 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c4011850 con 0x7fb3d00cd170 2024-06-02T22:53:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/215697725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d01f8e30 con 0x7fb3d00cd170 2024-06-02T22:53:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3beffd640 1 -- 172.21.15.82:0/215697725 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4011c40 con 0x7fb3d00cd170 2024-06-02T22:53:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.007+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/215697725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d009c630 con 0x7fb3d00cd170 2024-06-02T22:53:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.008+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/215697725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d0068540 con 0x7fb3d00cd170 2024-06-02T22:53:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.008+0000 7fb3beffd640 1 -- 172.21.15.82:0/215697725 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3c4018020 con 0x7fb3d00cd170 2024-06-02T22:53:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.009+0000 7fb3beffd640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3b006be60 0x7fb3b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.009+0000 7fb3beffd640 1 -- 172.21.15.82:0/215697725 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7fb3c408abc0 con 0x7fb3d00cd170 2024-06-02T22:53:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.009+0000 7fb3ce59c640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3b006be60 0x7fb3b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:37.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.009+0000 7fb3ce59c640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3b006be60 0x7fb3b006e320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0034000 tx=0x7fb3c002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:37.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.013+0000 7fb3beffd640 1 -- 172.21.15.82:0/215697725 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb3c401f020 con 0x7fb3d00cd170 2024-06-02T22:53:37.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.187+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/215697725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb3d00aed60 con 0x7fb3d00cd170 2024-06-02T22:53:37.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.496+0000 7fb3beffd640 1 -- 172.21.15.82:0/215697725 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) ==== 138+0+0 (secure 0 0 0) 0x7fb3d0155ec0 con 0x7fb3d00cd170 2024-06-02T22:53:37.496 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2024-06-02T22:53:37.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/215697725 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3b006be60 msgr2=0x7fb3b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3b006be60 0x7fb3b006e320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0034000 tx=0x7fb3c002e000 comp rx=0 tx=0).stop 2024-06-02T22:53:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/215697725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3d00cd170 msgr2=0x7fb3d015be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3d00cd170 0x7fb3d015be20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400b410 tx=0x7fb3c400b8d0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/215697725 shutdown_connections 2024-06-02T22:53:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb3b006be60 0x7fb3b006e320 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3d015a810 0x7fb3d01f8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3d00cd170 0x7fb3d015be20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 --2- 172.21.15.82:0/215697725 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3d00af420 0x7fb3d0145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/215697725 >> 172.21.15.82:0/215697725 conn(0x7fb3d00b1980 msgr2=0x7fb3d00cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/215697725 shutdown_connections 2024-06-02T22:53:37.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.499+0000 7fb3d4c5d640 1 -- 172.21.15.82:0/215697725 wait complete. 2024-06-02T22:53:37.514 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T22:53:37.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.620+0000 7f8934e7d640 1 Processor -- start 2024-06-02T22:53:37.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.620+0000 7f8934e7d640 1 -- start start 2024-06-02T22:53:37.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.621+0000 7f8934e7d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f89300d11f0 0x7f89300d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.621+0000 7f8934e7d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89300cf9a0 con 0x7f893015e1c0 2024-06-02T22:53:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.621+0000 7f8934e7d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89300cfc70 con 0x7f89300b2f60 2024-06-02T22:53:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.621+0000 7f8934e7d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f89300cff50 con 0x7f89300d11f0 2024-06-02T22:53:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.621+0000 7f892dd9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f89300d11f0 0x7f89300d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.621+0000 7f892e59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f893015e1c0 0x7f89300d0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34898/0 (socket says 172.21.15.82:34898) 2024-06-02T22:53:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.621+0000 7f892dd9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f89300d11f0 0x7f89300d4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55828/0 (socket says 172.21.15.82:55828) 2024-06-02T22:53:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.621+0000 7f892e59c640 1 -- 172.21.15.82:0/4123310398 learned_addr learned my addr 172.21.15.82:0/4123310398 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.622+0000 7f892dd9b640 1 -- 172.21.15.82:0/4123310398 >> v1:172.21.15.184:6789/0 conn(0x7f89300b2f60 legacy=0x7f89300d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.622+0000 7f892dd9b640 1 -- 172.21.15.82:0/4123310398 >> v1:172.21.15.82:6789/0 conn(0x7f893015e1c0 legacy=0x7f89300d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.622+0000 7f892dd9b640 1 -- 172.21.15.82:0/4123310398 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89300d0230 con 0x7f89300d11f0 2024-06-02T22:53:37.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.622+0000 7f892dd9b640 1 --2- 172.21.15.82:0/4123310398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89300d11f0 0x7f89300d4bc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f89240097a0 tx=0x7f892402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897020209adc436a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:37.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.623+0000 7f892d59a640 1 -- 172.21.15.82:0/4123310398 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924037070 con 0x7f89300d11f0 2024-06-02T22:53:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.623+0000 7f892d59a640 1 -- 172.21.15.82:0/4123310398 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8924032440 con 0x7f89300d11f0 2024-06-02T22:53:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.623+0000 7f892d59a640 1 -- 172.21.15.82:0/4123310398 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924032810 con 0x7f89300d11f0 2024-06-02T22:53:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.623+0000 7f8934e7d640 1 -- 172.21.15.82:0/4123310398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89300d11f0 msgr2=0x7f89300d4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.623+0000 7f8934e7d640 1 --2- 172.21.15.82:0/4123310398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89300d11f0 0x7f89300d4bc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f89240097a0 tx=0x7f892402a230 comp rx=0 tx=0).stop 2024-06-02T22:53:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.623+0000 7f8934e7d640 1 -- 172.21.15.82:0/4123310398 shutdown_connections 2024-06-02T22:53:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.623+0000 7f8934e7d640 1 --2- 172.21.15.82:0/4123310398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89300d11f0 0x7f89300d4bc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.623+0000 7f8934e7d640 1 -- 172.21.15.82:0/4123310398 >> 172.21.15.82:0/4123310398 conn(0x7f893009d3e0 msgr2=0x7f89300d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.623+0000 7f8934e7d640 1 -- 172.21.15.82:0/4123310398 shutdown_connections 2024-06-02T22:53:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.623+0000 7f8934e7d640 1 -- 172.21.15.82:0/4123310398 wait complete. 2024-06-02T22:53:37.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.625+0000 7f8934e7d640 1 Processor -- start 2024-06-02T22:53:37.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.625+0000 7f8934e7d640 1 -- start start 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.625+0000 7f8934e7d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89300b2f60 0x7f89300c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.625+0000 7f8934e7d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89300d11f0 0x7f89300c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.625+0000 7f8934e7d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f893015e1c0 0x7f8930158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.625+0000 7f8934e7d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89300b0cd0 con 0x7f89300d11f0 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.625+0000 7f8934e7d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f89300d1d40 con 0x7f893015e1c0 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.625+0000 7f8934e7d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f89300b0e50 con 0x7f89300b2f60 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.625+0000 7f892dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89300d11f0 0x7f89300c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.625+0000 7f892dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89300d11f0 0x7f89300c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55832/0 (socket says 172.21.15.82:55832) 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.625+0000 7f892dd9b640 1 -- 172.21.15.82:0/1077356981 learned_addr learned my addr 172.21.15.82:0/1077356981 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f892ed9d640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f893015e1c0 0x7f8930158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f892e59c640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89300b2f60 0x7f89300c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f892dd9b640 1 -- 172.21.15.82:0/1077356981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89300b2f60 msgr2=0x7f89300c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f892dd9b640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89300b2f60 0x7f89300c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f892dd9b640 1 -- 172.21.15.82:0/1077356981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f893015e1c0 msgr2=0x7f8930158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f892dd9b640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f893015e1c0 0x7f8930158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f892dd9b640 1 -- 172.21.15.82:0/1077356981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89300c81e0 con 0x7f89300d11f0 2024-06-02T22:53:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f892dd9b640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89300d11f0 0x7f89300c9280 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8924035040 tx=0x7f89240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f891effd640 1 -- 172.21.15.82:0/1077356981 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924037040 con 0x7f89300d11f0 2024-06-02T22:53:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f891effd640 1 -- 172.21.15.82:0/1077356981 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8924030770 con 0x7f89300d11f0 2024-06-02T22:53:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f8934e7d640 1 -- 172.21.15.82:0/1077356981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89300c84c0 con 0x7f89300d11f0 2024-06-02T22:53:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f891effd640 1 -- 172.21.15.82:0/1077356981 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924030b40 con 0x7f89300d11f0 2024-06-02T22:53:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.626+0000 7f8934e7d640 1 -- 172.21.15.82:0/1077356981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89300c8d60 con 0x7f89300d11f0 2024-06-02T22:53:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.627+0000 7f8934e7d640 1 -- 172.21.15.82:0/1077356981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89300c88b0 con 0x7f89300d11f0 2024-06-02T22:53:37.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.628+0000 7f891effd640 1 -- 172.21.15.82:0/1077356981 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8924044020 con 0x7f89300d11f0 2024-06-02T22:53:37.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.628+0000 7f891effd640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f891006be30 0x7f891006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:37.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.628+0000 7f891effd640 1 -- 172.21.15.82:0/1077356981 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5619+0+0 (secure 0 0 0) 0x7f89240abda0 con 0x7f89300d11f0 2024-06-02T22:53:37.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.628+0000 7f892e59c640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f891006be30 0x7f891006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:37.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.629+0000 7f892e59c640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f891006be30 0x7f891006e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8920005880 tx=0x7f8920009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:37.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.632+0000 7f891effd640 1 -- 172.21.15.82:0/1077356981 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8924032e20 con 0x7f89300d11f0 2024-06-02T22:53:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:37.806+0000 7f8934e7d640 1 -- 172.21.15.82:0/1077356981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f89300683c0 con 0x7f89300d11f0 2024-06-02T22:53:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.500+0000 7f891effd640 1 -- 172.21.15.82:0/1077356981 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) ==== 170+0+0 (secure 0 0 0) 0x7f892407a880 con 0x7f89300d11f0 2024-06-02T22:53:38.500 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2024-06-02T22:53:38.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.503+0000 7f8934e7d640 1 -- 172.21.15.82:0/1077356981 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f891006be30 msgr2=0x7f891006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.503+0000 7f8934e7d640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f891006be30 0x7f891006e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8920005880 tx=0x7f8920009040 comp rx=0 tx=0).stop 2024-06-02T22:53:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.504+0000 7f8934e7d640 1 -- 172.21.15.82:0/1077356981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89300d11f0 msgr2=0x7f89300c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.504+0000 7f8934e7d640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89300d11f0 0x7f89300c9280 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8924035040 tx=0x7f89240046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.504+0000 7f8934e7d640 1 -- 172.21.15.82:0/1077356981 shutdown_connections 2024-06-02T22:53:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.504+0000 7f8934e7d640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f891006be30 0x7f891006e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.504+0000 7f8934e7d640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f893015e1c0 0x7f8930158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.504+0000 7f8934e7d640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89300d11f0 0x7f89300c9280 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.504+0000 7f8934e7d640 1 --2- 172.21.15.82:0/1077356981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89300b2f60 0x7f89300c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.504+0000 7f8934e7d640 1 -- 172.21.15.82:0/1077356981 >> 172.21.15.82:0/1077356981 conn(0x7f893009d3e0 msgr2=0x7f89300d4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:38.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.508+0000 7f8934e7d640 1 -- 172.21.15.82:0/1077356981 shutdown_connections 2024-06-02T22:53:38.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.509+0000 7f8934e7d640 1 -- 172.21.15.82:0/1077356981 wait complete. 2024-06-02T22:53:38.532 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T22:53:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.638+0000 7f2d47d77640 1 Processor -- start 2024-06-02T22:53:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.638+0000 7f2d47d77640 1 -- start start 2024-06-02T22:53:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.639+0000 7f2d47d77640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d400d0020 0x7f2d400d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.639+0000 7f2d47d77640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d40155700 con 0x7f2d40155320 2024-06-02T22:53:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.639+0000 7f2d47d77640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d4015b6b0 con 0x7f2d4006e1f0 2024-06-02T22:53:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.639+0000 7f2d47d77640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2d400d09c0 con 0x7f2d400d0020 2024-06-02T22:53:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.639+0000 7f2d45312640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d400d0020 0x7f2d400d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.639+0000 7f2d45312640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d400d0020 0x7f2d400d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55834/0 (socket says 172.21.15.82:55834) 2024-06-02T22:53:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.639+0000 7f2d45312640 1 -- 172.21.15.82:0/1085909429 learned_addr learned my addr 172.21.15.82:0/1085909429 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.639+0000 7f2d45b13640 1 --1- 172.21.15.82:0/1085909429 >> v1:172.21.15.82:6789/0 conn(0x7f2d40155320 0x7f2d400b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34914/0 (socket says 172.21.15.82:34914) 2024-06-02T22:53:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.640+0000 7f2d45312640 1 -- 172.21.15.82:0/1085909429 >> v1:172.21.15.184:6789/0 conn(0x7f2d4006e1f0 legacy=0x7f2d4006e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.640+0000 7f2d45312640 1 -- 172.21.15.82:0/1085909429 >> v1:172.21.15.82:6789/0 conn(0x7f2d40155320 legacy=0x7f2d400b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.640+0000 7f2d44b11640 1 -- 172.21.15.82:0/1085909429 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033657579 0 0) 0x7f2d40155700 con 0x7f2d40155320 2024-06-02T22:53:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.640+0000 7f2d45312640 1 -- 172.21.15.82:0/1085909429 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4015b990 con 0x7f2d400d0020 2024-06-02T22:53:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.640+0000 7f2d45312640 1 --2- 172.21.15.82:0/1085909429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d400d0020 0x7f2d400d0480 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000bb10 tx=0x7f2d3002c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d1df54bbf524d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.640+0000 7f2d44b11640 1 -- 172.21.15.82:0/1085909429 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30036020 con 0x7f2d400d0020 2024-06-02T22:53:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.640+0000 7f2d44b11640 1 -- 172.21.15.82:0/1085909429 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d30032820 con 0x7f2d400d0020 2024-06-02T22:53:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.641+0000 7f2d44b11640 1 -- 172.21.15.82:0/1085909429 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30032bf0 con 0x7f2d400d0020 2024-06-02T22:53:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.641+0000 7f2d47d77640 1 -- 172.21.15.82:0/1085909429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d400d0020 msgr2=0x7f2d400d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.641+0000 7f2d47d77640 1 --2- 172.21.15.82:0/1085909429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d400d0020 0x7f2d400d0480 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000bb10 tx=0x7f2d3002c960 comp rx=0 tx=0).stop 2024-06-02T22:53:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.641+0000 7f2d47d77640 1 -- 172.21.15.82:0/1085909429 shutdown_connections 2024-06-02T22:53:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.641+0000 7f2d47d77640 1 --2- 172.21.15.82:0/1085909429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d400d0020 0x7f2d400d0480 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.641+0000 7f2d47d77640 1 -- 172.21.15.82:0/1085909429 >> 172.21.15.82:0/1085909429 conn(0x7f2d400b1d10 msgr2=0x7f2d400b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.641+0000 7f2d47d77640 1 -- 172.21.15.82:0/1085909429 shutdown_connections 2024-06-02T22:53:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.641+0000 7f2d47d77640 1 -- 172.21.15.82:0/1085909429 wait complete. 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.642+0000 7f2d47d77640 1 Processor -- start 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.642+0000 7f2d47d77640 1 -- start start 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d47d77640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d4006e1f0 0x7f2d40153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d47d77640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d400d0020 0x7f2d4009d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d47d77640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d40155320 0x7f2d40072060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d47d77640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4015bf50 con 0x7f2d4006e1f0 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d47d77640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4015b2f0 con 0x7f2d40155320 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d47d77640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2d4015b470 con 0x7f2d400d0020 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d45b13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d4006e1f0 0x7f2d40153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d45b13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d4006e1f0 0x7f2d40153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55844/0 (socket says 172.21.15.82:55844) 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d45b13640 1 -- 172.21.15.82:0/508755069 learned_addr learned my addr 172.21.15.82:0/508755069 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d46314640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d40155320 0x7f2d40072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d45312640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d400d0020 0x7f2d4009d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d45b13640 1 -- 172.21.15.82:0/508755069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d400d0020 msgr2=0x7f2d4009d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d45b13640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d400d0020 0x7f2d4009d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d45b13640 1 -- 172.21.15.82:0/508755069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d40155320 msgr2=0x7f2d40072060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d45b13640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d40155320 0x7f2d40072060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d45b13640 1 -- 172.21.15.82:0/508755069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4015da80 con 0x7f2d4006e1f0 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d46314640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d40155320 0x7f2d40072060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.643+0000 7f2d45312640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d400d0020 0x7f2d4009d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.644+0000 7f2d45b13640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d4006e1f0 0x7f2d40153b50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00c890 tx=0x7f2d3c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.644+0000 7f2d367fc640 1 -- 172.21.15.82:0/508755069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c018070 con 0x7f2d4006e1f0 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.644+0000 7f2d367fc640 1 -- 172.21.15.82:0/508755069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d3c00a5e0 con 0x7f2d4006e1f0 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.644+0000 7f2d47d77640 1 -- 172.21.15.82:0/508755069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d4015dd60 con 0x7f2d4006e1f0 2024-06-02T22:53:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.644+0000 7f2d367fc640 1 -- 172.21.15.82:0/508755069 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c00a9d0 con 0x7f2d4006e1f0 2024-06-02T22:53:38.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.644+0000 7f2d47d77640 1 -- 172.21.15.82:0/508755069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d40156e20 con 0x7f2d4006e1f0 2024-06-02T22:53:38.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.645+0000 7f2d47d77640 1 -- 172.21.15.82:0/508755069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d400683c0 con 0x7f2d4006e1f0 2024-06-02T22:53:38.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.645+0000 7f2d367fc640 1 -- 172.21.15.82:0/508755069 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d3c01b070 con 0x7f2d4006e1f0 2024-06-02T22:53:38.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.646+0000 7f2d367fc640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2d2406be30 0x7f2d2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:38.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.646+0000 7f2d45312640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2d2406be30 0x7f2d2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:38.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.646+0000 7f2d367fc640 1 -- 172.21.15.82:0/508755069 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6001+0+0 (secure 0 0 0) 0x7f2d3c08a580 con 0x7f2d4006e1f0 2024-06-02T22:53:38.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.646+0000 7f2d45312640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2d2406be30 0x7f2d2406e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2d30037000 tx=0x7f2d3003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:38.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.650+0000 7f2d367fc640 1 -- 172.21.15.82:0/508755069 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2d3c058e90 con 0x7f2d4006e1f0 2024-06-02T22:53:38.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:38.860+0000 7f2d47d77640 1 -- 172.21.15.82:0/508755069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2d40068ca0 con 0x7f2d4006e1f0 2024-06-02T22:53:39.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.512+0000 7f2d367fc640 1 -- 172.21.15.82:0/508755069 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v21) ==== 172+0+0 (secure 0 0 0) 0x7f2d3c058790 con 0x7f2d4006e1f0 2024-06-02T22:53:39.512 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 8 and data pool 9 2024-06-02T22:53:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 -- 172.21.15.82:0/508755069 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2d2406be30 msgr2=0x7f2d2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2d2406be30 0x7f2d2406e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2d30037000 tx=0x7f2d3003d040 comp rx=0 tx=0).stop 2024-06-02T22:53:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 -- 172.21.15.82:0/508755069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d4006e1f0 msgr2=0x7f2d40153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d4006e1f0 0x7f2d40153b50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00c890 tx=0x7f2d3c00cd50 comp rx=0 tx=0).stop 2024-06-02T22:53:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 -- 172.21.15.82:0/508755069 shutdown_connections 2024-06-02T22:53:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2d2406be30 0x7f2d2406e2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d40155320 0x7f2d40072060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d400d0020 0x7f2d4009d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 --2- 172.21.15.82:0/508755069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d4006e1f0 0x7f2d40153b50 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 -- 172.21.15.82:0/508755069 >> 172.21.15.82:0/508755069 conn(0x7f2d400b1d10 msgr2=0x7f2d400b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 -- 172.21.15.82:0/508755069 shutdown_connections 2024-06-02T22:53:39.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.515+0000 7f2d47d77640 1 -- 172.21.15.82:0/508755069 wait complete. 2024-06-02T22:53:39.530 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:53:39.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.630+0000 7f97e4377640 1 Processor -- start 2024-06-02T22:53:39.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.630+0000 7f97e4377640 1 -- start start 2024-06-02T22:53:39.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.631+0000 7f97e4377640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc06ebf0 0x7f97dc0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.631+0000 7f97e4377640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f97dc0cf190 0x7f97dc0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.631+0000 7f97e4377640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97dc0cf640 con 0x7f97dc0ae910 2024-06-02T22:53:39.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.631+0000 7f97e4377640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f97dc06d130 con 0x7f97dc0cf190 2024-06-02T22:53:39.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.631+0000 7f97e4377640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f97dc06d410 con 0x7f97dc06ebf0 2024-06-02T22:53:39.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.632+0000 7f97e2914640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f97dc0cf190 0x7f97dc0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:39.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.632+0000 7f97e1912640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc06ebf0 0x7f97dc0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:39.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.632+0000 7f97e2113640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f97dc0ae910 0x7f97dc06e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:36848/0 (socket says 172.21.15.82:36848) 2024-06-02T22:53:39.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.632+0000 7f97e2914640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f97dc0cf190 0x7f97dc0acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:59644/0 (socket says 172.21.15.82:59644) 2024-06-02T22:53:39.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.632+0000 7f97e2113640 1 -- 172.21.15.82:0/2247465364 learned_addr learned my addr 172.21.15.82:0/2247465364 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:39.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.632+0000 7f97e2914640 1 -- 172.21.15.82:0/2247465364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc06ebf0 msgr2=0x7f97dc0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:39.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.632+0000 7f97e2914640 1 --2- 172.21.15.82:0/2247465364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc06ebf0 0x7f97dc0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.632+0000 7f97e2914640 1 -- 172.21.15.82:0/2247465364 >> v1:172.21.15.184:6789/0 conn(0x7f97dc0ae910 legacy=0x7f97dc06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:39.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.632+0000 7f97e1111640 1 -- 172.21.15.82:0/2247465364 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964326208 0 0) 0x7f97dc0cf640 con 0x7f97dc0ae910 2024-06-02T22:53:39.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.632+0000 7f97e2914640 1 -- 172.21.15.82:0/2247465364 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc06d6f0 con 0x7f97dc0cf190 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.632+0000 7f97e1912640 1 --2- 172.21.15.82:0/2247465364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc06ebf0 0x7f97dc0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.633+0000 7f97e2914640 1 --2- 172.21.15.82:0/2247465364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc0cf190 0x7f97dc0acd40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f97d40097d0 tx=0x7f97d402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8479ee2cb021f1cb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.633+0000 7f97e1111640 1 -- 172.21.15.82:0/2247465364 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4037070 con 0x7f97dc0cf190 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.633+0000 7f97e1111640 1 -- 172.21.15.82:0/2247465364 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d402ae40 con 0x7f97dc0cf190 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.633+0000 7f97e1111640 1 -- 172.21.15.82:0/2247465364 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4032660 con 0x7f97dc0cf190 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.633+0000 7f97e4377640 1 -- 172.21.15.82:0/2247465364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc0cf190 msgr2=0x7f97dc0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.633+0000 7f97e4377640 1 --2- 172.21.15.82:0/2247465364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc0cf190 0x7f97dc0acd40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f97d40097d0 tx=0x7f97d402a130 comp rx=0 tx=0).stop 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.634+0000 7f97e4377640 1 -- 172.21.15.82:0/2247465364 shutdown_connections 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.634+0000 7f97e4377640 1 --2- 172.21.15.82:0/2247465364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc0cf190 0x7f97dc0acd40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.634+0000 7f97e4377640 1 --2- 172.21.15.82:0/2247465364 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc06ebf0 0x7f97dc0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.634+0000 7f97e4377640 1 -- 172.21.15.82:0/2247465364 >> 172.21.15.82:0/2247465364 conn(0x7f97dc0b19f0 msgr2=0x7f97dc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.634+0000 7f97e4377640 1 -- 172.21.15.82:0/2247465364 shutdown_connections 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.634+0000 7f97e4377640 1 -- 172.21.15.82:0/2247465364 wait complete. 2024-06-02T22:53:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.635+0000 7f97e4377640 1 Processor -- start 2024-06-02T22:53:39.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.635+0000 7f97e4377640 1 -- start start 2024-06-02T22:53:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.635+0000 7f97e4377640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc06ebf0 0x7f97dc151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.635+0000 7f97e4377640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc0ae910 0x7f97dc1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.635+0000 7f97e4377640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc0cf190 0x7f97dc0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.635+0000 7f97e4377640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc0ad280 con 0x7f97dc0ae910 2024-06-02T22:53:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.635+0000 7f97e4377640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc0aecf0 con 0x7f97dc06ebf0 2024-06-02T22:53:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.635+0000 7f97e4377640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f97dc0ad400 con 0x7f97dc0cf190 2024-06-02T22:53:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e1912640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc0ae910 0x7f97dc1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e2113640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc06ebf0 0x7f97dc151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e1912640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc0ae910 0x7f97dc1569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55860/0 (socket says 172.21.15.82:55860) 2024-06-02T22:53:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e1912640 1 -- 172.21.15.82:0/920077889 learned_addr learned my addr 172.21.15.82:0/920077889 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e2914640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc0cf190 0x7f97dc0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e2113640 1 -- 172.21.15.82:0/920077889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc0cf190 msgr2=0x7f97dc0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e2113640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc0cf190 0x7f97dc0cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e2113640 1 -- 172.21.15.82:0/920077889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc0ae910 msgr2=0x7f97dc1569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e2113640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc0ae910 0x7f97dc1569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e2113640 1 -- 172.21.15.82:0/920077889 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc157a90 con 0x7f97dc06ebf0 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e2914640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc0cf190 0x7f97dc0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e1912640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc0ae910 0x7f97dc1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e2113640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc06ebf0 0x7f97dc151990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f97d8002230 tx=0x7f97d800cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97d2ffd640 1 -- 172.21.15.82:0/920077889 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8018070 con 0x7f97dc06ebf0 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97d2ffd640 1 -- 172.21.15.82:0/920077889 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d800a640 con 0x7f97dc06ebf0 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e4377640 1 -- 172.21.15.82:0/920077889 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97dc157d70 con 0x7f97dc06ebf0 2024-06-02T22:53:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97d2ffd640 1 -- 172.21.15.82:0/920077889 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d800aa30 con 0x7f97dc06ebf0 2024-06-02T22:53:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.636+0000 7f97e4377640 1 -- 172.21.15.82:0/920077889 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97dc158330 con 0x7f97dc06ebf0 2024-06-02T22:53:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.637+0000 7f97e4377640 1 -- 172.21.15.82:0/920077889 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97dc155980 con 0x7f97dc06ebf0 2024-06-02T22:53:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.638+0000 7f97d2ffd640 1 -- 172.21.15.82:0/920077889 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97d801b070 con 0x7f97dc06ebf0 2024-06-02T22:53:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.638+0000 7f97d2ffd640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f97c006be60 0x7f97c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.639+0000 7f97d2ffd640 1 -- 172.21.15.82:0/920077889 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f97d808ac20 con 0x7f97dc06ebf0 2024-06-02T22:53:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.639+0000 7f97e1912640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f97c006be60 0x7f97c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.639+0000 7f97e1912640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f97c006be60 0x7f97c006e320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f97dc158ad0 tx=0x7f97cc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.643+0000 7f97d2ffd640 1 -- 172.21.15.82:0/920077889 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f97dc155980 con 0x7f97dc06ebf0 2024-06-02T22:53:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.820+0000 7f97e4377640 1 -- 172.21.15.82:0/920077889 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97dc0b06d0 con 0x7f97dc06ebf0 2024-06-02T22:53:39.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.822+0000 7f97d2ffd640 1 -- 172.21.15.82:0/920077889 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16951 (secure 0 0 0) 0x7f97d8058dd0 con 0x7f97dc06ebf0 2024-06-02T22:53:39.822 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:39.822 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":53,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:53:38.862053+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:53:37.205775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-06-02T22:53:37.825433+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:53:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 -- 172.21.15.82:0/920077889 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f97c006be60 msgr2=0x7f97c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f97c006be60 0x7f97c006e320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f97dc158ad0 tx=0x7f97cc009190 comp rx=0 tx=0).stop 2024-06-02T22:53:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 -- 172.21.15.82:0/920077889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc06ebf0 msgr2=0x7f97dc151990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc06ebf0 0x7f97dc151990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f97d8002230 tx=0x7f97d800cc50 comp rx=0 tx=0).stop 2024-06-02T22:53:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 -- 172.21.15.82:0/920077889 shutdown_connections 2024-06-02T22:53:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f97c006be60 0x7f97c006e320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97dc0cf190 0x7f97dc0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc0ae910 0x7f97dc1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 --2- 172.21.15.82:0/920077889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97dc06ebf0 0x7f97dc151990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 -- 172.21.15.82:0/920077889 >> 172.21.15.82:0/920077889 conn(0x7f97dc0b19f0 msgr2=0x7f97dc0722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 -- 172.21.15.82:0/920077889 shutdown_connections 2024-06-02T22:53:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.824+0000 7f97e4377640 1 -- 172.21.15.82:0/920077889 wait complete. 2024-06-02T22:53:39.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:53:39.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.936+0000 7f515bd1d640 1 Processor -- start 2024-06-02T22:53:39.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.936+0000 7f515bd1d640 1 -- start start 2024-06-02T22:53:39.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f515bd1d640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5154156830 0x7f5154071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f515bd1d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5154072130 0x7f51540cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f515bd1d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51540725f0 con 0x7f515415c7f0 2024-06-02T22:53:39.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f515bd1d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f51540b3090 con 0x7f5154072130 2024-06-02T22:53:39.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f515bd1d640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f51540728d0 con 0x7f5154156830 2024-06-02T22:53:39.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f51592b8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5154072130 0x7f51540cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:39.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f51592b8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5154072130 0x7f51540cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55874/0 (socket says 172.21.15.82:55874) 2024-06-02T22:53:39.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f51592b8640 1 -- 172.21.15.82:0/3161580763 learned_addr learned my addr 172.21.15.82:0/3161580763 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:39.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f51592b8640 1 -- 172.21.15.82:0/3161580763 >> v2:172.21.15.184:3300/0 conn(0x7f5154156830 msgr2=0x7f5154071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:39.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f51592b8640 1 --2- 172.21.15.82:0/3161580763 >> v2:172.21.15.184:3300/0 conn(0x7f5154156830 0x7f5154071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f51592b8640 1 -- 172.21.15.82:0/3161580763 >> v1:172.21.15.184:6789/0 conn(0x7f515415c7f0 legacy=0x7f51540b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:39.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.937+0000 7f51592b8640 1 -- 172.21.15.82:0/3161580763 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5154072bb0 con 0x7f5154072130 2024-06-02T22:53:39.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.938+0000 7f51592b8640 1 --2- 172.21.15.82:0/3161580763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154072130 0x7f51540cc670 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5154070cb0 tx=0x7f515002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecdcf6b38a46603 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:39.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.938+0000 7f5158ab7640 1 -- 172.21.15.82:0/3161580763 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150037070 con 0x7f5154072130 2024-06-02T22:53:39.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.938+0000 7f5158ab7640 1 -- 172.21.15.82:0/3161580763 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5150032440 con 0x7f5154072130 2024-06-02T22:53:39.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.938+0000 7f5158ab7640 1 -- 172.21.15.82:0/3161580763 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150032810 con 0x7f5154072130 2024-06-02T22:53:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.938+0000 7f515bd1d640 1 -- 172.21.15.82:0/3161580763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154072130 msgr2=0x7f51540cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.938+0000 7f515bd1d640 1 --2- 172.21.15.82:0/3161580763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154072130 0x7f51540cc670 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5154070cb0 tx=0x7f515002a230 comp rx=0 tx=0).stop 2024-06-02T22:53:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.938+0000 7f515bd1d640 1 -- 172.21.15.82:0/3161580763 shutdown_connections 2024-06-02T22:53:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.938+0000 7f515bd1d640 1 --2- 172.21.15.82:0/3161580763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5154072130 0x7f51540cc670 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.938+0000 7f515bd1d640 1 --2- 172.21.15.82:0/3161580763 >> v2:172.21.15.184:3300/0 conn(0x7f5154156830 0x7f5154071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.938+0000 7f515bd1d640 1 -- 172.21.15.82:0/3161580763 >> 172.21.15.82:0/3161580763 conn(0x7f51540b19f0 msgr2=0x7f51540b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.939+0000 7f515bd1d640 1 -- 172.21.15.82:0/3161580763 shutdown_connections 2024-06-02T22:53:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.939+0000 7f515bd1d640 1 -- 172.21.15.82:0/3161580763 wait complete. 2024-06-02T22:53:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.940+0000 7f515bd1d640 1 Processor -- start 2024-06-02T22:53:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.940+0000 7f515bd1d640 1 -- start start 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.940+0000 7f515bd1d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5154072130 0x7f51541f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.940+0000 7f515bd1d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5154156830 0x7f515415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.940+0000 7f515bd1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f515415c7f0 0x7f515409aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.940+0000 7f515bd1d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51540ccd30 con 0x7f515415c7f0 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.940+0000 7f515bd1d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f51540ccbb0 con 0x7f5154072130 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.940+0000 7f515bd1d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f51540cceb0 con 0x7f5154156830 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.940+0000 7f515a2ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f515415c7f0 0x7f515409aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f515a2ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f515415c7f0 0x7f515409aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55886/0 (socket says 172.21.15.82:55886) 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f515a2ba640 1 -- 172.21.15.82:0/1681472683 learned_addr learned my addr 172.21.15.82:0/1681472683 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f5159ab9640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5154072130 0x7f51541f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f51592b8640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5154156830 0x7f515415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f515a2ba640 1 -- 172.21.15.82:0/1681472683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5154156830 msgr2=0x7f515415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f515a2ba640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5154156830 0x7f515415dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f515a2ba640 1 -- 172.21.15.82:0/1681472683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5154072130 msgr2=0x7f51541f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f515a2ba640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5154072130 0x7f51541f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f515a2ba640 1 -- 172.21.15.82:0/1681472683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51541f4f80 con 0x7f515415c7f0 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f515a2ba640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f515415c7f0 0x7f515409aa10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f514c00b990 tx=0x7f514c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f51467fc640 1 -- 172.21.15.82:0/1681472683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c019070 con 0x7f515415c7f0 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f51467fc640 1 -- 172.21.15.82:0/1681472683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514c00cba0 con 0x7f515415c7f0 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f515bd1d640 1 -- 172.21.15.82:0/1681472683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515406d430 con 0x7f515415c7f0 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f51467fc640 1 -- 172.21.15.82:0/1681472683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c014440 con 0x7f515415c7f0 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.941+0000 7f515bd1d640 1 -- 172.21.15.82:0/1681472683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f515406d9f0 con 0x7f515415c7f0 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.942+0000 7f515bd1d640 1 -- 172.21.15.82:0/1681472683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5154068430 con 0x7f515415c7f0 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.942+0000 7f51467fc640 1 -- 172.21.15.82:0/1681472683 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f514c01c070 con 0x7f515415c7f0 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.943+0000 7f51467fc640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f513806be30 0x7f513806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.943+0000 7f5159ab9640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f513806be30 0x7f513806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:39.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.943+0000 7f51467fc640 1 -- 172.21.15.82:0/1681472683 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f514c08ad90 con 0x7f515415c7f0 2024-06-02T22:53:39.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.943+0000 7f5159ab9640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f513806be30 0x7f513806e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f515415eb00 tx=0x7f5148008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:39.948+0000 7f51467fc640 1 -- 172.21.15.82:0/1681472683 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f51541f4f80 con 0x7f515415c7f0 2024-06-02T22:53:40.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.120+0000 7f515bd1d640 1 -- 172.21.15.82:0/1681472683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5154075430 con 0x7f515415c7f0 2024-06-02T22:53:40.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.121+0000 7f51467fc640 1 -- 172.21.15.82:0/1681472683 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16951 (secure 0 0 0) 0x7f514c0595b0 con 0x7f515415c7f0 2024-06-02T22:53:40.121 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:40.122 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":53,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:53:38.862053+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:53:37.205775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-06-02T22:53:37.825433+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:53:40.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 -- 172.21.15.82:0/1681472683 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f513806be30 msgr2=0x7f513806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f513806be30 0x7f513806e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f515415eb00 tx=0x7f5148008040 comp rx=0 tx=0).stop 2024-06-02T22:53:40.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 -- 172.21.15.82:0/1681472683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f515415c7f0 msgr2=0x7f515409aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f515415c7f0 0x7f515409aa10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f514c00b990 tx=0x7f514c00be50 comp rx=0 tx=0).stop 2024-06-02T22:53:40.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 -- 172.21.15.82:0/1681472683 shutdown_connections 2024-06-02T22:53:40.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f513806be30 0x7f513806e2f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f515415c7f0 0x7f515409aa10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5154156830 0x7f515415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 --2- 172.21.15.82:0/1681472683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5154072130 0x7f51541f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 -- 172.21.15.82:0/1681472683 >> 172.21.15.82:0/1681472683 conn(0x7f51540b19f0 msgr2=0x7f51540b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:40.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 -- 172.21.15.82:0/1681472683 shutdown_connections 2024-06-02T22:53:40.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.123+0000 7f515bd1d640 1 -- 172.21.15.82:0/1681472683 wait complete. 2024-06-02T22:53:40.134 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-02T22:53:40.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.238+0000 7fb308e72640 1 Processor -- start 2024-06-02T22:53:40.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.238+0000 7fb308e72640 1 -- start start 2024-06-02T22:53:40.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb308e72640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3040b3b40 0x7fb3040b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb308e72640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3040d0730 0x7fb3040b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb308e72640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30415c870 con 0x7fb3040b48e0 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb308e72640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb30415cb50 con 0x7fb3040d0730 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb308e72640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb30415ce30 con 0x7fb3040b3b40 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb302d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3040d0730 0x7fb3040b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb2f9d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb3040b48e0 0x7fb3040d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34916/0 (socket says 172.21.15.82:34916) 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb2f9d9b640 1 -- 172.21.15.82:0/702992893 learned_addr learned my addr 172.21.15.82:0/702992893 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb302d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3040d0730 0x7fb3040b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55890/0 (socket says 172.21.15.82:55890) 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb302d9d640 1 -- 172.21.15.82:0/702992893 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3040b3b40 msgr2=0x7fb3040b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb302d9d640 1 --2- 172.21.15.82:0/702992893 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3040b3b40 0x7fb3040b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb302d9d640 1 -- 172.21.15.82:0/702992893 >> v1:172.21.15.82:6789/0 conn(0x7fb3040b48e0 legacy=0x7fb3040d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb302d9d640 1 -- 172.21.15.82:0/702992893 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30415d110 con 0x7fb3040d0730 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.239+0000 7fb301d9b640 1 -- 172.21.15.82:0/702992893 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4035144575 0 0) 0x7fb30415c870 con 0x7fb3040b48e0 2024-06-02T22:53:40.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.240+0000 7fb302d9d640 1 --2- 172.21.15.82:0/702992893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3040d0730 0x7fb3040b4d40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009d90 tx=0x7fb2fc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f72816d0f558899 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:40.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.240+0000 7fb301d9b640 1 -- 172.21.15.82:0/702992893 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc007740 con 0x7fb3040d0730 2024-06-02T22:53:40.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.240+0000 7fb301d9b640 1 -- 172.21.15.82:0/702992893 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0078e0 con 0x7fb3040d0730 2024-06-02T22:53:40.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.240+0000 7fb301d9b640 1 -- 172.21.15.82:0/702992893 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc007cb0 con 0x7fb3040d0730 2024-06-02T22:53:40.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.241+0000 7fb308e72640 1 -- 172.21.15.82:0/702992893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3040d0730 msgr2=0x7fb3040b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.241+0000 7fb308e72640 1 --2- 172.21.15.82:0/702992893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3040d0730 0x7fb3040b4d40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009d90 tx=0x7fb2fc02a660 comp rx=0 tx=0).stop 2024-06-02T22:53:40.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.241+0000 7fb308e72640 1 -- 172.21.15.82:0/702992893 shutdown_connections 2024-06-02T22:53:40.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.241+0000 7fb308e72640 1 --2- 172.21.15.82:0/702992893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3040d0730 0x7fb3040b4d40 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.241+0000 7fb308e72640 1 --2- 172.21.15.82:0/702992893 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3040b3b40 0x7fb3040b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.241+0000 7fb308e72640 1 -- 172.21.15.82:0/702992893 >> 172.21.15.82:0/702992893 conn(0x7fb3040b1d10 msgr2=0x7fb3040b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:40.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.241+0000 7fb308e72640 1 -- 172.21.15.82:0/702992893 shutdown_connections 2024-06-02T22:53:40.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.241+0000 7fb308e72640 1 -- 172.21.15.82:0/702992893 wait complete. 2024-06-02T22:53:40.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.242+0000 7fb308e72640 1 Processor -- start 2024-06-02T22:53:40.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.242+0000 7fb308e72640 1 -- start start 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb308e72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3040b3b40 0x7fb30406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb308e72640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3040b48e0 0x7fb30414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb308e72640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3040d0730 0x7fb30414ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb308e72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb30415c490 con 0x7fb3040b3b40 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb308e72640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb3040b3f20 con 0x7fb3040d0730 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb308e72640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb30415c610 con 0x7fb3040b48e0 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb30259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3040b3b40 0x7fb30406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb30259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3040b3b40 0x7fb30406d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55900/0 (socket says 172.21.15.82:55900) 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb30259c640 1 -- 172.21.15.82:0/3994384660 learned_addr learned my addr 172.21.15.82:0/3994384660 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb30259c640 1 -- 172.21.15.82:0/3994384660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3040b48e0 msgr2=0x7fb30414b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb30259c640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3040b48e0 0x7fb30414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb30259c640 1 -- 172.21.15.82:0/3994384660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3040d0730 msgr2=0x7fb30414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb302d9d640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3040d0730 0x7fb30414ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb30259c640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3040d0730 0x7fb30414ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.243+0000 7fb30259c640 1 -- 172.21.15.82:0/3994384660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3041e3480 con 0x7fb3040b3b40 2024-06-02T22:53:40.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.244+0000 7fb30259c640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3040b3b40 0x7fb30406d2e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400b410 tx=0x7fb2f400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:40.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.244+0000 7fb2fb7fe640 1 -- 172.21.15.82:0/3994384660 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4015020 con 0x7fb3040b3b40 2024-06-02T22:53:40.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.244+0000 7fb2fb7fe640 1 -- 172.21.15.82:0/3994384660 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f4011850 con 0x7fb3040b3b40 2024-06-02T22:53:40.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.244+0000 7fb308e72640 1 -- 172.21.15.82:0/3994384660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3041e3760 con 0x7fb3040b3b40 2024-06-02T22:53:40.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.244+0000 7fb2fb7fe640 1 -- 172.21.15.82:0/3994384660 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4011c40 con 0x7fb3040b3b40 2024-06-02T22:53:40.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.244+0000 7fb308e72640 1 -- 172.21.15.82:0/3994384660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3041e3d20 con 0x7fb3040b3b40 2024-06-02T22:53:40.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.245+0000 7fb308e72640 1 -- 172.21.15.82:0/3994384660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3040683c0 con 0x7fb3040b3b40 2024-06-02T22:53:40.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.245+0000 7fb2fb7fe640 1 -- 172.21.15.82:0/3994384660 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2f4018020 con 0x7fb3040b3b40 2024-06-02T22:53:40.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.246+0000 7fb2fb7fe640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2e406be30 0x7fb2e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.246+0000 7fb2fb7fe640 1 -- 172.21.15.82:0/3994384660 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fb2f408af90 con 0x7fb3040b3b40 2024-06-02T22:53:40.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.246+0000 7fb2f9d9b640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2e406be30 0x7fb2e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.246+0000 7fb2f9d9b640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2e406be30 0x7fb2e406e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec007fd0 tx=0x7fb2ec007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:40.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.250+0000 7fb2fb7fe640 1 -- 172.21.15.82:0/3994384660 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb2f401f020 con 0x7fb3040b3b40 2024-06-02T22:53:40.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.462+0000 7fb308e72640 1 -- 172.21.15.82:0/3994384660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb304159960 con 0x7fb3040b3b40 2024-06-02T22:53:40.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.517+0000 7fb2fb7fe640 1 -- 172.21.15.82:0/3994384660 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) ==== 118+0+0 (secure 0 0 0) 0x7fb2f40172c0 con 0x7fb3040b3b40 2024-06-02T22:53:40.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 -- 172.21.15.82:0/3994384660 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2e406be30 msgr2=0x7fb2e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2e406be30 0x7fb2e406e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec007fd0 tx=0x7fb2ec007920 comp rx=0 tx=0).stop 2024-06-02T22:53:40.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 -- 172.21.15.82:0/3994384660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3040b3b40 msgr2=0x7fb30406d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3040b3b40 0x7fb30406d2e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400b410 tx=0x7fb2f400b8d0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 -- 172.21.15.82:0/3994384660 shutdown_connections 2024-06-02T22:53:40.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb2e406be30 0x7fb2e406e2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3040d0730 0x7fb30414ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3040b48e0 0x7fb30414b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 --2- 172.21.15.82:0/3994384660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3040b3b40 0x7fb30406d2e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 -- 172.21.15.82:0/3994384660 >> 172.21.15.82:0/3994384660 conn(0x7fb3040b1d10 msgr2=0x7fb3040b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:40.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 -- 172.21.15.82:0/3994384660 shutdown_connections 2024-06-02T22:53:40.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.520+0000 7fb308e72640 1 -- 172.21.15.82:0/3994384660 wait complete. 2024-06-02T22:53:40.530 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-02T22:53:40.531 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-02T22:53:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.633+0000 7f25b1431640 1 Processor -- start 2024-06-02T22:53:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.633+0000 7f25b1431640 1 -- start start 2024-06-02T22:53:40.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.634+0000 7f25b1431640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f25ac06cee0 0x7f25ac06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.634+0000 7f25b1431640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac0703e0 0x7f25ac0d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.634+0000 7f25b1431640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25ac070890 con 0x7f25ac15e650 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.634+0000 7f25b1431640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f25ac0cfd40 con 0x7f25ac06cee0 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.634+0000 7f25b1431640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f25ac070b50 con 0x7f25ac0703e0 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.634+0000 7f25aa7fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f25ac15e650 0x7f25ac06d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:34932/0 (socket says 172.21.15.82:34932) 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.634+0000 7f25aa7fc640 1 -- 172.21.15.82:0/3736376249 learned_addr learned my addr 172.21.15.82:0/3736376249 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.634+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 948148136 0 0) 0x7f25ac070890 con 0x7f25ac15e650 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.634+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2594003520 con 0x7f25ac15e650 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25ab7fe640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac0703e0 0x7f25ac0d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1578559335 0 0) 0x7f2594003520 con 0x7f25ac15e650 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac0703e0 msgr2=0x7f25ac0d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac0703e0 0x7f25ac0d0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 >> v2:172.21.15.184:3300/0 conn(0x7f25ac06cee0 msgr2=0x7f25ac06c6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 --2- 172.21.15.82:0/3736376249 >> v2:172.21.15.184:3300/0 conn(0x7f25ac06cee0 0x7f25ac06c6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ac0cff90 con 0x7f25ac15e650 2024-06-02T22:53:40.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f25a0001670 con 0x7f25ac15e650 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25ab7fe640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac0703e0 0x7f25ac0d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 >> v1:172.21.15.82:6789/0 conn(0x7f25ac15e650 legacy=0x7f25ac06d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25940039b0 0x7f2594003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 0x7f2594004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac0703e0 0x7f25940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac0cfd40 con 0x7f2594004800 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac070b50 con 0x7f25940039b0 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f259400bb50 con 0x7f25ac0703e0 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25aa7fc640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 0x7f2594004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25ab7fe640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac0703e0 0x7f25940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25aa7fc640 1 -- 172.21.15.82:0/3736376249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac0703e0 msgr2=0x7f25940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25aa7fc640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac0703e0 0x7f25940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25aa7fc640 1 -- 172.21.15.82:0/3736376249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25940039b0 msgr2=0x7f2594003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25aa7fc640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25940039b0 0x7f2594003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.635+0000 7f25aa7fc640 1 -- 172.21.15.82:0/3736376249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2594003520 con 0x7f2594004800 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.636+0000 7f25aa7fc640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 0x7f2594004c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c210 tx=0x7f2594005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e71743c9b5f6d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.636+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a0007d70 con 0x7f2594004800 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.636+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a0005ad0 con 0x7f2594004800 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.636+0000 7f25a9ffb640 1 -- 172.21.15.82:0/3736376249 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a0007070 con 0x7f2594004800 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.636+0000 7f25b1431640 1 -- 172.21.15.82:0/3736376249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 msgr2=0x7f2594004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.636+0000 7f25b1431640 1 --2- 172.21.15.82:0/3736376249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 0x7f2594004c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c210 tx=0x7f2594005830 comp rx=0 tx=0).stop 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.636+0000 7f25ab7fe640 1 -- 172.21.15.82:0/3736376249 reap_dead start 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.636+0000 7f25b1431640 1 -- 172.21.15.82:0/3736376249 shutdown_connections 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.637+0000 7f25b1431640 1 -- 172.21.15.82:0/3736376249 >> 172.21.15.82:0/3736376249 conn(0x7f25ac0b3970 msgr2=0x7f25ac0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.637+0000 7f25b1431640 1 -- 172.21.15.82:0/3736376249 shutdown_connections 2024-06-02T22:53:40.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.637+0000 7f25b1431640 1 -- 172.21.15.82:0/3736376249 wait complete. 2024-06-02T22:53:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.638+0000 7f25b1431640 1 Processor -- start 2024-06-02T22:53:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.638+0000 7f25b1431640 1 -- start start 2024-06-02T22:53:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.638+0000 7f25b1431640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 0x7f25ac0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.638+0000 7f25b1431640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac1504c0 0x7f25ac0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.638+0000 7f25b1431640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25ac1608c0 0x7f25ac160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.638+0000 7f25b1431640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac0d0a70 con 0x7f2594004800 2024-06-02T22:53:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.638+0000 7f25b1431640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac0d0550 con 0x7f25ac1608c0 2024-06-02T22:53:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.638+0000 7f25b1431640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f25ac0d0bf0 con 0x7f25ac1504c0 2024-06-02T22:53:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 0x7f25ac0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 0x7f25ac0b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55928/0 (socket says 172.21.15.82:55928) 2024-06-02T22:53:40.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25aaffd640 1 -- 172.21.15.82:0/2958866422 learned_addr learned my addr 172.21.15.82:0/2958866422 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25aaffd640 1 -- 172.21.15.82:0/2958866422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac1504c0 msgr2=0x7f25ac0b30d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25aaffd640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac1504c0 0x7f25ac0b30d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25aaffd640 1 -- 172.21.15.82:0/2958866422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25ac1608c0 msgr2=0x7f25ac160d70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25aaffd640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25ac1608c0 0x7f25ac160d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25aaffd640 1 -- 172.21.15.82:0/2958866422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ac161640 con 0x7f2594004800 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25aaffd640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 0x7f25ac0b2b90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f259c00b9c0 tx=0x7f259c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25937fe640 1 -- 172.21.15.82:0/2958866422 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c019070 con 0x7f2594004800 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25937fe640 1 -- 172.21.15.82:0/2958866422 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c00cba0 con 0x7f2594004800 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25937fe640 1 -- 172.21.15.82:0/2958866422 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c014440 con 0x7f2594004800 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25b1431640 1 -- 172.21.15.82:0/2958866422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ac0c5b10 con 0x7f2594004800 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.639+0000 7f25b1431640 1 -- 172.21.15.82:0/2958866422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ac1612b0 con 0x7f2594004800 2024-06-02T22:53:40.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.640+0000 7f25b1431640 1 -- 172.21.15.82:0/2958866422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25ac0683c0 con 0x7f2594004800 2024-06-02T22:53:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.641+0000 7f25937fe640 1 -- 172.21.15.82:0/2958866422 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f259c003a10 con 0x7f2594004800 2024-06-02T22:53:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.641+0000 7f25937fe640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f259806be60 0x7f259806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.641+0000 7f25937fe640 1 -- 172.21.15.82:0/2958866422 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f259c08abf0 con 0x7f2594004800 2024-06-02T22:53:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.641+0000 7f25aa7fc640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f259806be60 0x7f259806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.642+0000 7f25aa7fc640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f259806be60 0x7f259806e320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f25a0033000 tx=0x7f25a0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.645+0000 7f25937fe640 1 -- 172.21.15.82:0/2958866422 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f259c059410 con 0x7f2594004800 2024-06-02T22:53:40.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:40.856+0000 7f25b1431640 1 -- 172.21.15.82:0/2958866422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f25ac154500 con 0x7f2594004800 2024-06-02T22:53:41.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.518+0000 7f25937fe640 1 -- 172.21.15.82:0/2958866422 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) ==== 122+0+0 (secure 0 0 0) 0x7f259c058d10 con 0x7f2594004800 2024-06-02T22:53:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 -- 172.21.15.82:0/2958866422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f259806be60 msgr2=0x7f259806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f259806be60 0x7f259806e320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f25a0033000 tx=0x7f25a0009030 comp rx=0 tx=0).stop 2024-06-02T22:53:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 -- 172.21.15.82:0/2958866422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 msgr2=0x7f25ac0b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 0x7f25ac0b2b90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f259c00b9c0 tx=0x7f259c00be80 comp rx=0 tx=0).stop 2024-06-02T22:53:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 -- 172.21.15.82:0/2958866422 shutdown_connections 2024-06-02T22:53:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f259806be60 0x7f259806e320 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25ac1608c0 0x7f25ac160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25ac1504c0 0x7f25ac0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 --2- 172.21.15.82:0/2958866422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2594004800 0x7f25ac0b2b90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 -- 172.21.15.82:0/2958866422 >> 172.21.15.82:0/2958866422 conn(0x7f25ac0b3970 msgr2=0x7f25ac15c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 -- 172.21.15.82:0/2958866422 shutdown_connections 2024-06-02T22:53:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.521+0000 7f25b1431640 1 -- 172.21.15.82:0/2958866422 wait complete. 2024-06-02T22:53:41.534 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-02T22:53:41.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:53:41.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.638+0000 7f6b86212640 1 Processor -- start 2024-06-02T22:53:41.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.638+0000 7f6b86212640 1 -- start start 2024-06-02T22:53:41.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.639+0000 7f6b86212640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6b8006ebf0 0x7f6b800cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.639+0000 7f6b86212640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b800cf190 0x7f6b800acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.639+0000 7f6b86212640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b800cf600 con 0x7f6b800ae910 2024-06-02T22:53:41.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.639+0000 7f6b86212640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f6b8006d130 con 0x7f6b800cf190 2024-06-02T22:53:41.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.639+0000 7f6b86212640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f6b8006d410 con 0x7f6b8006ebf0 2024-06-02T22:53:41.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.639+0000 7f6b7ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b800cf190 0x7f6b800acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.639+0000 7f6b7ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b800cf190 0x7f6b800acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40698/0 (socket says 172.21.15.82:40698) 2024-06-02T22:53:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.639+0000 7f6b7ffff640 1 -- 172.21.15.82:0/2249773544 learned_addr learned my addr 172.21.15.82:0/2249773544 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.640+0000 7f6b7effd640 1 --2- 172.21.15.82:0/2249773544 >> v2:172.21.15.184:3300/0 conn(0x7f6b8006ebf0 0x7f6b800cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.640+0000 7f6b7ffff640 1 -- 172.21.15.82:0/2249773544 >> v2:172.21.15.184:3300/0 conn(0x7f6b8006ebf0 msgr2=0x7f6b800cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.640+0000 7f6b7ffff640 1 --2- 172.21.15.82:0/2249773544 >> v2:172.21.15.184:3300/0 conn(0x7f6b8006ebf0 0x7f6b800cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.640+0000 7f6b7ffff640 1 -- 172.21.15.82:0/2249773544 >> v1:172.21.15.184:6789/0 conn(0x7f6b800ae910 legacy=0x7f6b8006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.640+0000 7f6b7ffff640 1 -- 172.21.15.82:0/2249773544 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8006d6f0 con 0x7f6b800cf190 2024-06-02T22:53:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.640+0000 7f6b7ffff640 1 --2- 172.21.15.82:0/2249773544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b800cf190 0x7f6b800acd40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6b80070c80 tx=0x7f6b7802c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1ceb21a0b0dbf8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.640+0000 7f6b7e7fc640 1 -- 172.21.15.82:0/2249773544 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78039070 con 0x7f6b800cf190 2024-06-02T22:53:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.640+0000 7f6b7e7fc640 1 -- 172.21.15.82:0/2249773544 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b7800b2e0 con 0x7f6b800cf190 2024-06-02T22:53:41.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.640+0000 7f6b7e7fc640 1 -- 172.21.15.82:0/2249773544 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78009820 con 0x7f6b800cf190 2024-06-02T22:53:41.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.641+0000 7f6b86212640 1 -- 172.21.15.82:0/2249773544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b800cf190 msgr2=0x7f6b800acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.641+0000 7f6b86212640 1 --2- 172.21.15.82:0/2249773544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b800cf190 0x7f6b800acd40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6b80070c80 tx=0x7f6b7802c860 comp rx=0 tx=0).stop 2024-06-02T22:53:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.641+0000 7f6b86212640 1 -- 172.21.15.82:0/2249773544 shutdown_connections 2024-06-02T22:53:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.641+0000 7f6b86212640 1 --2- 172.21.15.82:0/2249773544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b800cf190 0x7f6b800acd40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.641+0000 7f6b86212640 1 --2- 172.21.15.82:0/2249773544 >> v2:172.21.15.184:3300/0 conn(0x7f6b8006ebf0 0x7f6b800cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.641+0000 7f6b86212640 1 -- 172.21.15.82:0/2249773544 >> 172.21.15.82:0/2249773544 conn(0x7f6b800b19f0 msgr2=0x7f6b800b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.641+0000 7f6b86212640 1 -- 172.21.15.82:0/2249773544 shutdown_connections 2024-06-02T22:53:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.641+0000 7f6b86212640 1 -- 172.21.15.82:0/2249773544 wait complete. 2024-06-02T22:53:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.642+0000 7f6b86212640 1 Processor -- start 2024-06-02T22:53:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.642+0000 7f6b86212640 1 -- start start 2024-06-02T22:53:41.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b86212640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b8006ebf0 0x7f6b80158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b86212640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b800ae910 0x7f6b8015c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b86212640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b800cf190 0x7f6b801e5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b86212640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b800ad280 con 0x7f6b8006ebf0 2024-06-02T22:53:41.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b86212640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6b800aecf0 con 0x7f6b800ae910 2024-06-02T22:53:41.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b86212640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6b800ad400 con 0x7f6b800cf190 2024-06-02T22:53:41.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b7f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b8006ebf0 0x7f6b80158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b7f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b8006ebf0 0x7f6b80158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40700/0 (socket says 172.21.15.82:40700) 2024-06-02T22:53:41.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b7f7fe640 1 -- 172.21.15.82:0/3247409665 learned_addr learned my addr 172.21.15.82:0/3247409665 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:41.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b7f7fe640 1 -- 172.21.15.82:0/3247409665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b800cf190 msgr2=0x7f6b801e5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:41.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b7f7fe640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b800cf190 0x7f6b801e5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b7f7fe640 1 -- 172.21.15.82:0/3247409665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b800ae910 msgr2=0x7f6b8015c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:41.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b7f7fe640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b800ae910 0x7f6b8015c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.643+0000 7f6b7f7fe640 1 -- 172.21.15.82:0/3247409665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8015e3f0 con 0x7f6b8006ebf0 2024-06-02T22:53:41.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.644+0000 7f6b7f7fe640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b8006ebf0 0x7f6b80158400 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c430 tx=0x7f6b7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:41.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.644+0000 7f6b67fff640 1 -- 172.21.15.82:0/3247409665 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70011790 con 0x7f6b8006ebf0 2024-06-02T22:53:41.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.644+0000 7f6b67fff640 1 -- 172.21.15.82:0/3247409665 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b70017070 con 0x7f6b8006ebf0 2024-06-02T22:53:41.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.644+0000 7f6b86212640 1 -- 172.21.15.82:0/3247409665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8015d350 con 0x7f6b8006ebf0 2024-06-02T22:53:41.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.644+0000 7f6b67fff640 1 -- 172.21.15.82:0/3247409665 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70011bb0 con 0x7f6b8006ebf0 2024-06-02T22:53:41.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.644+0000 7f6b86212640 1 -- 172.21.15.82:0/3247409665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b8015dbf0 con 0x7f6b8006ebf0 2024-06-02T22:53:41.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.645+0000 7f6b86212640 1 -- 172.21.15.82:0/3247409665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b80068430 con 0x7f6b8006ebf0 2024-06-02T22:53:41.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.645+0000 7f6b67fff640 1 -- 172.21.15.82:0/3247409665 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b7001c460 con 0x7f6b8006ebf0 2024-06-02T22:53:41.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.646+0000 7f6b67fff640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6b6c06be30 0x7f6b6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.646+0000 7f6b7effd640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6b6c06be30 0x7f6b6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.646+0000 7f6b67fff640 1 -- 172.21.15.82:0/3247409665 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f6b7008ae30 con 0x7f6b8006ebf0 2024-06-02T22:53:41.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.646+0000 7f6b7effd640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6b6c06be30 0x7f6b6c06e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b80073370 tx=0x7f6b74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:41.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.650+0000 7f6b67fff640 1 -- 172.21.15.82:0/3247409665 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6b700596e0 con 0x7f6b8006ebf0 2024-06-02T22:53:41.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.859+0000 7f6b86212640 1 -- 172.21.15.82:0/3247409665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b8006e570 con 0x7f6b8006ebf0 2024-06-02T22:53:41.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.859+0000 7f6b67fff640 1 -- 172.21.15.82:0/3247409665 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5187 (secure 0 0 0) 0x7f6b70058fe0 con 0x7f6b8006ebf0 2024-06-02T22:53:41.860 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:41.860 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2836777878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2836777878},{"type":"v1","addr":"172.21.15.184:6834","nonce":2836777878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1408890584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":1408890584},{"type":"v1","addr":"172.21.15.184:6835","nonce":1408890584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3064310162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3064310162},{"type":"v1","addr":"172.21.15.82:6835","nonce":3064310162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:53:38.862365+0000","modified":"2024-06-02T22:53:40.857453+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2390078487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2390078487},{"type":"v1","addr":"172.21.15.82:6837","nonce":2390078487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5403,"qdb_cluster":[5403]},"id":3}]} 2024-06-02T22:53:41.860 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2024-06-02T22:53:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.861+0000 7f6b86212640 1 -- 172.21.15.82:0/3247409665 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6b6c06be30 msgr2=0x7f6b6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.861+0000 7f6b86212640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6b6c06be30 0x7f6b6c06e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b80073370 tx=0x7f6b74008040 comp rx=0 tx=0).stop 2024-06-02T22:53:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.861+0000 7f6b86212640 1 -- 172.21.15.82:0/3247409665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b8006ebf0 msgr2=0x7f6b80158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.861+0000 7f6b86212640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b8006ebf0 0x7f6b80158400 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c430 tx=0x7f6b7000c8f0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.862+0000 7f6b86212640 1 -- 172.21.15.82:0/3247409665 shutdown_connections 2024-06-02T22:53:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.862+0000 7f6b86212640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6b6c06be30 0x7f6b6c06e2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.862+0000 7f6b86212640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b800cf190 0x7f6b801e5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.862+0000 7f6b86212640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b800ae910 0x7f6b8015c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.862+0000 7f6b86212640 1 --2- 172.21.15.82:0/3247409665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b8006ebf0 0x7f6b80158400 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.862+0000 7f6b86212640 1 -- 172.21.15.82:0/3247409665 >> 172.21.15.82:0/3247409665 conn(0x7f6b800b19f0 msgr2=0x7f6b800b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.862+0000 7f6b86212640 1 -- 172.21.15.82:0/3247409665 shutdown_connections 2024-06-02T22:53:41.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.862+0000 7f6b86212640 1 -- 172.21.15.82:0/3247409665 wait complete. 2024-06-02T22:53:41.873 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:53:41.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.972+0000 7f2dec7e7640 1 Processor -- start 2024-06-02T22:53:41.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.972+0000 7f2dec7e7640 1 -- start start 2024-06-02T22:53:41.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2dec7e7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40ae910 0x7f2de406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2dec7e7640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2de40cf360 0x7f2de40acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2dec7e7640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de406d130 con 0x7f2de406ea20 2024-06-02T22:53:41.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2dec7e7640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f2de406ee60 con 0x7f2de40cf360 2024-06-02T22:53:41.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2dec7e7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2de406d410 con 0x7f2de40ae910 2024-06-02T22:53:41.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9d82640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2de406ea20 0x7f2de40cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52904/0 (socket says 172.21.15.82:52904) 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9d82640 1 -- 172.21.15.82:0/1257032986 learned_addr learned my addr 172.21.15.82:0/1257032986 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4113819768 0 0) 0x7f2de406d130 con 0x7f2de406ea20 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dd0003520 con 0x7f2de406ea20 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2dead84640 1 --2- 172.21.15.82:0/1257032986 >> v2:172.21.15.184:3300/0 conn(0x7f2de40cf360 0x7f2de40acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2dea583640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40ae910 0x7f2de406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1072047302 0 0) 0x7f2dd0003520 con 0x7f2de406ea20 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40ae910 msgr2=0x7f2de406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40ae910 0x7f2de406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 >> v2:172.21.15.184:3300/0 conn(0x7f2de40cf360 msgr2=0x7f2de40acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 --2- 172.21.15.82:0/1257032986 >> v2:172.21.15.184:3300/0 conn(0x7f2de40cf360 0x7f2de40acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de406d6f0 con 0x7f2de406ea20 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f2de0001670 con 0x7f2de406ea20 2024-06-02T22:53:41.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2dea583640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40ae910 0x7f2de406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 >> v1:172.21.15.82:6789/0 conn(0x7f2de406ea20 legacy=0x7f2de40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd00039b0 0x7f2dd0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40ae910 0x7f2dd0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dd0004d40 0x7f2dd00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2de406ee60 con 0x7f2dd00039b0 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2de406d410 con 0x7f2dd0004d40 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd000bac0 con 0x7f2de40ae910 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2dead84640 1 --2- 172.21.15.82:0/1257032986 >> v2:172.21.15.184:3300/0 conn(0x7f2de40cf360 0x7f2de40acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.973+0000 7f2dea583640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd00039b0 0x7f2dd0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.974+0000 7f2de9d82640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40ae910 0x7f2dd0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.974+0000 7f2dead84640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dd0004d40 0x7f2dd00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.974+0000 7f2dea583640 1 -- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40ae910 msgr2=0x7f2dd0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.974+0000 7f2dea583640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40ae910 0x7f2dd0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.974+0000 7f2dea583640 1 -- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dd0004d40 msgr2=0x7f2dd00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.974+0000 7f2dea583640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dd0004d40 0x7f2dd00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.974+0000 7f2dea583640 1 -- 172.21.15.82:0/1257032986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd0003520 con 0x7f2dd00039b0 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.974+0000 7f2de9d82640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40ae910 0x7f2dd0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.975+0000 7f2dea583640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd00039b0 0x7f2dd0003dd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40098a0 tx=0x7f2dd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2688bf259d581c2a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.975+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400f040 con 0x7f2dd00039b0 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.975+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd402ace0 con 0x7f2dd00039b0 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.975+0000 7f2de9581640 1 -- 172.21.15.82:0/1257032986 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4004250 con 0x7f2dd00039b0 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.975+0000 7f2dec7e7640 1 -- 172.21.15.82:0/1257032986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd00039b0 msgr2=0x7f2dd0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.975+0000 7f2dec7e7640 1 --2- 172.21.15.82:0/1257032986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd00039b0 0x7f2dd0003dd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40098a0 tx=0x7f2dd0005830 comp rx=0 tx=0).stop 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.975+0000 7f2dead84640 1 -- 172.21.15.82:0/1257032986 reap_dead start 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.975+0000 7f2dec7e7640 1 -- 172.21.15.82:0/1257032986 shutdown_connections 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.975+0000 7f2dec7e7640 1 -- 172.21.15.82:0/1257032986 >> 172.21.15.82:0/1257032986 conn(0x7f2de40b19f0 msgr2=0x7f2de40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:41.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.975+0000 7f2dec7e7640 1 -- 172.21.15.82:0/1257032986 shutdown_connections 2024-06-02T22:53:41.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.975+0000 7f2dec7e7640 1 -- 172.21.15.82:0/1257032986 wait complete. 2024-06-02T22:53:41.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.976+0000 7f2dec7e7640 1 Processor -- start 2024-06-02T22:53:41.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.976+0000 7f2dec7e7640 1 -- start start 2024-06-02T22:53:41.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.977+0000 7f2dec7e7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dd00039b0 0x7f2de41f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.977+0000 7f2dec7e7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de41f1660 0x7f2de414e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.977+0000 7f2dec7e7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40c5290 0x7f2de40722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.977+0000 7f2dec7e7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2de406e4e0 con 0x7f2de41f1660 2024-06-02T22:53:41.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.977+0000 7f2dec7e7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2de40aecf0 con 0x7f2dd00039b0 2024-06-02T22:53:41.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.977+0000 7f2dec7e7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f2de406e660 con 0x7f2de40c5290 2024-06-02T22:53:41.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.977+0000 7f2de9d82640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de41f1660 0x7f2de414e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.977+0000 7f2de9d82640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de41f1660 0x7f2de414e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40724/0 (socket says 172.21.15.82:40724) 2024-06-02T22:53:41.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.977+0000 7f2de9d82640 1 -- 172.21.15.82:0/775705256 learned_addr learned my addr 172.21.15.82:0/775705256 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:41.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.977+0000 7f2dea583640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dd00039b0 0x7f2de41f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.977+0000 7f2dead84640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40c5290 0x7f2de40722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2de9d82640 1 -- 172.21.15.82:0/775705256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40c5290 msgr2=0x7f2de40722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:41.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2de9d82640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40c5290 0x7f2de40722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2de9d82640 1 -- 172.21.15.82:0/775705256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dd00039b0 msgr2=0x7f2de41f1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:41.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2de9d82640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dd00039b0 0x7f2de41f1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:41.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2de9d82640 1 -- 172.21.15.82:0/775705256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de415bea0 con 0x7f2de41f1660 2024-06-02T22:53:41.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2dea583640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dd00039b0 0x7f2de41f1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:41.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2dead84640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40c5290 0x7f2de40722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:41.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2de9d82640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de41f1660 0x7f2de414e7b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2de000e7e0 tx=0x7f2de000ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:41.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2ddaffd640 1 -- 172.21.15.82:0/775705256 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de000c6c0 con 0x7f2de41f1660 2024-06-02T22:53:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2ddaffd640 1 -- 172.21.15.82:0/775705256 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de0018070 con 0x7f2de41f1660 2024-06-02T22:53:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2ddaffd640 1 -- 172.21.15.82:0/775705256 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de000ca60 con 0x7f2de41f1660 2024-06-02T22:53:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2dec7e7640 1 -- 172.21.15.82:0/775705256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de415c180 con 0x7f2de41f1660 2024-06-02T22:53:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.978+0000 7f2dec7e7640 1 -- 172.21.15.82:0/775705256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de415c740 con 0x7f2de41f1660 2024-06-02T22:53:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.979+0000 7f2dec7e7640 1 -- 172.21.15.82:0/775705256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de4068430 con 0x7f2de41f1660 2024-06-02T22:53:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.979+0000 7f2ddaffd640 1 -- 172.21.15.82:0/775705256 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2de000cc00 con 0x7f2de41f1660 2024-06-02T22:53:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.980+0000 7f2ddaffd640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2dc806be30 0x7f2dc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.980+0000 7f2ddaffd640 1 -- 172.21.15.82:0/775705256 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2de008add0 con 0x7f2de41f1660 2024-06-02T22:53:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.980+0000 7f2dea583640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2dc806be30 0x7f2dc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.980+0000 7f2dea583640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2dc806be30 0x7f2dc806e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4033000 tx=0x7f2dd402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:41.984+0000 7f2ddaffd640 1 -- 172.21.15.82:0/775705256 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2de0059680 con 0x7f2de41f1660 2024-06-02T22:53:42.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.159+0000 7f2dec7e7640 1 -- 172.21.15.82:0/775705256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2de40b0e10 con 0x7f2de41f1660 2024-06-02T22:53:42.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.160+0000 7f2ddaffd640 1 -- 172.21.15.82:0/775705256 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16938 (secure 0 0 0) 0x7f2de008c070 con 0x7f2de41f1660 2024-06-02T22:53:42.160 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:42.160 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":54,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:53:40.210399+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:53:37.205775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-06-02T22:53:37.825433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:53:42.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 -- 172.21.15.82:0/775705256 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2dc806be30 msgr2=0x7f2dc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2dc806be30 0x7f2dc806e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4033000 tx=0x7f2dd402e000 comp rx=0 tx=0).stop 2024-06-02T22:53:42.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 -- 172.21.15.82:0/775705256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de41f1660 msgr2=0x7f2de414e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de41f1660 0x7f2de414e7b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2de000e7e0 tx=0x7f2de000ebe0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 -- 172.21.15.82:0/775705256 shutdown_connections 2024-06-02T22:53:42.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f2dc806be30 0x7f2dc806e2f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2de40c5290 0x7f2de40722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de41f1660 0x7f2de414e7b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 --2- 172.21.15.82:0/775705256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2dd00039b0 0x7f2de41f1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 -- 172.21.15.82:0/775705256 >> 172.21.15.82:0/775705256 conn(0x7f2de40b19f0 msgr2=0x7f2de40b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:42.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 -- 172.21.15.82:0/775705256 shutdown_connections 2024-06-02T22:53:42.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.162+0000 7f2dec7e7640 1 -- 172.21.15.82:0/775705256 wait complete. 2024-06-02T22:53:42.173 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T22:53:42.173 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:53:42.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.272+0000 7f5c124b3640 1 Processor -- start 2024-06-02T22:53:42.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.272+0000 7f5c124b3640 1 -- start start 2024-06-02T22:53:42.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.273+0000 7f5c124b3640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5c0c0ae910 0x7f5c0c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.273+0000 7f5c124b3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5c0c0cf360 0x7f5c0c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.273+0000 7f5c124b3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0c06d130 con 0x7f5c0c06ea20 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.273+0000 7f5c124b3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5c0c06ee90 con 0x7f5c0c0cf360 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.273+0000 7f5c124b3640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f5c0c06d410 con 0x7f5c0c0ae910 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.273+0000 7f5c10a50640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5c0c0cf360 0x7f5c0c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.273+0000 7f5c0b7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5c0c06ea20 0x7f5c0c0cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52906/0 (socket says 172.21.15.82:52906) 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.273+0000 7f5c10a50640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5c0c0cf360 0x7f5c0c0acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40736/0 (socket says 172.21.15.82:40736) 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.273+0000 7f5c0b7fe640 1 -- 172.21.15.82:0/791883656 learned_addr learned my addr 172.21.15.82:0/791883656 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.273+0000 7f5c0bfff640 1 --2- 172.21.15.82:0/791883656 >> v2:172.21.15.184:3300/0 conn(0x7f5c0c0ae910 0x7f5c0c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.274+0000 7f5c10a50640 1 -- 172.21.15.82:0/791883656 >> v2:172.21.15.184:3300/0 conn(0x7f5c0c0ae910 msgr2=0x7f5c0c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.274+0000 7f5c10a50640 1 --2- 172.21.15.82:0/791883656 >> v2:172.21.15.184:3300/0 conn(0x7f5c0c0ae910 0x7f5c0c06e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.274+0000 7f5c10a50640 1 -- 172.21.15.82:0/791883656 >> v1:172.21.15.82:6789/0 conn(0x7f5c0c06ea20 legacy=0x7f5c0c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.274+0000 7f5c10a50640 1 -- 172.21.15.82:0/791883656 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0c06d6f0 con 0x7f5c0c0cf360 2024-06-02T22:53:42.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.274+0000 7f5c0affd640 1 -- 172.21.15.82:0/791883656 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742489297 0 0) 0x7f5c0c06d130 con 0x7f5c0c06ea20 2024-06-02T22:53:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.274+0000 7f5c10a50640 1 --2- 172.21.15.82:0/791883656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0c0cf360 0x7f5c0c0acd40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0750b0 tx=0x7f5c0402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486438cbb609de2d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.274+0000 7f5c0affd640 1 -- 172.21.15.82:0/791883656 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04007740 con 0x7f5c0c0cf360 2024-06-02T22:53:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.274+0000 7f5c0affd640 1 -- 172.21.15.82:0/791883656 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c040078e0 con 0x7f5c0c0cf360 2024-06-02T22:53:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.274+0000 7f5c0affd640 1 -- 172.21.15.82:0/791883656 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04007cb0 con 0x7f5c0c0cf360 2024-06-02T22:53:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.275+0000 7f5c124b3640 1 -- 172.21.15.82:0/791883656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0c0cf360 msgr2=0x7f5c0c0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.275+0000 7f5c124b3640 1 --2- 172.21.15.82:0/791883656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0c0cf360 0x7f5c0c0acd40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c0750b0 tx=0x7f5c0402a5f0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.275+0000 7f5c124b3640 1 -- 172.21.15.82:0/791883656 shutdown_connections 2024-06-02T22:53:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.275+0000 7f5c124b3640 1 --2- 172.21.15.82:0/791883656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0c0cf360 0x7f5c0c0acd40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.275+0000 7f5c124b3640 1 --2- 172.21.15.82:0/791883656 >> v2:172.21.15.184:3300/0 conn(0x7f5c0c0ae910 0x7f5c0c06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.275+0000 7f5c124b3640 1 -- 172.21.15.82:0/791883656 >> 172.21.15.82:0/791883656 conn(0x7f5c0c0b19f0 msgr2=0x7f5c0c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.275+0000 7f5c124b3640 1 -- 172.21.15.82:0/791883656 shutdown_connections 2024-06-02T22:53:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.275+0000 7f5c124b3640 1 -- 172.21.15.82:0/791883656 wait complete. 2024-06-02T22:53:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.276+0000 7f5c124b3640 1 Processor -- start 2024-06-02T22:53:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.276+0000 7f5c124b3640 1 -- start start 2024-06-02T22:53:42.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c124b3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c0c06ea20 0x7f5c0c1f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c124b3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c0c0ae910 0x7f5c0c1f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c124b3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0c0cf360 0x7f5c0c148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c124b3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c0ad280 con 0x7f5c0c0cf360 2024-06-02T22:53:42.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c124b3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c0aecf0 con 0x7f5c0c0ae910 2024-06-02T22:53:42.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c124b3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0c0ad400 con 0x7f5c0c06ea20 2024-06-02T22:53:42.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c10a50640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0c0cf360 0x7f5c0c148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c10a50640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0c0cf360 0x7f5c0c148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40746/0 (socket says 172.21.15.82:40746) 2024-06-02T22:53:42.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c10a50640 1 -- 172.21.15.82:0/2792216701 learned_addr learned my addr 172.21.15.82:0/2792216701 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:42.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c0b7fe640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c0c0ae910 0x7f5c0c1f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c10a50640 1 -- 172.21.15.82:0/2792216701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c0c06ea20 msgr2=0x7f5c0c1f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c0bfff640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c0c06ea20 0x7f5c0c1f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c10a50640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c0c06ea20 0x7f5c0c1f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c10a50640 1 -- 172.21.15.82:0/2792216701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c0c0ae910 msgr2=0x7f5c0c1f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c10a50640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c0c0ae910 0x7f5c0c1f1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.277+0000 7f5c10a50640 1 -- 172.21.15.82:0/2792216701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0c09c560 con 0x7f5c0c0cf360 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.278+0000 7f5c10a50640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0c0cf360 0x7f5c0c148270 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5c0402abe0 tx=0x7f5c04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.278+0000 7f5c08ff9640 1 -- 172.21.15.82:0/2792216701 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04040070 con 0x7f5c0c0cf360 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.278+0000 7f5c08ff9640 1 -- 172.21.15.82:0/2792216701 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c04031c90 con 0x7f5c0c0cf360 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.278+0000 7f5c124b3640 1 -- 172.21.15.82:0/2792216701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0c1489e0 con 0x7f5c0c0cf360 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.278+0000 7f5c08ff9640 1 -- 172.21.15.82:0/2792216701 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04045680 con 0x7f5c0c0cf360 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.278+0000 7f5c124b3640 1 -- 172.21.15.82:0/2792216701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c0c148fa0 con 0x7f5c0c0cf360 2024-06-02T22:53:42.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.279+0000 7f5c124b3640 1 -- 172.21.15.82:0/2792216701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0c145f40 con 0x7f5c0c0cf360 2024-06-02T22:53:42.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.279+0000 7f5c08ff9640 1 -- 172.21.15.82:0/2792216701 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c04039040 con 0x7f5c0c0cf360 2024-06-02T22:53:42.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.280+0000 7f5c08ff9640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.280+0000 7f5c08ff9640 1 -- 172.21.15.82:0/2792216701 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f5c040aca00 con 0x7f5c0c0cf360 2024-06-02T22:53:42.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.280+0000 7f5c0bfff640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.280+0000 7f5c0bfff640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5bf806be30 0x7f5bf806e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006fd0 tx=0x7f5bfc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:42.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.284+0000 7f5c08ff9640 1 -- 172.21.15.82:0/2792216701 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5c0c145f40 con 0x7f5c0c0cf360 2024-06-02T22:53:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.454+0000 7f5c124b3640 1 -- 172.21.15.82:0/2792216701 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c0c068430 con 0x7f5bf806be30 2024-06-02T22:53:42.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.460+0000 7f5c08ff9640 1 -- 172.21.15.82:0/2792216701 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237205 (secure 0 0 0) 0x7f5c0c068430 con 0x7f5bf806be30 2024-06-02T22:53:42.463 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:53:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 -- 172.21.15.82:0/2792216701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5bf806be30 msgr2=0x7f5bf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5bf806be30 0x7f5bf806e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006fd0 tx=0x7f5bfc008040 comp rx=0 tx=0).stop 2024-06-02T22:53:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 -- 172.21.15.82:0/2792216701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0c0cf360 msgr2=0x7f5c0c148270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0c0cf360 0x7f5c0c148270 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5c0402abe0 tx=0x7f5c04004a40 comp rx=0 tx=0).stop 2024-06-02T22:53:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 -- 172.21.15.82:0/2792216701 shutdown_connections 2024-06-02T22:53:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0c0cf360 0x7f5c0c148270 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c0c0ae910 0x7f5c0c1f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 --2- 172.21.15.82:0/2792216701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c0c06ea20 0x7f5c0c1f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 -- 172.21.15.82:0/2792216701 >> 172.21.15.82:0/2792216701 conn(0x7f5c0c0b19f0 msgr2=0x7f5c0c0cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 -- 172.21.15.82:0/2792216701 shutdown_connections 2024-06-02T22:53:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.463+0000 7f5c124b3640 1 -- 172.21.15.82:0/2792216701 wait complete. 2024-06-02T22:53:42.474 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-06-02T22:53:41.843865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221848,"kb_used_data":5652,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752872,"statfs":{"total":773094113280,"available":772866940928,"internally_reserved":0,"allocated":5787648,"data_stored":3218207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.345342"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":225,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-02T22:53:36.313806+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:53:36.313806+0000","last_peered":"2024-06-02T22:53:36.313806+0000","last_clean":"2024-06-02T22:53:36.313806+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:53:36.313806+0000","last_undegraded":"2024-06-02T22:53:36.313806+0000","last_fullsized":"2024-06-02T22:53:36.313806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1191936,"data_stored":855418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":259531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":242926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":259531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":248461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":536576,"data_stored":237391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27616,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":598016,"data_stored":265050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":849899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:53:42.478 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:53:42.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.614+0000 7fafecfb7640 1 Processor -- start 2024-06-02T22:53:42.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.615+0000 7fafecfb7640 1 -- start start 2024-06-02T22:53:42.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.615+0000 7fafecfb7640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fafe8161cc0 0x7fafe80d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.615+0000 7fafecfb7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fafe80d4cd0 0x7fafe80d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.615+0000 7fafecfb7640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe80d03e0 con 0x7fafe81618e0 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.615+0000 7fafecfb7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fafe80b4130 con 0x7fafe80d4cd0 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.615+0000 7fafecfb7640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fafe80d0100 con 0x7fafe8161cc0 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.616+0000 7fafe6d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fafe80d4cd0 0x7fafe80d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.616+0000 7fafe659c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fafe81618e0 0x7fafe80cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52916/0 (socket says 172.21.15.82:52916) 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.616+0000 7fafe6d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fafe80d4cd0 0x7fafe80d2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40754/0 (socket says 172.21.15.82:40754) 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.616+0000 7fafe659c640 1 -- 172.21.15.82:0/1017812454 learned_addr learned my addr 172.21.15.82:0/1017812454 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.616+0000 7fafe5d9b640 1 --2- 172.21.15.82:0/1017812454 >> v2:172.21.15.184:3300/0 conn(0x7fafe8161cc0 0x7fafe80d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.616+0000 7fafe6d9d640 1 -- 172.21.15.82:0/1017812454 >> v2:172.21.15.184:3300/0 conn(0x7fafe8161cc0 msgr2=0x7fafe80d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.616+0000 7fafe6d9d640 1 --2- 172.21.15.82:0/1017812454 >> v2:172.21.15.184:3300/0 conn(0x7fafe8161cc0 0x7fafe80d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.616+0000 7fafe6d9d640 1 -- 172.21.15.82:0/1017812454 >> v1:172.21.15.82:6789/0 conn(0x7fafe81618e0 legacy=0x7fafe80cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.616+0000 7fafe6d9d640 1 -- 172.21.15.82:0/1017812454 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe80b3ae0 con 0x7fafe80d4cd0 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.616+0000 7fafe559a640 1 -- 172.21.15.82:0/1017812454 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197422841 0 0) 0x7fafe80d03e0 con 0x7fafe81618e0 2024-06-02T22:53:42.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.616+0000 7fafe5d9b640 1 --2- 172.21.15.82:0/1017812454 >> v2:172.21.15.184:3300/0 conn(0x7fafe8161cc0 0x7fafe80d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:42.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafe6d9d640 1 --2- 172.21.15.82:0/1017812454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafe80d4cd0 0x7fafe80d2a50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fafe80cb160 tx=0x7fafd802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf209e5b908f46c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:42.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafe559a640 1 -- 172.21.15.82:0/1017812454 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd8037070 con 0x7fafe80d4cd0 2024-06-02T22:53:42.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafe559a640 1 -- 172.21.15.82:0/1017812454 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd8032440 con 0x7fafe80d4cd0 2024-06-02T22:53:42.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafe559a640 1 -- 172.21.15.82:0/1017812454 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd8032810 con 0x7fafe80d4cd0 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafecfb7640 1 -- 172.21.15.82:0/1017812454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafe80d4cd0 msgr2=0x7fafe80d2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafecfb7640 1 --2- 172.21.15.82:0/1017812454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafe80d4cd0 0x7fafe80d2a50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fafe80cb160 tx=0x7fafd802a1a0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafecfb7640 1 -- 172.21.15.82:0/1017812454 shutdown_connections 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafecfb7640 1 --2- 172.21.15.82:0/1017812454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafe80d4cd0 0x7fafe80d2a50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafecfb7640 1 --2- 172.21.15.82:0/1017812454 >> v2:172.21.15.184:3300/0 conn(0x7fafe8161cc0 0x7fafe80d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafecfb7640 1 -- 172.21.15.82:0/1017812454 >> 172.21.15.82:0/1017812454 conn(0x7fafe809d410 msgr2=0x7fafe80d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafecfb7640 1 -- 172.21.15.82:0/1017812454 shutdown_connections 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.617+0000 7fafecfb7640 1 -- 172.21.15.82:0/1017812454 wait complete. 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.619+0000 7fafecfb7640 1 Processor -- start 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.619+0000 7fafecfb7640 1 -- start start 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.619+0000 7fafecfb7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafe80d4cd0 0x7fafe80b8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.619+0000 7fafecfb7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe81618e0 0x7fafe80cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.619+0000 7fafecfb7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe8161cc0 0x7fafe81500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.619+0000 7fafecfb7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fafe80b4740 con 0x7fafe80d4cd0 2024-06-02T22:53:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.619+0000 7fafecfb7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fafe80b45c0 con 0x7fafe8161cc0 2024-06-02T22:53:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.619+0000 7fafecfb7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fafe80b48c0 con 0x7fafe81618e0 2024-06-02T22:53:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafe659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafe80d4cd0 0x7fafe80b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafe659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafe80d4cd0 0x7fafe80b8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40770/0 (socket says 172.21.15.82:40770) 2024-06-02T22:53:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafe659c640 1 -- 172.21.15.82:0/3565494862 learned_addr learned my addr 172.21.15.82:0/3565494862 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafe659c640 1 -- 172.21.15.82:0/3565494862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe81618e0 msgr2=0x7fafe80cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafe659c640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe81618e0 0x7fafe80cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafe659c640 1 -- 172.21.15.82:0/3565494862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe8161cc0 msgr2=0x7fafe81500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafe6d9d640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe8161cc0 0x7fafe81500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafe659c640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe8161cc0 0x7fafe81500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafe659c640 1 -- 172.21.15.82:0/3565494862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe80ccbc0 con 0x7fafe80d4cd0 2024-06-02T22:53:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafe659c640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafe80d4cd0 0x7fafe80b8770 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fafe000c890 tx=0x7fafe000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafdeffd640 1 -- 172.21.15.82:0/3565494862 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe0018070 con 0x7fafe80d4cd0 2024-06-02T22:53:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafdeffd640 1 -- 172.21.15.82:0/3565494862 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe000a640 con 0x7fafe80d4cd0 2024-06-02T22:53:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafecfb7640 1 -- 172.21.15.82:0/3565494862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe80cbb20 con 0x7fafe80d4cd0 2024-06-02T22:53:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafdeffd640 1 -- 172.21.15.82:0/3565494862 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe000aa30 con 0x7fafe80d4cd0 2024-06-02T22:53:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.620+0000 7fafecfb7640 1 -- 172.21.15.82:0/3565494862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe80cc0e0 con 0x7fafe80d4cd0 2024-06-02T22:53:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.621+0000 7fafecfb7640 1 -- 172.21.15.82:0/3565494862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe8068430 con 0x7fafe80d4cd0 2024-06-02T22:53:42.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.622+0000 7fafdeffd640 1 -- 172.21.15.82:0/3565494862 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafe000abd0 con 0x7fafe80d4cd0 2024-06-02T22:53:42.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.622+0000 7fafdeffd640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fafc806be30 0x7fafc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.622+0000 7fafdeffd640 1 -- 172.21.15.82:0/3565494862 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fafe008a680 con 0x7fafe80d4cd0 2024-06-02T22:53:42.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.622+0000 7fafe5d9b640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fafc806be30 0x7fafc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.623+0000 7fafe5d9b640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fafc806be30 0x7fafc806e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fafd0006fd0 tx=0x7fafd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.627+0000 7fafdeffd640 1 -- 172.21.15.82:0/3565494862 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fafe0058e20 con 0x7fafe80d4cd0 2024-06-02T22:53:42.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.798+0000 7fafecfb7640 1 -- 172.21.15.82:0/3565494862 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafe80cc8c0 con 0x7fafc806be30 2024-06-02T22:53:42.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.803+0000 7fafdeffd640 1 -- 172.21.15.82:0/3565494862 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237205 (secure 0 0 0) 0x7fafe80cc8c0 con 0x7fafc806be30 2024-06-02T22:53:42.805 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:42.806 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:53:42.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 -- 172.21.15.82:0/3565494862 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fafc806be30 msgr2=0x7fafc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fafc806be30 0x7fafc806e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fafd0006fd0 tx=0x7fafd0008040 comp rx=0 tx=0).stop 2024-06-02T22:53:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 -- 172.21.15.82:0/3565494862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafe80d4cd0 msgr2=0x7fafe80b8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafe80d4cd0 0x7fafe80b8770 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fafe000c890 tx=0x7fafe000cd50 comp rx=0 tx=0).stop 2024-06-02T22:53:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 -- 172.21.15.82:0/3565494862 shutdown_connections 2024-06-02T22:53:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fafc806be30 0x7fafc806e2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe8161cc0 0x7fafe81500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe81618e0 0x7fafe80cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 --2- 172.21.15.82:0/3565494862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafe80d4cd0 0x7fafe80b8770 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 -- 172.21.15.82:0/3565494862 >> 172.21.15.82:0/3565494862 conn(0x7fafe809d410 msgr2=0x7fafe806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 -- 172.21.15.82:0/3565494862 shutdown_connections 2024-06-02T22:53:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.806+0000 7fafecfb7640 1 -- 172.21.15.82:0/3565494862 wait complete. 2024-06-02T22:53:42.817 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-06-02T22:53:41.843865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221848,"kb_used_data":5652,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752872,"statfs":{"total":773094113280,"available":772866940928,"internally_reserved":0,"allocated":5787648,"data_stored":3218207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.345342"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":225,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-02T22:53:36.313806+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:53:36.313806+0000","last_peered":"2024-06-02T22:53:36.313806+0000","last_clean":"2024-06-02T22:53:36.313806+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:53:36.313806+0000","last_undegraded":"2024-06-02T22:53:36.313806+0000","last_fullsized":"2024-06-02T22:53:36.313806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1191936,"data_stored":855418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":259531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":242926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":259531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":248461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":536576,"data_stored":237391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27616,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":598016,"data_stored":265050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":849899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:53:42.820 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:53:42.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.956+0000 7fc93069e640 1 Processor -- start 2024-06-02T22:53:42.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.956+0000 7fc93069e640 1 -- start start 2024-06-02T22:53:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.957+0000 7fc93069e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9280d2680 0x7fc92815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.957+0000 7fc93069e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc9280d1fc0 0x7fc9280d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.957+0000 7fc93069e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc928161fa0 0x7fc928162410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.957+0000 7fc93069e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc9280d13e0 con 0x7fc9280d2680 2024-06-02T22:53:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.957+0000 7fc93069e640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fc9280d2fa0 con 0x7fc9280d1fc0 2024-06-02T22:53:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.957+0000 7fc93069e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc9280d0ad0 con 0x7fc928161fa0 2024-06-02T22:53:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.957+0000 7fc92e43a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9280d2680 0x7fc92815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.957+0000 7fc92e43a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9280d2680 0x7fc92815f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40780/0 (socket says 172.21.15.82:40780) 2024-06-02T22:53:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.957+0000 7fc92e43a640 1 -- 172.21.15.82:0/3767470760 learned_addr learned my addr 172.21.15.82:0/3767470760 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.958+0000 7fc92dc39640 1 --2- 172.21.15.82:0/3767470760 >> v2:172.21.15.184:3300/0 conn(0x7fc9280d1fc0 0x7fc9280d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.958+0000 7fc92ec3b640 1 --2- 172.21.15.82:0/3767470760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc928161fa0 0x7fc928162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.958+0000 7fc92e43a640 1 -- 172.21.15.82:0/3767470760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc928161fa0 msgr2=0x7fc928162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.958+0000 7fc92e43a640 1 --2- 172.21.15.82:0/3767470760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc928161fa0 0x7fc928162410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.958+0000 7fc92e43a640 1 -- 172.21.15.82:0/3767470760 >> v2:172.21.15.184:3300/0 conn(0x7fc9280d1fc0 msgr2=0x7fc9280d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.958+0000 7fc92e43a640 1 --2- 172.21.15.82:0/3767470760 >> v2:172.21.15.184:3300/0 conn(0x7fc9280d1fc0 0x7fc9280d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.958+0000 7fc92e43a640 1 -- 172.21.15.82:0/3767470760 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92815f890 con 0x7fc9280d2680 2024-06-02T22:53:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.958+0000 7fc92dc39640 1 --2- 172.21.15.82:0/3767470760 >> v2:172.21.15.184:3300/0 conn(0x7fc9280d1fc0 0x7fc9280d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.958+0000 7fc92e43a640 1 --2- 172.21.15.82:0/3767470760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9280d2680 0x7fc92815f1a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc9280c7960 tx=0x7fc91802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a74658875b5df5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:42.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc92d438640 1 -- 172.21.15.82:0/3767470760 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918036070 con 0x7fc9280d2680 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc92d438640 1 -- 172.21.15.82:0/3767470760 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc918031600 con 0x7fc9280d2680 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc92d438640 1 -- 172.21.15.82:0/3767470760 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9180319d0 con 0x7fc9280d2680 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc93069e640 1 -- 172.21.15.82:0/3767470760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9280d2680 msgr2=0x7fc92815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc93069e640 1 --2- 172.21.15.82:0/3767470760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9280d2680 0x7fc92815f1a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc9280c7960 tx=0x7fc91802a6a0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc93069e640 1 -- 172.21.15.82:0/3767470760 shutdown_connections 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc93069e640 1 --2- 172.21.15.82:0/3767470760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc928161fa0 0x7fc928162410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc93069e640 1 --2- 172.21.15.82:0/3767470760 >> v2:172.21.15.184:3300/0 conn(0x7fc9280d1fc0 0x7fc9280d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc93069e640 1 --2- 172.21.15.82:0/3767470760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9280d2680 0x7fc92815f1a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc93069e640 1 -- 172.21.15.82:0/3767470760 >> 172.21.15.82:0/3767470760 conn(0x7fc92809d3f0 msgr2=0x7fc9280d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc93069e640 1 -- 172.21.15.82:0/3767470760 shutdown_connections 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.959+0000 7fc93069e640 1 -- 172.21.15.82:0/3767470760 wait complete. 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.960+0000 7fc93069e640 1 Processor -- start 2024-06-02T22:53:42.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.960+0000 7fc93069e640 1 -- start start 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc93069e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9280d1fc0 0x7fc9280cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc93069e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9280d2680 0x7fc92809f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc93069e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc928161fa0 0x7fc9280a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc93069e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9280d2400 con 0x7fc9280d2680 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc93069e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc9280d1070 con 0x7fc928161fa0 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc93069e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fc9280d4f00 con 0x7fc9280d1fc0 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc92dc39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9280d2680 0x7fc92809f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc92dc39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9280d2680 0x7fc92809f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40782/0 (socket says 172.21.15.82:40782) 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc92dc39640 1 -- 172.21.15.82:0/3662010788 learned_addr learned my addr 172.21.15.82:0/3662010788 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc92ec3b640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc928161fa0 0x7fc9280a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc92e43a640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9280d1fc0 0x7fc9280cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.961+0000 7fc92dc39640 1 -- 172.21.15.82:0/3662010788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9280d1fc0 msgr2=0x7fc9280cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.962+0000 7fc92dc39640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9280d1fc0 0x7fc9280cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.962+0000 7fc92dc39640 1 -- 172.21.15.82:0/3662010788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc928161fa0 msgr2=0x7fc9280a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.962+0000 7fc92dc39640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc928161fa0 0x7fc9280a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.962+0000 7fc92dc39640 1 -- 172.21.15.82:0/3662010788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92809fc40 con 0x7fc9280d2680 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.962+0000 7fc92e43a640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9280d1fc0 0x7fc9280cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.962+0000 7fc92dc39640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9280d2680 0x7fc92809f700 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00e840 tx=0x7fc91c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.962+0000 7fc926ffd640 1 -- 172.21.15.82:0/3662010788 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c00f040 con 0x7fc9280d2680 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.962+0000 7fc926ffd640 1 -- 172.21.15.82:0/3662010788 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c004030 con 0x7fc9280d2680 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.962+0000 7fc93069e640 1 -- 172.21.15.82:0/3662010788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9280cb750 con 0x7fc9280d2680 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.962+0000 7fc926ffd640 1 -- 172.21.15.82:0/3662010788 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c004400 con 0x7fc9280d2680 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.962+0000 7fc93069e640 1 -- 172.21.15.82:0/3662010788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9280cbd10 con 0x7fc9280d2680 2024-06-02T22:53:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.963+0000 7fc93069e640 1 -- 172.21.15.82:0/3662010788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc928068430 con 0x7fc9280d2680 2024-06-02T22:53:42.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.963+0000 7fc926ffd640 1 -- 172.21.15.82:0/3662010788 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc91c00c6d0 con 0x7fc9280d2680 2024-06-02T22:53:42.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.964+0000 7fc926ffd640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc91406be30 0x7fc91406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:42.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.964+0000 7fc926ffd640 1 -- 172.21.15.82:0/3662010788 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc91c08abc0 con 0x7fc9280d2680 2024-06-02T22:53:42.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.964+0000 7fc92e43a640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc91406be30 0x7fc91406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:42.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.964+0000 7fc92e43a640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc91406be30 0x7fc91406e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc918033000 tx=0x7fc918009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:42.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:42.968+0000 7fc926ffd640 1 -- 172.21.15.82:0/3662010788 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc91c017020 con 0x7fc9280d2680 2024-06-02T22:53:43.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.138+0000 7fc93069e640 1 -- 172.21.15.82:0/3662010788 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9280d04e0 con 0x7fc91406be30 2024-06-02T22:53:43.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.144+0000 7fc926ffd640 1 -- 172.21.15.82:0/3662010788 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237205 (secure 0 0 0) 0x7fc9280d04e0 con 0x7fc91406be30 2024-06-02T22:53:43.146 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:43.147 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:53:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 -- 172.21.15.82:0/3662010788 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc91406be30 msgr2=0x7fc91406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc91406be30 0x7fc91406e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc918033000 tx=0x7fc918009000 comp rx=0 tx=0).stop 2024-06-02T22:53:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 -- 172.21.15.82:0/3662010788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9280d2680 msgr2=0x7fc92809f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9280d2680 0x7fc92809f700 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00e840 tx=0x7fc91c00ed00 comp rx=0 tx=0).stop 2024-06-02T22:53:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 -- 172.21.15.82:0/3662010788 shutdown_connections 2024-06-02T22:53:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fc91406be30 0x7fc91406e2f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc928161fa0 0x7fc9280a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9280d2680 0x7fc92809f700 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 --2- 172.21.15.82:0/3662010788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9280d1fc0 0x7fc9280cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 -- 172.21.15.82:0/3662010788 >> 172.21.15.82:0/3662010788 conn(0x7fc92809d3f0 msgr2=0x7fc9280d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 -- 172.21.15.82:0/3662010788 shutdown_connections 2024-06-02T22:53:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.147+0000 7fc93069e640 1 -- 172.21.15.82:0/3662010788 wait complete. 2024-06-02T22:53:43.157 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-06-02T22:53:41.843865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221848,"kb_used_data":5652,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752872,"statfs":{"total":773094113280,"available":772866940928,"internally_reserved":0,"allocated":5787648,"data_stored":3218207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.345342"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:38.497665+0000","last_change":"2024-06-02T22:53:38.497665+0000","last_active":"2024-06-02T22:53:38.497665+0000","last_peered":"2024-06-02T22:53:38.497665+0000","last_clean":"2024-06-02T22:53:38.497665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:38.497665+0000","last_undegraded":"2024-06-02T22:53:38.497665+0000","last_fullsized":"2024-06-02T22:53:38.497665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T22:53:37.495765+0000","last_change":"2024-06-02T22:53:37.495765+0000","last_active":"2024-06-02T22:53:37.495765+0000","last_peered":"2024-06-02T22:53:37.495765+0000","last_clean":"2024-06-02T22:53:37.495765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T22:53:37.495765+0000","last_undegraded":"2024-06-02T22:53:37.495765+0000","last_fullsized":"2024-06-02T22:53:37.495765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":225,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-06-02T22:53:36.313806+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:53:36.313806+0000","last_peered":"2024-06-02T22:53:36.313806+0000","last_clean":"2024-06-02T22:53:36.313806+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:53:36.313806+0000","last_undegraded":"2024-06-02T22:53:36.313806+0000","last_fullsized":"2024-06-02T22:53:36.313806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1191936,"data_stored":855418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":259531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":242926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27600,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":585728,"data_stored":259531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":248461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27544,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":536576,"data_stored":237391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27616,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":598016,"data_stored":265050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":849899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:53:43.161 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-06-02T22:53:43.161 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.162 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-06-02T22:53:43.162 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.162 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3d is not active+clean 2024-06-02T22:53:43.162 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.162 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3c is not active+clean 2024-06-02T22:53:43.162 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.162 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-06-02T22:53:43.162 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3a is not active+clean 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:PG 9.39 is not active+clean 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:PG 9.38 is not active+clean 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:PG 9.37 is not active+clean 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:PG 9.36 is not active+clean 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:PG 9.35 is not active+clean 2024-06-02T22:53:43.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:PG 9.34 is not active+clean 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:PG 9.33 is not active+clean 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:PG 9.32 is not active+clean 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:PG 9.31 is not active+clean 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:PG 9.30 is not active+clean 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2f is not active+clean 2024-06-02T22:53:43.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2e is not active+clean 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2b is not active+clean 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:PG 9.29 is not active+clean 2024-06-02T22:53:43.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.166 INFO:tasks.ceph.ceph_manager.ceph:PG 9.28 is not active+clean 2024-06-02T22:53:43.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.166 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-06-02T22:53:43.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.166 INFO:tasks.ceph.ceph_manager.ceph:PG 9.26 is not active+clean 2024-06-02T22:53:43.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.166 INFO:tasks.ceph.ceph_manager.ceph:PG 9.25 is not active+clean 2024-06-02T22:53:43.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.166 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-06-02T22:53:43.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.166 INFO:tasks.ceph.ceph_manager.ceph:PG 9.23 is not active+clean 2024-06-02T22:53:43.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.167 INFO:tasks.ceph.ceph_manager.ceph:PG 9.22 is not active+clean 2024-06-02T22:53:43.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.167 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-06-02T22:53:43.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.167 INFO:tasks.ceph.ceph_manager.ceph:PG 9.20 is not active+clean 2024-06-02T22:53:43.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.167 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1e is not active+clean 2024-06-02T22:53:43.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.167 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1f is not active+clean 2024-06-02T22:53:43.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.168 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-06-02T22:53:43.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.168 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-06-02T22:53:43.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.168 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1c is not active+clean 2024-06-02T22:53:43.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.168 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1d is not active+clean 2024-06-02T22:53:43.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.168 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1d is not active+clean 2024-06-02T22:53:43.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.168 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-06-02T22:53:43.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.169 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-06-02T22:53:43.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.169 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-06-02T22:53:43.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.169 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-06-02T22:53:43.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.169 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1a is not active+clean 2024-06-02T22:53:43.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.169 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-06-02T22:53:43.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.170 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-06-02T22:53:43.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.170 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-06-02T22:53:43.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.170 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-06-02T22:53:43.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.170 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-06-02T22:53:43.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.170 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-06-02T22:53:43.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.171 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-06-02T22:53:43.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.171 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-06-02T22:53:43.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.171 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-06-02T22:53:43.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.171 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-06-02T22:53:43.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.172 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-06-02T22:53:43.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.172 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-06-02T22:53:43.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.172 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-06-02T22:53:43.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.172 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-06-02T22:53:43.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.172 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-06-02T22:53:43.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.173 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-06-02T22:53:43.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.173 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-06-02T22:53:43.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.173 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-06-02T22:53:43.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.173 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-06-02T22:53:43.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.173 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-06-02T22:53:43.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.174 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-06-02T22:53:43.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.174 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-06-02T22:53:43.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.174 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-06-02T22:53:43.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.175 INFO:tasks.ceph.ceph_manager.ceph:PG 8.e is not active+clean 2024-06-02T22:53:43.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.175 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-06-02T22:53:43.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.175 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-06-02T22:53:43.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.175 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-06-02T22:53:43.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.175 INFO:tasks.ceph.ceph_manager.ceph:PG 8.c is not active+clean 2024-06-02T22:53:43.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.176 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-06-02T22:53:43.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.176 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-06-02T22:53:43.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.176 INFO:tasks.ceph.ceph_manager.ceph:PG 9.b is not active+clean 2024-06-02T22:53:43.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.176 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-06-02T22:53:43.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.176 INFO:tasks.ceph.ceph_manager.ceph:PG 9.9 is not active+clean 2024-06-02T22:53:43.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.176 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-06-02T22:53:43.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.177 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-06-02T22:53:43.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.177 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-06-02T22:53:43.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.177 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-06-02T22:53:43.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:PG 8.6 is not active+clean 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:PG 9.5 is not active+clean 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-06-02T22:53:43.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.179 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-06-02T22:53:43.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.179 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-06-02T22:53:43.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.179 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-06-02T22:53:43.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.180 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-06-02T22:53:43.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.180 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-06-02T22:53:43.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.180 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-06-02T22:53:43.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.180 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-06-02T22:53:43.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.180 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-06-02T22:53:43.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:38.497665+0000', 'last_change': '2024-06-02T22:53:38.497665+0000', 'last_active': '2024-06-02T22:53:38.497665+0000', 'last_peered': '2024-06-02T22:53:38.497665+0000', 'last_clean': '2024-06-02T22:53:38.497665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:38.497665+0000', 'last_undegraded': '2024-06-02T22:53:38.497665+0000', 'last_fullsized': '2024-06-02T22:53:38.497665+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:38.497665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.181 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-06-02T22:53:43.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T22:53:37.495765+0000', 'last_change': '2024-06-02T22:53:37.495765+0000', 'last_active': '2024-06-02T22:53:37.495765+0000', 'last_peered': '2024-06-02T22:53:37.495765+0000', 'last_clean': '2024-06-02T22:53:37.495765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T22:53:37.495765+0000', 'last_undegraded': '2024-06-02T22:53:37.495765+0000', 'last_fullsized': '2024-06-02T22:53:37.495765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'last_clean_scrub_stamp': '2024-06-02T22:53:37.495765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T22:53:43.181 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-02T22:53:43.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.296+0000 7fb2bcbed640 1 Processor -- start 2024-06-02T22:53:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.296+0000 7fb2bcbed640 1 -- start start 2024-06-02T22:53:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.296+0000 7fb2bcbed640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2b80cf360 0x7fb2b80b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.296+0000 7fb2bcbed640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b80b3420 con 0x7fb2b80cd230 2024-06-02T22:53:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.296+0000 7fb2bcbed640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b80cc750 con 0x7fb2b81553c0 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.296+0000 7fb2bcbed640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b80cca30 con 0x7fb2b80cf360 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2add9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb2b80cd230 0x7fb2b80cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52932/0 (socket says 172.21.15.82:52932) 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2add9b640 1 -- 172.21.15.82:0/94760801 learned_addr learned my addr 172.21.15.82:0/94760801 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b6d9d640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2b80cf360 0x7fb2b80b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 753761541 0 0) 0x7fb2b80b3420 con 0x7fb2b80cd230 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a4003520 con 0x7fb2b80cd230 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3274219949 0 0) 0x7fb2b80cc750 con 0x7fb2b81553c0 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2b80b3420 con 0x7fb2b81553c0 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2193661066 0 0) 0x7fb2a4003520 con 0x7fb2b80cd230 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2b80cf360 msgr2=0x7fb2b80b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2b80cf360 0x7fb2b80b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 >> v1:172.21.15.184:6789/0 conn(0x7fb2b81553c0 legacy=0x7fb2b815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b80ccd10 con 0x7fb2b80cd230 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fb2a0001670 con 0x7fb2b80cd230 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 >> v1:172.21.15.82:6789/0 conn(0x7fb2b80cd230 legacy=0x7fb2b80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2a4003b70 0x7fb2a4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2a4004800 0x7fb2a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2b80cf360 0x7fb2a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b80cca30 con 0x7fb2a4004800 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a400baa0 con 0x7fb2a4003b70 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a400bca0 con 0x7fb2b80cf360 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2add9b640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2a4004800 0x7fb2a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b659c640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2a4003b70 0x7fb2a4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.297+0000 7fb2b6d9d640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2b80cf360 0x7fb2a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.298+0000 7fb2add9b640 1 -- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2b80cf360 msgr2=0x7fb2a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.298+0000 7fb2add9b640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2b80cf360 0x7fb2a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.298+0000 7fb2add9b640 1 -- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2a4003b70 msgr2=0x7fb2a4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.298+0000 7fb2add9b640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2a4003b70 0x7fb2a4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.298+0000 7fb2add9b640 1 -- 172.21.15.82:0/94760801 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a4003520 con 0x7fb2a4004800 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.298+0000 7fb2b659c640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2a4003b70 0x7fb2a4003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.298+0000 7fb2add9b640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2a4004800 0x7fb2a4004c80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0007fc0 tx=0x7fb2a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a060091f8072c23 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.298+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0007be0 con 0x7fb2a4004800 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.298+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a0005af0 con 0x7fb2a4004800 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.298+0000 7fb2b5d9b640 1 -- 172.21.15.82:0/94760801 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0007070 con 0x7fb2a4004800 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.299+0000 7fb2bcbed640 1 -- 172.21.15.82:0/94760801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2a4004800 msgr2=0x7fb2a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.299+0000 7fb2bcbed640 1 --2- 172.21.15.82:0/94760801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2a4004800 0x7fb2a4004c80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0007fc0 tx=0x7fb2a4005830 comp rx=0 tx=0).stop 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.299+0000 7fb2b6d9d640 1 -- 172.21.15.82:0/94760801 reap_dead start 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.299+0000 7fb2bcbed640 1 -- 172.21.15.82:0/94760801 shutdown_connections 2024-06-02T22:53:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.299+0000 7fb2bcbed640 1 -- 172.21.15.82:0/94760801 >> 172.21.15.82:0/94760801 conn(0x7fb2b80b19f0 msgr2=0x7fb2b80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.299+0000 7fb2bcbed640 1 -- 172.21.15.82:0/94760801 shutdown_connections 2024-06-02T22:53:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.299+0000 7fb2bcbed640 1 -- 172.21.15.82:0/94760801 wait complete. 2024-06-02T22:53:43.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.300+0000 7fb2bcbed640 1 Processor -- start 2024-06-02T22:53:43.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.301+0000 7fb2bcbed640 1 -- start start 2024-06-02T22:53:43.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.301+0000 7fb2bcbed640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2a4004800 0x7fb2b80ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.301+0000 7fb2bcbed640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2b8140b20 0x7fb2b8157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.301+0000 7fb2bcbed640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2b8158000 0x7fb2b81431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.301+0000 7fb2bcbed640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b8155920 con 0x7fb2b8158000 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.301+0000 7fb2bcbed640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b81557a0 con 0x7fb2b8140b20 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.301+0000 7fb2bcbed640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b80b2cf0 con 0x7fb2a4004800 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.301+0000 7fb2b6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2b8158000 0x7fb2b81431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.301+0000 7fb2b6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2b8158000 0x7fb2b81431b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40794/0 (socket says 172.21.15.82:40794) 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.301+0000 7fb2b6d9d640 1 -- 172.21.15.82:0/2227869330 learned_addr learned my addr 172.21.15.82:0/2227869330 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.302+0000 7fb2b6d9d640 1 -- 172.21.15.82:0/2227869330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2a4004800 msgr2=0x7fb2b80ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.302+0000 7fb2b6d9d640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2a4004800 0x7fb2b80ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.302+0000 7fb2b6d9d640 1 -- 172.21.15.82:0/2227869330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2b8140b20 msgr2=0x7fb2b8157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.302+0000 7fb2b6d9d640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2b8140b20 0x7fb2b8157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.302+0000 7fb2b6d9d640 1 -- 172.21.15.82:0/2227869330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b81f62c0 con 0x7fb2b8158000 2024-06-02T22:53:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.302+0000 7fb2b6d9d640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2b8158000 0x7fb2b81431b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80b51c0 tx=0x7fb2b000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.302+0000 7fb2af7fe640 1 -- 172.21.15.82:0/2227869330 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0015430 con 0x7fb2b8158000 2024-06-02T22:53:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.302+0000 7fb2af7fe640 1 -- 172.21.15.82:0/2227869330 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b00155f0 con 0x7fb2b8158000 2024-06-02T22:53:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.302+0000 7fb2af7fe640 1 -- 172.21.15.82:0/2227869330 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00159e0 con 0x7fb2b8158000 2024-06-02T22:53:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.302+0000 7fb2bcbed640 1 -- 172.21.15.82:0/2227869330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b81f5740 con 0x7fb2b8158000 2024-06-02T22:53:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.302+0000 7fb2bcbed640 1 -- 172.21.15.82:0/2227869330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b81f5d00 con 0x7fb2b8158000 2024-06-02T22:53:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.303+0000 7fb2bcbed640 1 -- 172.21.15.82:0/2227869330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b8068430 con 0x7fb2b8158000 2024-06-02T22:53:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.303+0000 7fb2af7fe640 1 -- 172.21.15.82:0/2227869330 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2b0015b80 con 0x7fb2b8158000 2024-06-02T22:53:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.304+0000 7fb2af7fe640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29806be30 0x7fb29806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.304+0000 7fb2af7fe640 1 -- 172.21.15.82:0/2227869330 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fb2b008bf20 con 0x7fb2b8158000 2024-06-02T22:53:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.304+0000 7fb2b659c640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29806be30 0x7fb29806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.304+0000 7fb2b659c640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29806be30 0x7fb29806e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8001650 tx=0x7fb2a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.308+0000 7fb2af7fe640 1 -- 172.21.15.82:0/2227869330 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb2b0019030 con 0x7fb2b8158000 2024-06-02T22:53:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.549+0000 7fb2bcbed640 1 -- 172.21.15.82:0/2227869330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb2b8074e10 con 0x7fb2b8158000 2024-06-02T22:53:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.550+0000 7fb2af7fe640 1 -- 172.21.15.82:0/2227869330 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1571 (secure 0 0 0) 0x7fb2b0010040 con 0x7fb2b8158000 2024-06-02T22:53:43.550 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:43.550 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":123,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1717368710,"num_in_osds":8,"osd_in_since":1717368701,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":227172352,"bytes_avail":772866940928,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":23,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5403}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-06-02T22:52:53.832860+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-06-02T22:53:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.551+0000 7fb2bcbed640 1 -- 172.21.15.82:0/2227869330 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29806be30 msgr2=0x7fb29806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.551+0000 7fb2bcbed640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29806be30 0x7fb29806e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8001650 tx=0x7fb2a8009040 comp rx=0 tx=0).stop 2024-06-02T22:53:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.551+0000 7fb2bcbed640 1 -- 172.21.15.82:0/2227869330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2b8158000 msgr2=0x7fb2b81431b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.551+0000 7fb2bcbed640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2b8158000 0x7fb2b81431b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80b51c0 tx=0x7fb2b000f580 comp rx=0 tx=0).stop 2024-06-02T22:53:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.552+0000 7fb2bcbed640 1 -- 172.21.15.82:0/2227869330 shutdown_connections 2024-06-02T22:53:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.552+0000 7fb2bcbed640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb29806be30 0x7fb29806e2f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.552+0000 7fb2bcbed640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2b8158000 0x7fb2b81431b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.552+0000 7fb2bcbed640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2b8140b20 0x7fb2b8157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.552+0000 7fb2bcbed640 1 --2- 172.21.15.82:0/2227869330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2a4004800 0x7fb2b80ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.552+0000 7fb2bcbed640 1 -- 172.21.15.82:0/2227869330 >> 172.21.15.82:0/2227869330 conn(0x7fb2b80b19f0 msgr2=0x7fb2b80af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.552+0000 7fb2bcbed640 1 -- 172.21.15.82:0/2227869330 shutdown_connections 2024-06-02T22:53:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.552+0000 7fb2bcbed640 1 -- 172.21.15.82:0/2227869330 wait complete. 2024-06-02T22:53:43.562 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-06-02T22:53:43.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:53:43.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.662+0000 7f6784488640 1 Processor -- start 2024-06-02T22:53:43.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.662+0000 7f6784488640 1 -- start start 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.663+0000 7f6784488640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f677c0add50 0x7f677c165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.663+0000 7f6784488640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f677c06d130 con 0x7f677c0ae910 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.663+0000 7f6784488640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f677c06d410 con 0x7f677c06ebf0 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.663+0000 7f6784488640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f677c06d6f0 con 0x7f677c0add50 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.663+0000 7f6782224640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f677c0ae910 0x7f677c06e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52940/0 (socket says 172.21.15.82:52940) 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.663+0000 7f6782224640 1 -- 172.21.15.82:0/1465904557 learned_addr learned my addr 172.21.15.82:0/1465904557 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.663+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 769877249 0 0) 0x7f677c06d130 con 0x7f677c0ae910 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.663+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6768003520 con 0x7f677c0ae910 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.663+0000 7f6782a25640 1 --2- 172.21.15.82:0/1465904557 >> v2:172.21.15.184:3300/0 conn(0x7f677c0add50 0x7f677c165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1770071661 0 0) 0x7f6768003520 con 0x7f677c0ae910 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 >> v2:172.21.15.184:3300/0 conn(0x7f677c0add50 msgr2=0x7f677c165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:43.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 --2- 172.21.15.82:0/1465904557 >> v2:172.21.15.184:3300/0 conn(0x7f677c0add50 0x7f677c165c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 >> v1:172.21.15.184:6789/0 conn(0x7f677c06ebf0 legacy=0x7f677c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677c06d9d0 con 0x7f677c0ae910 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f6778001670 con 0x7f677c0ae910 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 >> v1:172.21.15.82:6789/0 conn(0x7f677c0ae910 legacy=0x7f677c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67680039b0 0x7f6768003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6768004800 0x7f6768004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 0x7f676800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f677c06d6f0 con 0x7f67680052e0 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f676800c1b0 con 0x7f6768004800 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f676800c3b0 con 0x7f67680039b0 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6782a25640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 0x7f676800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6782224640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67680039b0 0x7f6768003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6781a23640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6768004800 0x7f6768004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6782a25640 1 -- 172.21.15.82:0/1465904557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67680039b0 msgr2=0x7f6768003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:43.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6782a25640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67680039b0 0x7f6768003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6782a25640 1 -- 172.21.15.82:0/1465904557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6768004800 msgr2=0x7f6768004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:43.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6782a25640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6768004800 0x7f6768004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6782a25640 1 -- 172.21.15.82:0/1465904557 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6768003520 con 0x7f67680052e0 2024-06-02T22:53:43.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.664+0000 7f6782224640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67680039b0 0x7f6768003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:43.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.665+0000 7f6782a25640 1 -- 172.21.15.82:0/1465904557 reap_dead start 2024-06-02T22:53:43.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.665+0000 7f6782a25640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 0x7f676800b9c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6774007330 tx=0x7f6768005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa4c5fab6f17023 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:43.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.665+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774009be0 con 0x7f67680052e0 2024-06-02T22:53:43.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.665+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6774003b90 con 0x7f67680052e0 2024-06-02T22:53:43.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.665+0000 7f6781222640 1 -- 172.21.15.82:0/1465904557 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774004020 con 0x7f67680052e0 2024-06-02T22:53:43.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.665+0000 7f6784488640 1 -- 172.21.15.82:0/1465904557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 msgr2=0x7f676800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.665+0000 7f6784488640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 0x7f676800b9c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6774007330 tx=0x7f6768005830 comp rx=0 tx=0).stop 2024-06-02T22:53:43.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.666+0000 7f6784488640 1 -- 172.21.15.82:0/1465904557 shutdown_connections 2024-06-02T22:53:43.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.666+0000 7f6784488640 1 --2- 172.21.15.82:0/1465904557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 0x7f676800b9c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.666+0000 7f6784488640 1 -- 172.21.15.82:0/1465904557 >> 172.21.15.82:0/1465904557 conn(0x7f677c0b19f0 msgr2=0x7f677c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.666+0000 7f6784488640 1 -- 172.21.15.82:0/1465904557 shutdown_connections 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.666+0000 7f6784488640 1 -- 172.21.15.82:0/1465904557 wait complete. 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.667+0000 7f6784488640 1 Processor -- start 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.667+0000 7f6784488640 1 -- start start 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.667+0000 7f6784488640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 0x7f677c15e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.667+0000 7f6784488640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c14a800 0x7f677c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.667+0000 7f6784488640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f677c1473e0 0x7f677c147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.667+0000 7f6784488640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f677c06e660 con 0x7f67680052e0 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.667+0000 7f6784488640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f677c06e4e0 con 0x7f677c1473e0 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.667+0000 7f6784488640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f677c06e7e0 con 0x7f677c14a800 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6782224640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 0x7f677c15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6782224640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 0x7f677c15e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40816/0 (socket says 172.21.15.82:40816) 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6782224640 1 -- 172.21.15.82:0/1691130289 learned_addr learned my addr 172.21.15.82:0/1691130289 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6782224640 1 -- 172.21.15.82:0/1691130289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c14a800 msgr2=0x7f677c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6781a23640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c14a800 0x7f677c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6782a25640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f677c1473e0 0x7f677c147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6782224640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c14a800 0x7f677c15a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6782224640 1 -- 172.21.15.82:0/1691130289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f677c1473e0 msgr2=0x7f677c147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6782224640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f677c1473e0 0x7f677c147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6782224640 1 -- 172.21.15.82:0/1691130289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677c15cf80 con 0x7f67680052e0 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6782224640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 0x7f677c15e020 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f677800e760 tx=0x7f677800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6772ffd640 1 -- 172.21.15.82:0/1691130289 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677800ee70 con 0x7f67680052e0 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6772ffd640 1 -- 172.21.15.82:0/1691130289 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6778018070 con 0x7f67680052e0 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6784488640 1 -- 172.21.15.82:0/1691130289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677c15d260 con 0x7f67680052e0 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6772ffd640 1 -- 172.21.15.82:0/1691130289 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677800ca90 con 0x7f67680052e0 2024-06-02T22:53:43.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.668+0000 7f6784488640 1 -- 172.21.15.82:0/1691130289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f677c15d820 con 0x7f67680052e0 2024-06-02T22:53:43.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.669+0000 7f6784488640 1 -- 172.21.15.82:0/1691130289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f677c068430 con 0x7f67680052e0 2024-06-02T22:53:43.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.670+0000 7f6772ffd640 1 -- 172.21.15.82:0/1691130289 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f677800cc30 con 0x7f67680052e0 2024-06-02T22:53:43.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.670+0000 7f6772ffd640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f676006be60 0x7f676006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:43.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.670+0000 7f6781a23640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f676006be60 0x7f676006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:43.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.670+0000 7f6772ffd640 1 -- 172.21.15.82:0/1691130289 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f677808ab30 con 0x7f67680052e0 2024-06-02T22:53:43.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.671+0000 7f6781a23640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f676006be60 0x7f676006e320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f676c000c00 tx=0x7f676c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:43.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.675+0000 7f6772ffd640 1 -- 172.21.15.82:0/1691130289 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6778059350 con 0x7f67680052e0 2024-06-02T22:53:43.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.846+0000 7f6784488640 1 -- 172.21.15.82:0/1691130289 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f677c09dc70 con 0x7f676006be60 2024-06-02T22:53:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.853+0000 7f6772ffd640 1 -- 172.21.15.82:0/1691130289 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251954 (secure 0 0 0) 0x7f677c09dc70 con 0x7f676006be60 2024-06-02T22:53:43.855 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:43.856 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:53:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.855+0000 7f6784488640 1 -- 172.21.15.82:0/1691130289 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f676006be60 msgr2=0x7f676006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.855+0000 7f6784488640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f676006be60 0x7f676006e320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f676c000c00 tx=0x7f676c009040 comp rx=0 tx=0).stop 2024-06-02T22:53:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.855+0000 7f6784488640 1 -- 172.21.15.82:0/1691130289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 msgr2=0x7f677c15e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.855+0000 7f6784488640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 0x7f677c15e020 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f677800e760 tx=0x7f677800ec20 comp rx=0 tx=0).stop 2024-06-02T22:53:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.856+0000 7f6784488640 1 -- 172.21.15.82:0/1691130289 shutdown_connections 2024-06-02T22:53:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.856+0000 7f6784488640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f676006be60 0x7f676006e320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.856+0000 7f6784488640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f677c1473e0 0x7f677c147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.856+0000 7f6784488640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f677c14a800 0x7f677c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.856+0000 7f6784488640 1 --2- 172.21.15.82:0/1691130289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67680052e0 0x7f677c15e020 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:43.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.856+0000 7f6784488640 1 -- 172.21.15.82:0/1691130289 >> 172.21.15.82:0/1691130289 conn(0x7f677c0b19f0 msgr2=0x7f677c071940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:43.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.856+0000 7f6784488640 1 -- 172.21.15.82:0/1691130289 shutdown_connections 2024-06-02T22:53:43.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:43.856+0000 7f6784488640 1 -- 172.21.15.82:0/1691130289 wait complete. 2024-06-02T22:53:43.866 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-06-02T22:53:43.844183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222452,"kb_used_data":6244,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752268,"statfs":{"total":773094113280,"available":772866322432,"internally_reserved":0,"allocated":6393856,"data_stored":3499696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001097"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329680+0000","last_change":"2024-06-02T22:53:39.229801+0000","last_active":"2024-06-02T22:53:41.329680+0000","last_peered":"2024-06-02T22:53:41.329680+0000","last_clean":"2024-06-02T22:53:41.329680+0000","last_became_active":"2024-06-02T22:53:39.229550+0000","last_became_peered":"2024-06-02T22:53:39.229550+0000","last_unstale":"2024-06-02T22:53:41.329680+0000","last_undegraded":"2024-06-02T22:53:41.329680+0000","last_fullsized":"2024-06-02T22:53:41.329680+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:47.102349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330074+0000","last_change":"2024-06-02T22:53:39.226821+0000","last_active":"2024-06-02T22:53:41.330074+0000","last_peered":"2024-06-02T22:53:41.330074+0000","last_clean":"2024-06-02T22:53:41.330074+0000","last_became_active":"2024-06-02T22:53:39.226527+0000","last_became_peered":"2024-06-02T22:53:39.226527+0000","last_unstale":"2024-06-02T22:53:41.330074+0000","last_undegraded":"2024-06-02T22:53:41.330074+0000","last_fullsized":"2024-06-02T22:53:41.330074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:28:06.448260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681951+0000","last_change":"2024-06-02T22:53:39.236715+0000","last_active":"2024-06-02T22:53:40.681951+0000","last_peered":"2024-06-02T22:53:40.681951+0000","last_clean":"2024-06-02T22:53:40.681951+0000","last_became_active":"2024-06-02T22:53:39.236395+0000","last_became_peered":"2024-06-02T22:53:39.236395+0000","last_unstale":"2024-06-02T22:53:40.681951+0000","last_undegraded":"2024-06-02T22:53:40.681951+0000","last_fullsized":"2024-06-02T22:53:40.681951+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:05:10.982237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370537+0000","last_change":"2024-06-02T22:53:39.230699+0000","last_active":"2024-06-02T22:53:40.370537+0000","last_peered":"2024-06-02T22:53:40.370537+0000","last_clean":"2024-06-02T22:53:40.370537+0000","last_became_active":"2024-06-02T22:53:39.230377+0000","last_became_peered":"2024-06-02T22:53:39.230377+0000","last_unstale":"2024-06-02T22:53:40.370537+0000","last_undegraded":"2024-06-02T22:53:40.370537+0000","last_fullsized":"2024-06-02T22:53:40.370537+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:25:24.155798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329541+0000","last_change":"2024-06-02T22:53:39.222421+0000","last_active":"2024-06-02T22:53:41.329541+0000","last_peered":"2024-06-02T22:53:41.329541+0000","last_clean":"2024-06-02T22:53:41.329541+0000","last_became_active":"2024-06-02T22:53:39.222152+0000","last_became_peered":"2024-06-02T22:53:39.222152+0000","last_unstale":"2024-06-02T22:53:41.329541+0000","last_undegraded":"2024-06-02T22:53:41.329541+0000","last_fullsized":"2024-06-02T22:53:41.329541+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:41.233138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330151+0000","last_change":"2024-06-02T22:53:39.224031+0000","last_active":"2024-06-02T22:53:41.330151+0000","last_peered":"2024-06-02T22:53:41.330151+0000","last_clean":"2024-06-02T22:53:41.330151+0000","last_became_active":"2024-06-02T22:53:39.223512+0000","last_became_peered":"2024-06-02T22:53:39.223512+0000","last_unstale":"2024-06-02T22:53:41.330151+0000","last_undegraded":"2024-06-02T22:53:41.330151+0000","last_fullsized":"2024-06-02T22:53:41.330151+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:08:46.066561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217525+0000","last_change":"2024-06-02T22:53:39.223058+0000","last_active":"2024-06-02T22:53:40.217525+0000","last_peered":"2024-06-02T22:53:40.217525+0000","last_clean":"2024-06-02T22:53:40.217525+0000","last_became_active":"2024-06-02T22:53:39.222788+0000","last_became_peered":"2024-06-02T22:53:39.222788+0000","last_unstale":"2024-06-02T22:53:40.217525+0000","last_undegraded":"2024-06-02T22:53:40.217525+0000","last_fullsized":"2024-06-02T22:53:40.217525+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:15:22.317641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329872+0000","last_change":"2024-06-02T22:53:39.232404+0000","last_active":"2024-06-02T22:53:41.329872+0000","last_peered":"2024-06-02T22:53:41.329872+0000","last_clean":"2024-06-02T22:53:41.329872+0000","last_became_active":"2024-06-02T22:53:39.232155+0000","last_became_peered":"2024-06-02T22:53:39.232155+0000","last_unstale":"2024-06-02T22:53:41.329872+0000","last_undegraded":"2024-06-02T22:53:41.329872+0000","last_fullsized":"2024-06-02T22:53:41.329872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:33.568403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217784+0000","last_change":"2024-06-02T22:53:39.222118+0000","last_active":"2024-06-02T22:53:40.217784+0000","last_peered":"2024-06-02T22:53:40.217784+0000","last_clean":"2024-06-02T22:53:40.217784+0000","last_became_active":"2024-06-02T22:53:39.221837+0000","last_became_peered":"2024-06-02T22:53:39.221837+0000","last_unstale":"2024-06-02T22:53:40.217784+0000","last_undegraded":"2024-06-02T22:53:40.217784+0000","last_fullsized":"2024-06-02T22:53:40.217784+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:00.375651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217007+0000","last_change":"2024-06-02T22:53:39.220238+0000","last_active":"2024-06-02T22:53:40.217007+0000","last_peered":"2024-06-02T22:53:40.217007+0000","last_clean":"2024-06-02T22:53:40.217007+0000","last_became_active":"2024-06-02T22:53:39.219984+0000","last_became_peered":"2024-06-02T22:53:39.219984+0000","last_unstale":"2024-06-02T22:53:40.217007+0000","last_undegraded":"2024-06-02T22:53:40.217007+0000","last_fullsized":"2024-06-02T22:53:40.217007+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:43.041962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216824+0000","last_change":"2024-06-02T22:53:39.227116+0000","last_active":"2024-06-02T22:53:40.216824+0000","last_peered":"2024-06-02T22:53:40.216824+0000","last_clean":"2024-06-02T22:53:40.216824+0000","last_became_active":"2024-06-02T22:53:39.226860+0000","last_became_peered":"2024-06-02T22:53:39.226860+0000","last_unstale":"2024-06-02T22:53:40.216824+0000","last_undegraded":"2024-06-02T22:53:40.216824+0000","last_fullsized":"2024-06-02T22:53:40.216824+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:00.375651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370535+0000","last_change":"2024-06-02T22:53:39.229861+0000","last_active":"2024-06-02T22:53:40.370535+0000","last_peered":"2024-06-02T22:53:40.370535+0000","last_clean":"2024-06-02T22:53:40.370535+0000","last_became_active":"2024-06-02T22:53:39.229587+0000","last_became_peered":"2024-06-02T22:53:39.229587+0000","last_unstale":"2024-06-02T22:53:40.370535+0000","last_undegraded":"2024-06-02T22:53:40.370535+0000","last_fullsized":"2024-06-02T22:53:40.370535+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:43:24.396305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218361+0000","last_change":"2024-06-02T22:53:39.220077+0000","last_active":"2024-06-02T22:53:40.218361+0000","last_peered":"2024-06-02T22:53:40.218361+0000","last_clean":"2024-06-02T22:53:40.218361+0000","last_became_active":"2024-06-02T22:53:39.219751+0000","last_became_peered":"2024-06-02T22:53:39.219751+0000","last_unstale":"2024-06-02T22:53:40.218361+0000","last_undegraded":"2024-06-02T22:53:40.218361+0000","last_fullsized":"2024-06-02T22:53:40.218361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:50.567016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217902+0000","last_change":"2024-06-02T22:53:39.225797+0000","last_active":"2024-06-02T22:53:40.217902+0000","last_peered":"2024-06-02T22:53:40.217902+0000","last_clean":"2024-06-02T22:53:40.217902+0000","last_became_active":"2024-06-02T22:53:39.225538+0000","last_became_peered":"2024-06-02T22:53:39.225538+0000","last_unstale":"2024-06-02T22:53:40.217902+0000","last_undegraded":"2024-06-02T22:53:40.217902+0000","last_fullsized":"2024-06-02T22:53:40.217902+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:05:18.549306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217677+0000","last_change":"2024-06-02T22:53:39.218569+0000","last_active":"2024-06-02T22:53:40.217677+0000","last_peered":"2024-06-02T22:53:40.217677+0000","last_clean":"2024-06-02T22:53:40.217677+0000","last_became_active":"2024-06-02T22:53:39.217921+0000","last_became_peered":"2024-06-02T22:53:39.217921+0000","last_unstale":"2024-06-02T22:53:40.217677+0000","last_undegraded":"2024-06-02T22:53:40.217677+0000","last_fullsized":"2024-06-02T22:53:40.217677+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:34.437279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330814+0000","last_change":"2024-06-02T22:53:39.226767+0000","last_active":"2024-06-02T22:53:41.330814+0000","last_peered":"2024-06-02T22:53:41.330814+0000","last_clean":"2024-06-02T22:53:41.330814+0000","last_became_active":"2024-06-02T22:53:39.225677+0000","last_became_peered":"2024-06-02T22:53:39.225677+0000","last_unstale":"2024-06-02T22:53:41.330814+0000","last_undegraded":"2024-06-02T22:53:41.330814+0000","last_fullsized":"2024-06-02T22:53:41.330814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:13:01.894721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330304+0000","last_change":"2024-06-02T22:53:39.228364+0000","last_active":"2024-06-02T22:53:41.330304+0000","last_peered":"2024-06-02T22:53:41.330304+0000","last_clean":"2024-06-02T22:53:41.330304+0000","last_became_active":"2024-06-02T22:53:39.228116+0000","last_became_peered":"2024-06-02T22:53:39.228116+0000","last_unstale":"2024-06-02T22:53:41.330304+0000","last_undegraded":"2024-06-02T22:53:41.330304+0000","last_fullsized":"2024-06-02T22:53:41.330304+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:15:58.297664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682116+0000","last_change":"2024-06-02T22:53:39.228280+0000","last_active":"2024-06-02T22:53:40.682116+0000","last_peered":"2024-06-02T22:53:40.682116+0000","last_clean":"2024-06-02T22:53:40.682116+0000","last_became_active":"2024-06-02T22:53:39.227900+0000","last_became_peered":"2024-06-02T22:53:39.227900+0000","last_unstale":"2024-06-02T22:53:40.682116+0000","last_undegraded":"2024-06-02T22:53:40.682116+0000","last_fullsized":"2024-06-02T22:53:40.682116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:44:43.528239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329656+0000","last_change":"2024-06-02T22:53:39.230261+0000","last_active":"2024-06-02T22:53:41.329656+0000","last_peered":"2024-06-02T22:53:41.329656+0000","last_clean":"2024-06-02T22:53:41.329656+0000","last_became_active":"2024-06-02T22:53:39.230019+0000","last_became_peered":"2024-06-02T22:53:39.230019+0000","last_unstale":"2024-06-02T22:53:41.329656+0000","last_undegraded":"2024-06-02T22:53:41.329656+0000","last_fullsized":"2024-06-02T22:53:41.329656+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:43:34.729351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330290+0000","last_change":"2024-06-02T22:53:39.230447+0000","last_active":"2024-06-02T22:53:41.330290+0000","last_peered":"2024-06-02T22:53:41.330290+0000","last_clean":"2024-06-02T22:53:41.330290+0000","last_became_active":"2024-06-02T22:53:39.230139+0000","last_became_peered":"2024-06-02T22:53:39.230139+0000","last_unstale":"2024-06-02T22:53:41.330290+0000","last_undegraded":"2024-06-02T22:53:41.330290+0000","last_fullsized":"2024-06-02T22:53:41.330290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:23:27.432198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681750+0000","last_change":"2024-06-02T22:53:39.237669+0000","last_active":"2024-06-02T22:53:40.681750+0000","last_peered":"2024-06-02T22:53:40.681750+0000","last_clean":"2024-06-02T22:53:40.681750+0000","last_became_active":"2024-06-02T22:53:39.237322+0000","last_became_peered":"2024-06-02T22:53:39.237322+0000","last_unstale":"2024-06-02T22:53:40.681750+0000","last_undegraded":"2024-06-02T22:53:40.681750+0000","last_fullsized":"2024-06-02T22:53:40.681750+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:05.997684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329892+0000","last_change":"2024-06-02T22:53:39.231342+0000","last_active":"2024-06-02T22:53:41.329892+0000","last_peered":"2024-06-02T22:53:41.329892+0000","last_clean":"2024-06-02T22:53:41.329892+0000","last_became_active":"2024-06-02T22:53:39.231066+0000","last_became_peered":"2024-06-02T22:53:39.231066+0000","last_unstale":"2024-06-02T22:53:41.329892+0000","last_undegraded":"2024-06-02T22:53:41.329892+0000","last_fullsized":"2024-06-02T22:53:41.329892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:44:37.835649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681811+0000","last_change":"2024-06-02T22:53:39.238588+0000","last_active":"2024-06-02T22:53:40.681811+0000","last_peered":"2024-06-02T22:53:40.681811+0000","last_clean":"2024-06-02T22:53:40.681811+0000","last_became_active":"2024-06-02T22:53:39.237590+0000","last_became_peered":"2024-06-02T22:53:39.237590+0000","last_unstale":"2024-06-02T22:53:40.681811+0000","last_undegraded":"2024-06-02T22:53:40.681811+0000","last_fullsized":"2024-06-02T22:53:40.681811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:13:01.894721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218159+0000","last_change":"2024-06-02T22:53:39.223653+0000","last_active":"2024-06-02T22:53:40.218159+0000","last_peered":"2024-06-02T22:53:40.218159+0000","last_clean":"2024-06-02T22:53:40.218159+0000","last_became_active":"2024-06-02T22:53:39.223381+0000","last_became_peered":"2024-06-02T22:53:39.223381+0000","last_unstale":"2024-06-02T22:53:40.218159+0000","last_undegraded":"2024-06-02T22:53:40.218159+0000","last_fullsized":"2024-06-02T22:53:40.218159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:48.891951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329712+0000","last_change":"2024-06-02T22:53:39.226486+0000","last_active":"2024-06-02T22:53:41.329712+0000","last_peered":"2024-06-02T22:53:41.329712+0000","last_clean":"2024-06-02T22:53:41.329712+0000","last_became_active":"2024-06-02T22:53:39.226223+0000","last_became_peered":"2024-06-02T22:53:39.226223+0000","last_unstale":"2024-06-02T22:53:41.329712+0000","last_undegraded":"2024-06-02T22:53:41.329712+0000","last_fullsized":"2024-06-02T22:53:41.329712+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:25:27.058614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370469+0000","last_change":"2024-06-02T22:53:39.231112+0000","last_active":"2024-06-02T22:53:40.370469+0000","last_peered":"2024-06-02T22:53:40.370469+0000","last_clean":"2024-06-02T22:53:40.370469+0000","last_became_active":"2024-06-02T22:53:39.230764+0000","last_became_peered":"2024-06-02T22:53:39.230764+0000","last_unstale":"2024-06-02T22:53:40.370469+0000","last_undegraded":"2024-06-02T22:53:40.370469+0000","last_fullsized":"2024-06-02T22:53:40.370469+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:08:46.066561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330611+0000","last_change":"2024-06-02T22:53:39.225929+0000","last_active":"2024-06-02T22:53:41.330611+0000","last_peered":"2024-06-02T22:53:41.330611+0000","last_clean":"2024-06-02T22:53:41.330611+0000","last_became_active":"2024-06-02T22:53:39.225412+0000","last_became_peered":"2024-06-02T22:53:39.225412+0000","last_unstale":"2024-06-02T22:53:41.330611+0000","last_undegraded":"2024-06-02T22:53:41.330611+0000","last_fullsized":"2024-06-02T22:53:41.330611+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:34:27.118218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329695+0000","last_change":"2024-06-02T22:53:39.231770+0000","last_active":"2024-06-02T22:53:41.329695+0000","last_peered":"2024-06-02T22:53:41.329695+0000","last_clean":"2024-06-02T22:53:41.329695+0000","last_became_active":"2024-06-02T22:53:39.231418+0000","last_became_peered":"2024-06-02T22:53:39.231418+0000","last_unstale":"2024-06-02T22:53:41.329695+0000","last_undegraded":"2024-06-02T22:53:41.329695+0000","last_fullsized":"2024-06-02T22:53:41.329695+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:15:57.043235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330407+0000","last_change":"2024-06-02T22:53:39.226619+0000","last_active":"2024-06-02T22:53:41.330407+0000","last_peered":"2024-06-02T22:53:41.330407+0000","last_clean":"2024-06-02T22:53:41.330407+0000","last_became_active":"2024-06-02T22:53:39.225946+0000","last_became_peered":"2024-06-02T22:53:39.225946+0000","last_unstale":"2024-06-02T22:53:41.330407+0000","last_undegraded":"2024-06-02T22:53:41.330407+0000","last_fullsized":"2024-06-02T22:53:41.330407+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:59:30.098876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681743+0000","last_change":"2024-06-02T22:53:39.237697+0000","last_active":"2024-06-02T22:53:40.681743+0000","last_peered":"2024-06-02T22:53:40.681743+0000","last_clean":"2024-06-02T22:53:40.681743+0000","last_became_active":"2024-06-02T22:53:39.236964+0000","last_became_peered":"2024-06-02T22:53:39.236964+0000","last_unstale":"2024-06-02T22:53:40.681743+0000","last_undegraded":"2024-06-02T22:53:40.681743+0000","last_fullsized":"2024-06-02T22:53:40.681743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:09:25.874398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329509+0000","last_change":"2024-06-02T22:53:39.222767+0000","last_active":"2024-06-02T22:53:41.329509+0000","last_peered":"2024-06-02T22:53:41.329509+0000","last_clean":"2024-06-02T22:53:41.329509+0000","last_became_active":"2024-06-02T22:53:39.222498+0000","last_became_peered":"2024-06-02T22:53:39.222498+0000","last_unstale":"2024-06-02T22:53:41.329509+0000","last_undegraded":"2024-06-02T22:53:41.329509+0000","last_fullsized":"2024-06-02T22:53:41.329509+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:13:01.891277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330966+0000","last_change":"2024-06-02T22:53:39.225434+0000","last_active":"2024-06-02T22:53:41.330966+0000","last_peered":"2024-06-02T22:53:41.330966+0000","last_clean":"2024-06-02T22:53:41.330966+0000","last_became_active":"2024-06-02T22:53:39.225082+0000","last_became_peered":"2024-06-02T22:53:39.225082+0000","last_unstale":"2024-06-02T22:53:41.330966+0000","last_undegraded":"2024-06-02T22:53:41.330966+0000","last_fullsized":"2024-06-02T22:53:41.330966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:05:10.982237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330713+0000","last_change":"2024-06-02T22:53:39.229166+0000","last_active":"2024-06-02T22:53:41.330713+0000","last_peered":"2024-06-02T22:53:41.330713+0000","last_clean":"2024-06-02T22:53:41.330713+0000","last_became_active":"2024-06-02T22:53:39.228798+0000","last_became_peered":"2024-06-02T22:53:39.228798+0000","last_unstale":"2024-06-02T22:53:41.330713+0000","last_undegraded":"2024-06-02T22:53:41.330713+0000","last_fullsized":"2024-06-02T22:53:41.330713+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:05.997684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330716+0000","last_change":"2024-06-02T22:53:38.522751+0000","last_active":"2024-06-02T22:53:41.330716+0000","last_peered":"2024-06-02T22:53:41.330716+0000","last_clean":"2024-06-02T22:53:41.330716+0000","last_became_active":"2024-06-02T22:53:38.522361+0000","last_became_peered":"2024-06-02T22:53:38.522361+0000","last_unstale":"2024-06-02T22:53:41.330716+0000","last_undegraded":"2024-06-02T22:53:41.330716+0000","last_fullsized":"2024-06-02T22:53:41.330716+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:15:21.315741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216885+0000","last_change":"2024-06-02T22:53:39.228688+0000","last_active":"2024-06-02T22:53:40.216885+0000","last_peered":"2024-06-02T22:53:40.216885+0000","last_clean":"2024-06-02T22:53:40.216885+0000","last_became_active":"2024-06-02T22:53:39.228455+0000","last_became_peered":"2024-06-02T22:53:39.228455+0000","last_unstale":"2024-06-02T22:53:40.216885+0000","last_undegraded":"2024-06-02T22:53:40.216885+0000","last_fullsized":"2024-06-02T22:53:40.216885+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:05:18.549306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330171+0000","last_change":"2024-06-02T22:53:38.522514+0000","last_active":"2024-06-02T22:53:41.330171+0000","last_peered":"2024-06-02T22:53:41.330171+0000","last_clean":"2024-06-02T22:53:41.330171+0000","last_became_active":"2024-06-02T22:53:38.522215+0000","last_became_peered":"2024-06-02T22:53:38.522215+0000","last_unstale":"2024-06-02T22:53:41.330171+0000","last_undegraded":"2024-06-02T22:53:41.330171+0000","last_fullsized":"2024-06-02T22:53:41.330171+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:08:45.064661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330583+0000","last_change":"2024-06-02T22:53:39.220368+0000","last_active":"2024-06-02T22:53:41.330583+0000","last_peered":"2024-06-02T22:53:41.330583+0000","last_clean":"2024-06-02T22:53:41.330583+0000","last_became_active":"2024-06-02T22:53:39.220073+0000","last_became_peered":"2024-06-02T22:53:39.220073+0000","last_unstale":"2024-06-02T22:53:41.330583+0000","last_undegraded":"2024-06-02T22:53:41.330583+0000","last_fullsized":"2024-06-02T22:53:41.330583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:25:24.155798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330824+0000","last_change":"2024-06-02T22:53:38.521131+0000","last_active":"2024-06-02T22:53:41.330824+0000","last_peered":"2024-06-02T22:53:41.330824+0000","last_clean":"2024-06-02T22:53:41.330824+0000","last_became_active":"2024-06-02T22:53:38.520810+0000","last_became_peered":"2024-06-02T22:53:38.520810+0000","last_unstale":"2024-06-02T22:53:41.330824+0000","last_undegraded":"2024-06-02T22:53:41.330824+0000","last_fullsized":"2024-06-02T22:53:41.330824+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:05:17.547407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330743+0000","last_change":"2024-06-02T22:53:39.223944+0000","last_active":"2024-06-02T22:53:41.330743+0000","last_peered":"2024-06-02T22:53:41.330743+0000","last_clean":"2024-06-02T22:53:41.330743+0000","last_became_active":"2024-06-02T22:53:39.223376+0000","last_became_peered":"2024-06-02T22:53:39.223376+0000","last_unstale":"2024-06-02T22:53:41.330743+0000","last_undegraded":"2024-06-02T22:53:41.330743+0000","last_fullsized":"2024-06-02T22:53:41.330743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:51:00.587950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370648+0000","last_change":"2024-06-02T22:53:38.522297+0000","last_active":"2024-06-02T22:53:40.370648+0000","last_peered":"2024-06-02T22:53:40.370648+0000","last_clean":"2024-06-02T22:53:40.370648+0000","last_became_active":"2024-06-02T22:53:38.521981+0000","last_became_peered":"2024-06-02T22:53:38.521981+0000","last_unstale":"2024-06-02T22:53:40.370648+0000","last_undegraded":"2024-06-02T22:53:40.370648+0000","last_fullsized":"2024-06-02T22:53:40.370648+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:42.040063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330835+0000","last_change":"2024-06-02T22:53:39.231298+0000","last_active":"2024-06-02T22:53:41.330835+0000","last_peered":"2024-06-02T22:53:41.330835+0000","last_clean":"2024-06-02T22:53:41.330835+0000","last_became_active":"2024-06-02T22:53:39.230730+0000","last_became_peered":"2024-06-02T22:53:39.230730+0000","last_unstale":"2024-06-02T22:53:41.330835+0000","last_undegraded":"2024-06-02T22:53:41.330835+0000","last_fullsized":"2024-06-02T22:53:41.330835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:06:06.067588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217730+0000","last_change":"2024-06-02T22:53:38.520747+0000","last_active":"2024-06-02T22:53:40.217730+0000","last_peered":"2024-06-02T22:53:40.217730+0000","last_clean":"2024-06-02T22:53:40.217730+0000","last_became_active":"2024-06-02T22:53:38.520520+0000","last_became_peered":"2024-06-02T22:53:38.520520+0000","last_unstale":"2024-06-02T22:53:40.217730+0000","last_undegraded":"2024-06-02T22:53:40.217730+0000","last_fullsized":"2024-06-02T22:53:40.217730+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:19:38.973859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329989+0000","last_change":"2024-06-02T22:53:39.226835+0000","last_active":"2024-06-02T22:53:41.329989+0000","last_peered":"2024-06-02T22:53:41.329989+0000","last_clean":"2024-06-02T22:53:41.329989+0000","last_became_active":"2024-06-02T22:53:39.226320+0000","last_became_peered":"2024-06-02T22:53:39.226320+0000","last_unstale":"2024-06-02T22:53:41.329989+0000","last_undegraded":"2024-06-02T22:53:41.329989+0000","last_fullsized":"2024-06-02T22:53:41.329989+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:13.991919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330301+0000","last_change":"2024-06-02T22:53:38.512688+0000","last_active":"2024-06-02T22:53:41.330301+0000","last_peered":"2024-06-02T22:53:41.330301+0000","last_clean":"2024-06-02T22:53:41.330301+0000","last_became_active":"2024-06-02T22:53:38.512371+0000","last_became_peered":"2024-06-02T22:53:38.512371+0000","last_unstale":"2024-06-02T22:53:41.330301+0000","last_undegraded":"2024-06-02T22:53:41.330301+0000","last_fullsized":"2024-06-02T22:53:41.330301+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:59.373751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218296+0000","last_change":"2024-06-02T22:53:39.229208+0000","last_active":"2024-06-02T22:53:40.218296+0000","last_peered":"2024-06-02T22:53:40.218296+0000","last_clean":"2024-06-02T22:53:40.218296+0000","last_became_active":"2024-06-02T22:53:39.228866+0000","last_became_peered":"2024-06-02T22:53:39.228866+0000","last_unstale":"2024-06-02T22:53:40.218296+0000","last_undegraded":"2024-06-02T22:53:40.218296+0000","last_fullsized":"2024-06-02T22:53:40.218296+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:20.011764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370222+0000","last_change":"2024-06-02T22:53:38.522212+0000","last_active":"2024-06-02T22:53:40.370222+0000","last_peered":"2024-06-02T22:53:40.370222+0000","last_clean":"2024-06-02T22:53:40.370222+0000","last_became_active":"2024-06-02T22:53:38.521831+0000","last_became_peered":"2024-06-02T22:53:38.521831+0000","last_unstale":"2024-06-02T22:53:40.370222+0000","last_undegraded":"2024-06-02T22:53:40.370222+0000","last_fullsized":"2024-06-02T22:53:40.370222+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:33.435379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.331049+0000","last_change":"2024-06-02T22:53:39.231155+0000","last_active":"2024-06-02T22:53:41.331049+0000","last_peered":"2024-06-02T22:53:41.331049+0000","last_clean":"2024-06-02T22:53:41.331049+0000","last_became_active":"2024-06-02T22:53:39.228519+0000","last_became_peered":"2024-06-02T22:53:39.228519+0000","last_unstale":"2024-06-02T22:53:41.331049+0000","last_undegraded":"2024-06-02T22:53:41.331049+0000","last_fullsized":"2024-06-02T22:53:41.331049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:12.890590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217474+0000","last_change":"2024-06-02T22:53:38.515279+0000","last_active":"2024-06-02T22:53:40.217474+0000","last_peered":"2024-06-02T22:53:40.217474+0000","last_clean":"2024-06-02T22:53:40.217474+0000","last_became_active":"2024-06-02T22:53:38.514983+0000","last_became_peered":"2024-06-02T22:53:38.514983+0000","last_unstale":"2024-06-02T22:53:40.217474+0000","last_undegraded":"2024-06-02T22:53:40.217474+0000","last_fullsized":"2024-06-02T22:53:40.217474+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:52:48.120405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217926+0000","last_change":"2024-06-02T22:53:39.218223+0000","last_active":"2024-06-02T22:53:40.217926+0000","last_peered":"2024-06-02T22:53:40.217926+0000","last_clean":"2024-06-02T22:53:40.217926+0000","last_became_active":"2024-06-02T22:53:39.217866+0000","last_became_peered":"2024-06-02T22:53:39.217866+0000","last_unstale":"2024-06-02T22:53:40.217926+0000","last_undegraded":"2024-06-02T22:53:40.217926+0000","last_fullsized":"2024-06-02T22:53:40.217926+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:43.041962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682180+0000","last_change":"2024-06-02T22:53:38.520159+0000","last_active":"2024-06-02T22:53:40.682180+0000","last_peered":"2024-06-02T22:53:40.682180+0000","last_clean":"2024-06-02T22:53:40.682180+0000","last_became_active":"2024-06-02T22:53:38.519837+0000","last_became_peered":"2024-06-02T22:53:38.519837+0000","last_unstale":"2024-06-02T22:53:40.682180+0000","last_undegraded":"2024-06-02T22:53:40.682180+0000","last_fullsized":"2024-06-02T22:53:40.682180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:37:06.108356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682223+0000","last_change":"2024-06-02T22:53:39.232736+0000","last_active":"2024-06-02T22:53:40.682223+0000","last_peered":"2024-06-02T22:53:40.682223+0000","last_clean":"2024-06-02T22:53:40.682223+0000","last_became_active":"2024-06-02T22:53:39.232419+0000","last_became_peered":"2024-06-02T22:53:39.232419+0000","last_unstale":"2024-06-02T22:53:40.682223+0000","last_undegraded":"2024-06-02T22:53:40.682223+0000","last_fullsized":"2024-06-02T22:53:40.682223+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:43:39.467852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330254+0000","last_change":"2024-06-02T22:53:38.521237+0000","last_active":"2024-06-02T22:53:41.330254+0000","last_peered":"2024-06-02T22:53:41.330254+0000","last_clean":"2024-06-02T22:53:41.330254+0000","last_became_active":"2024-06-02T22:53:38.520966+0000","last_became_peered":"2024-06-02T22:53:38.520966+0000","last_unstale":"2024-06-02T22:53:41.330254+0000","last_undegraded":"2024-06-02T22:53:41.330254+0000","last_fullsized":"2024-06-02T22:53:41.330254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:43:23.394406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216677+0000","last_change":"2024-06-02T22:53:39.218650+0000","last_active":"2024-06-02T22:53:40.216677+0000","last_peered":"2024-06-02T22:53:40.216677+0000","last_clean":"2024-06-02T22:53:40.216677+0000","last_became_active":"2024-06-02T22:53:39.218401+0000","last_became_peered":"2024-06-02T22:53:39.218401+0000","last_unstale":"2024-06-02T22:53:40.216677+0000","last_undegraded":"2024-06-02T22:53:40.216677+0000","last_fullsized":"2024-06-02T22:53:40.216677+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:15:22.317641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682246+0000","last_change":"2024-06-02T22:53:38.519276+0000","last_active":"2024-06-02T22:53:40.682246+0000","last_peered":"2024-06-02T22:53:40.682246+0000","last_clean":"2024-06-02T22:53:40.682246+0000","last_became_active":"2024-06-02T22:53:38.519001+0000","last_became_peered":"2024-06-02T22:53:38.519001+0000","last_unstale":"2024-06-02T22:53:40.682246+0000","last_undegraded":"2024-06-02T22:53:40.682246+0000","last_fullsized":"2024-06-02T22:53:40.682246+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:07:20.915834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682106+0000","last_change":"2024-06-02T22:53:39.230534+0000","last_active":"2024-06-02T22:53:40.682106+0000","last_peered":"2024-06-02T22:53:40.682106+0000","last_clean":"2024-06-02T22:53:40.682106+0000","last_became_active":"2024-06-02T22:53:39.228668+0000","last_became_peered":"2024-06-02T22:53:39.228668+0000","last_unstale":"2024-06-02T22:53:40.682106+0000","last_undegraded":"2024-06-02T22:53:40.682106+0000","last_fullsized":"2024-06-02T22:53:40.682106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:11:13.964052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218092+0000","last_change":"2024-06-02T22:53:38.517458+0000","last_active":"2024-06-02T22:53:40.218092+0000","last_peered":"2024-06-02T22:53:40.218092+0000","last_clean":"2024-06-02T22:53:40.218092+0000","last_became_active":"2024-06-02T22:53:38.517211+0000","last_became_peered":"2024-06-02T22:53:38.517211+0000","last_unstale":"2024-06-02T22:53:40.218092+0000","last_undegraded":"2024-06-02T22:53:40.218092+0000","last_fullsized":"2024-06-02T22:53:40.218092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:19:18.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370222+0000","last_change":"2024-06-02T22:53:39.226924+0000","last_active":"2024-06-02T22:53:40.370222+0000","last_peered":"2024-06-02T22:53:40.370222+0000","last_clean":"2024-06-02T22:53:40.370222+0000","last_became_active":"2024-06-02T22:53:39.226655+0000","last_became_peered":"2024-06-02T22:53:39.226655+0000","last_unstale":"2024-06-02T22:53:40.370222+0000","last_undegraded":"2024-06-02T22:53:40.370222+0000","last_fullsized":"2024-06-02T22:53:40.370222+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:14:21.846516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330084+0000","last_change":"2024-06-02T22:53:38.523424+0000","last_active":"2024-06-02T22:53:41.330084+0000","last_peered":"2024-06-02T22:53:41.330084+0000","last_clean":"2024-06-02T22:53:41.330084+0000","last_became_active":"2024-06-02T22:53:38.523001+0000","last_became_peered":"2024-06-02T22:53:38.523001+0000","last_unstale":"2024-06-02T22:53:41.330084+0000","last_undegraded":"2024-06-02T22:53:41.330084+0000","last_fullsized":"2024-06-02T22:53:41.330084+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:32.950818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681792+0000","last_change":"2024-06-02T22:53:39.231475+0000","last_active":"2024-06-02T22:53:40.681792+0000","last_peered":"2024-06-02T22:53:40.681792+0000","last_clean":"2024-06-02T22:53:40.681792+0000","last_became_active":"2024-06-02T22:53:39.231156+0000","last_became_peered":"2024-06-02T22:53:39.231156+0000","last_unstale":"2024-06-02T22:53:40.681792+0000","last_undegraded":"2024-06-02T22:53:40.681792+0000","last_fullsized":"2024-06-02T22:53:40.681792+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:51:00.587950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218275+0000","last_change":"2024-06-02T22:53:38.515112+0000","last_active":"2024-06-02T22:53:40.218275+0000","last_peered":"2024-06-02T22:53:40.218275+0000","last_clean":"2024-06-02T22:53:40.218275+0000","last_became_active":"2024-06-02T22:53:38.514823+0000","last_became_peered":"2024-06-02T22:53:38.514823+0000","last_unstale":"2024-06-02T22:53:40.218275+0000","last_undegraded":"2024-06-02T22:53:40.218275+0000","last_fullsized":"2024-06-02T22:53:40.218275+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:35:19.337672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217527+0000","last_change":"2024-06-02T22:53:39.228281+0000","last_active":"2024-06-02T22:53:40.217527+0000","last_peered":"2024-06-02T22:53:40.217527+0000","last_clean":"2024-06-02T22:53:40.217527+0000","last_became_active":"2024-06-02T22:53:39.227961+0000","last_became_peered":"2024-06-02T22:53:39.227961+0000","last_unstale":"2024-06-02T22:53:40.217527+0000","last_undegraded":"2024-06-02T22:53:40.217527+0000","last_fullsized":"2024-06-02T22:53:40.217527+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:29:57.640178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370242+0000","last_change":"2024-06-02T22:53:38.522532+0000","last_active":"2024-06-02T22:53:40.370242+0000","last_peered":"2024-06-02T22:53:40.370242+0000","last_clean":"2024-06-02T22:53:40.370242+0000","last_became_active":"2024-06-02T22:53:38.522230+0000","last_became_peered":"2024-06-02T22:53:38.522230+0000","last_unstale":"2024-06-02T22:53:40.370242+0000","last_undegraded":"2024-06-02T22:53:40.370242+0000","last_fullsized":"2024-06-02T22:53:40.370242+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:59.373751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681793+0000","last_change":"2024-06-02T22:53:39.238581+0000","last_active":"2024-06-02T22:53:40.681793+0000","last_peered":"2024-06-02T22:53:40.681793+0000","last_clean":"2024-06-02T22:53:40.681793+0000","last_became_active":"2024-06-02T22:53:39.238225+0000","last_became_peered":"2024-06-02T22:53:39.238225+0000","last_unstale":"2024-06-02T22:53:40.681793+0000","last_undegraded":"2024-06-02T22:53:40.681793+0000","last_fullsized":"2024-06-02T22:53:40.681793+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:49:11.033805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681827+0000","last_change":"2024-06-02T22:53:38.522015+0000","last_active":"2024-06-02T22:53:40.681827+0000","last_peered":"2024-06-02T22:53:40.681827+0000","last_clean":"2024-06-02T22:53:40.681827+0000","last_became_active":"2024-06-02T22:53:38.521648+0000","last_became_peered":"2024-06-02T22:53:38.521648+0000","last_unstale":"2024-06-02T22:53:40.681827+0000","last_undegraded":"2024-06-02T22:53:40.681827+0000","last_fullsized":"2024-06-02T22:53:40.681827+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:17.919301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682165+0000","last_change":"2024-06-02T22:53:39.238175+0000","last_active":"2024-06-02T22:53:40.682165+0000","last_peered":"2024-06-02T22:53:40.682165+0000","last_clean":"2024-06-02T22:53:40.682165+0000","last_became_active":"2024-06-02T22:53:39.236799+0000","last_became_peered":"2024-06-02T22:53:39.236799+0000","last_unstale":"2024-06-02T22:53:40.682165+0000","last_undegraded":"2024-06-02T22:53:40.682165+0000","last_fullsized":"2024-06-02T22:53:40.682165+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:47:11.690417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330400+0000","last_change":"2024-06-02T22:53:38.520955+0000","last_active":"2024-06-02T22:53:41.330400+0000","last_peered":"2024-06-02T22:53:41.330400+0000","last_clean":"2024-06-02T22:53:41.330400+0000","last_became_active":"2024-06-02T22:53:38.520683+0000","last_became_peered":"2024-06-02T22:53:38.520683+0000","last_unstale":"2024-06-02T22:53:41.330400+0000","last_undegraded":"2024-06-02T22:53:41.330400+0000","last_fullsized":"2024-06-02T22:53:41.330400+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:26:12.529239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370672+0000","last_change":"2024-06-02T22:53:39.226111+0000","last_active":"2024-06-02T22:53:40.370672+0000","last_peered":"2024-06-02T22:53:40.370672+0000","last_clean":"2024-06-02T22:53:40.370672+0000","last_became_active":"2024-06-02T22:53:39.225839+0000","last_became_peered":"2024-06-02T22:53:39.225839+0000","last_unstale":"2024-06-02T22:53:40.370672+0000","last_undegraded":"2024-06-02T22:53:40.370672+0000","last_fullsized":"2024-06-02T22:53:40.370672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:05.997684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330547+0000","last_change":"2024-06-02T22:53:38.520305+0000","last_active":"2024-06-02T22:53:41.330547+0000","last_peered":"2024-06-02T22:53:41.330547+0000","last_clean":"2024-06-02T22:53:41.330547+0000","last_became_active":"2024-06-02T22:53:38.519650+0000","last_became_peered":"2024-06-02T22:53:38.519650+0000","last_unstale":"2024-06-02T22:53:41.330547+0000","last_undegraded":"2024-06-02T22:53:41.330547+0000","last_fullsized":"2024-06-02T22:53:41.330547+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:42.040063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330401+0000","last_change":"2024-06-02T22:53:39.232298+0000","last_active":"2024-06-02T22:53:41.330401+0000","last_peered":"2024-06-02T22:53:41.330401+0000","last_clean":"2024-06-02T22:53:41.330401+0000","last_became_active":"2024-06-02T22:53:39.231840+0000","last_became_peered":"2024-06-02T22:53:39.231840+0000","last_unstale":"2024-06-02T22:53:41.330401+0000","last_undegraded":"2024-06-02T22:53:41.330401+0000","last_fullsized":"2024-06-02T22:53:41.330401+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:26.001190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370468+0000","last_change":"2024-06-02T22:53:38.522098+0000","last_active":"2024-06-02T22:53:40.370468+0000","last_peered":"2024-06-02T22:53:40.370468+0000","last_clean":"2024-06-02T22:53:40.370468+0000","last_became_active":"2024-06-02T22:53:38.521757+0000","last_became_peered":"2024-06-02T22:53:38.521757+0000","last_unstale":"2024-06-02T22:53:40.370468+0000","last_undegraded":"2024-06-02T22:53:40.370468+0000","last_fullsized":"2024-06-02T22:53:40.370468+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:05:17.547407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682178+0000","last_change":"2024-06-02T22:53:39.232107+0000","last_active":"2024-06-02T22:53:40.682178+0000","last_peered":"2024-06-02T22:53:40.682178+0000","last_clean":"2024-06-02T22:53:40.682178+0000","last_became_active":"2024-06-02T22:53:39.231488+0000","last_became_peered":"2024-06-02T22:53:39.231488+0000","last_unstale":"2024-06-02T22:53:40.682178+0000","last_undegraded":"2024-06-02T22:53:40.682178+0000","last_fullsized":"2024-06-02T22:53:40.682178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:57.784028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330584+0000","last_change":"2024-06-02T22:53:38.520503+0000","last_active":"2024-06-02T22:53:41.330584+0000","last_peered":"2024-06-02T22:53:41.330584+0000","last_clean":"2024-06-02T22:53:41.330584+0000","last_became_active":"2024-06-02T22:53:38.520199+0000","last_became_peered":"2024-06-02T22:53:38.520199+0000","last_unstale":"2024-06-02T22:53:41.330584+0000","last_undegraded":"2024-06-02T22:53:41.330584+0000","last_fullsized":"2024-06-02T22:53:41.330584+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:33.435379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370450+0000","last_change":"2024-06-02T22:53:39.226895+0000","last_active":"2024-06-02T22:53:40.370450+0000","last_peered":"2024-06-02T22:53:40.370450+0000","last_clean":"2024-06-02T22:53:40.370450+0000","last_became_active":"2024-06-02T22:53:39.226556+0000","last_became_peered":"2024-06-02T22:53:39.226556+0000","last_unstale":"2024-06-02T22:53:40.370450+0000","last_undegraded":"2024-06-02T22:53:40.370450+0000","last_fullsized":"2024-06-02T22:53:40.370450+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:26:13.531139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330522+0000","last_change":"2024-06-02T22:53:38.514056+0000","last_active":"2024-06-02T22:53:41.330522+0000","last_peered":"2024-06-02T22:53:41.330522+0000","last_clean":"2024-06-02T22:53:41.330522+0000","last_became_active":"2024-06-02T22:53:38.513758+0000","last_became_peered":"2024-06-02T22:53:38.513758+0000","last_unstale":"2024-06-02T22:53:41.330522+0000","last_undegraded":"2024-06-02T22:53:41.330522+0000","last_fullsized":"2024-06-02T22:53:41.330522+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:14:20.844616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330410+0000","last_change":"2024-06-02T22:53:39.219365+0000","last_active":"2024-06-02T22:53:41.330410+0000","last_peered":"2024-06-02T22:53:41.330410+0000","last_clean":"2024-06-02T22:53:41.330410+0000","last_became_active":"2024-06-02T22:53:39.218932+0000","last_became_peered":"2024-06-02T22:53:39.218932+0000","last_unstale":"2024-06-02T22:53:41.330410+0000","last_undegraded":"2024-06-02T22:53:41.330410+0000","last_fullsized":"2024-06-02T22:53:41.330410+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:43:24.396305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216534+0000","last_change":"2024-06-02T22:53:38.520364+0000","last_active":"2024-06-02T22:53:40.216534+0000","last_peered":"2024-06-02T22:53:40.216534+0000","last_clean":"2024-06-02T22:53:40.216534+0000","last_became_active":"2024-06-02T22:53:38.520052+0000","last_became_peered":"2024-06-02T22:53:38.520052+0000","last_unstale":"2024-06-02T22:53:40.216534+0000","last_undegraded":"2024-06-02T22:53:40.216534+0000","last_fullsized":"2024-06-02T22:53:40.216534+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:19:38.973859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330659+0000","last_change":"2024-06-02T22:53:39.229115+0000","last_active":"2024-06-02T22:53:41.330659+0000","last_peered":"2024-06-02T22:53:41.330659+0000","last_clean":"2024-06-02T22:53:41.330659+0000","last_became_active":"2024-06-02T22:53:39.228840+0000","last_became_peered":"2024-06-02T22:53:39.228840+0000","last_unstale":"2024-06-02T22:53:41.330659+0000","last_undegraded":"2024-06-02T22:53:41.330659+0000","last_fullsized":"2024-06-02T22:53:41.330659+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:09:25.874398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370205+0000","last_change":"2024-06-02T22:53:38.519974+0000","last_active":"2024-06-02T22:53:40.370205+0000","last_peered":"2024-06-02T22:53:40.370205+0000","last_clean":"2024-06-02T22:53:40.370205+0000","last_became_active":"2024-06-02T22:53:38.519672+0000","last_became_peered":"2024-06-02T22:53:38.519672+0000","last_unstale":"2024-06-02T22:53:40.370205+0000","last_undegraded":"2024-06-02T22:53:40.370205+0000","last_fullsized":"2024-06-02T22:53:40.370205+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:15:21.315741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370673+0000","last_change":"2024-06-02T22:53:39.225897+0000","last_active":"2024-06-02T22:53:40.370673+0000","last_peered":"2024-06-02T22:53:40.370673+0000","last_clean":"2024-06-02T22:53:40.370673+0000","last_became_active":"2024-06-02T22:53:39.225597+0000","last_became_peered":"2024-06-02T22:53:39.225597+0000","last_unstale":"2024-06-02T22:53:40.370673+0000","last_undegraded":"2024-06-02T22:53:40.370673+0000","last_fullsized":"2024-06-02T22:53:40.370673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:09:25.874398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216855+0000","last_change":"2024-06-02T22:53:38.515823+0000","last_active":"2024-06-02T22:53:40.216855+0000","last_peered":"2024-06-02T22:53:40.216855+0000","last_clean":"2024-06-02T22:53:40.216855+0000","last_became_active":"2024-06-02T22:53:38.515511+0000","last_became_peered":"2024-06-02T22:53:38.515511+0000","last_unstale":"2024-06-02T22:53:40.216855+0000","last_undegraded":"2024-06-02T22:53:40.216855+0000","last_fullsized":"2024-06-02T22:53:40.216855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:10:10.965478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370664+0000","last_change":"2024-06-02T22:53:39.236459+0000","last_active":"2024-06-02T22:53:40.370664+0000","last_peered":"2024-06-02T22:53:40.370664+0000","last_clean":"2024-06-02T22:53:40.370664+0000","last_became_active":"2024-06-02T22:53:39.236024+0000","last_became_peered":"2024-06-02T22:53:39.236024+0000","last_unstale":"2024-06-02T22:53:40.370664+0000","last_undegraded":"2024-06-02T22:53:40.370664+0000","last_fullsized":"2024-06-02T22:53:40.370664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:34:27.118218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"54'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.518829+0000","last_change":"2024-06-02T22:53:38.518505+0000","last_active":"2024-06-02T22:53:41.518829+0000","last_peered":"2024-06-02T22:53:41.518829+0000","last_clean":"2024-06-02T22:53:41.518829+0000","last_became_active":"2024-06-02T22:53:38.518190+0000","last_became_peered":"2024-06-02T22:53:38.518190+0000","last_unstale":"2024-06-02T22:53:41.518829+0000","last_undegraded":"2024-06-02T22:53:41.518829+0000","last_fullsized":"2024-06-02T22:53:41.518829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:17.919301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216779+0000","last_change":"2024-06-02T22:53:39.218572+0000","last_active":"2024-06-02T22:53:40.216779+0000","last_peered":"2024-06-02T22:53:40.216779+0000","last_clean":"2024-06-02T22:53:40.216779+0000","last_became_active":"2024-06-02T22:53:39.218304+0000","last_became_peered":"2024-06-02T22:53:39.218304+0000","last_unstale":"2024-06-02T22:53:40.216779+0000","last_undegraded":"2024-06-02T22:53:40.216779+0000","last_fullsized":"2024-06-02T22:53:40.216779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:34.437279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218199+0000","last_change":"2024-06-02T22:53:38.509588+0000","last_active":"2024-06-02T22:53:40.218199+0000","last_peered":"2024-06-02T22:53:40.218199+0000","last_clean":"2024-06-02T22:53:40.218199+0000","last_became_active":"2024-06-02T22:53:38.509305+0000","last_became_peered":"2024-06-02T22:53:38.509305+0000","last_unstale":"2024-06-02T22:53:40.218199+0000","last_undegraded":"2024-06-02T22:53:40.218199+0000","last_fullsized":"2024-06-02T22:53:40.218199+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:19:18.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330774+0000","last_change":"2024-06-02T22:53:39.223582+0000","last_active":"2024-06-02T22:53:41.330774+0000","last_peered":"2024-06-02T22:53:41.330774+0000","last_clean":"2024-06-02T22:53:41.330774+0000","last_became_active":"2024-06-02T22:53:39.223310+0000","last_became_peered":"2024-06-02T22:53:39.223310+0000","last_unstale":"2024-06-02T22:53:41.330774+0000","last_undegraded":"2024-06-02T22:53:41.330774+0000","last_fullsized":"2024-06-02T22:53:41.330774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:49:11.033805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370677+0000","last_change":"2024-06-02T22:53:38.519652+0000","last_active":"2024-06-02T22:53:40.370677+0000","last_peered":"2024-06-02T22:53:40.370677+0000","last_clean":"2024-06-02T22:53:40.370677+0000","last_became_active":"2024-06-02T22:53:38.519353+0000","last_became_peered":"2024-06-02T22:53:38.519353+0000","last_unstale":"2024-06-02T22:53:40.370677+0000","last_undegraded":"2024-06-02T22:53:40.370677+0000","last_fullsized":"2024-06-02T22:53:40.370677+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:17.919301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330838+0000","last_change":"2024-06-02T22:53:39.225199+0000","last_active":"2024-06-02T22:53:41.330838+0000","last_peered":"2024-06-02T22:53:41.330838+0000","last_clean":"2024-06-02T22:53:41.330838+0000","last_became_active":"2024-06-02T22:53:39.224748+0000","last_became_peered":"2024-06-02T22:53:39.224748+0000","last_unstale":"2024-06-02T22:53:41.330838+0000","last_undegraded":"2024-06-02T22:53:41.330838+0000","last_fullsized":"2024-06-02T22:53:41.330838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:33:30.567837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216488+0000","last_change":"2024-06-02T22:53:38.514739+0000","last_active":"2024-06-02T22:53:40.216488+0000","last_peered":"2024-06-02T22:53:40.216488+0000","last_clean":"2024-06-02T22:53:40.216488+0000","last_became_active":"2024-06-02T22:53:38.514418+0000","last_became_peered":"2024-06-02T22:53:38.514418+0000","last_unstale":"2024-06-02T22:53:40.216488+0000","last_undegraded":"2024-06-02T22:53:40.216488+0000","last_fullsized":"2024-06-02T22:53:40.216488+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:19:18.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681951+0000","last_change":"2024-06-02T22:53:39.237819+0000","last_active":"2024-06-02T22:53:40.681951+0000","last_peered":"2024-06-02T22:53:40.681951+0000","last_clean":"2024-06-02T22:53:40.681951+0000","last_became_active":"2024-06-02T22:53:39.236619+0000","last_became_peered":"2024-06-02T22:53:39.236619+0000","last_unstale":"2024-06-02T22:53:40.681951+0000","last_undegraded":"2024-06-02T22:53:40.681951+0000","last_fullsized":"2024-06-02T22:53:40.681951+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:10:52.547924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218113+0000","last_change":"2024-06-02T22:53:38.513604+0000","last_active":"2024-06-02T22:53:40.218113+0000","last_peered":"2024-06-02T22:53:40.218113+0000","last_clean":"2024-06-02T22:53:40.218113+0000","last_became_active":"2024-06-02T22:53:38.513331+0000","last_became_peered":"2024-06-02T22:53:38.513331+0000","last_unstale":"2024-06-02T22:53:40.218113+0000","last_undegraded":"2024-06-02T22:53:40.218113+0000","last_fullsized":"2024-06-02T22:53:40.218113+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:35:19.337672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216414+0000","last_change":"2024-06-02T22:53:39.220193+0000","last_active":"2024-06-02T22:53:40.216414+0000","last_peered":"2024-06-02T22:53:40.216414+0000","last_clean":"2024-06-02T22:53:40.216414+0000","last_became_active":"2024-06-02T22:53:39.219946+0000","last_became_peered":"2024-06-02T22:53:39.219946+0000","last_unstale":"2024-06-02T22:53:40.216414+0000","last_undegraded":"2024-06-02T22:53:40.216414+0000","last_fullsized":"2024-06-02T22:53:40.216414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:29:57.640178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216424+0000","last_change":"2024-06-02T22:53:38.519894+0000","last_active":"2024-06-02T22:53:40.216424+0000","last_peered":"2024-06-02T22:53:40.216424+0000","last_clean":"2024-06-02T22:53:40.216424+0000","last_became_active":"2024-06-02T22:53:38.519642+0000","last_became_peered":"2024-06-02T22:53:38.519642+0000","last_unstale":"2024-06-02T22:53:40.216424+0000","last_undegraded":"2024-06-02T22:53:40.216424+0000","last_fullsized":"2024-06-02T22:53:40.216424+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:35:19.337672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.331069+0000","last_change":"2024-06-02T22:53:39.229208+0000","last_active":"2024-06-02T22:53:41.331069+0000","last_peered":"2024-06-02T22:53:41.331069+0000","last_clean":"2024-06-02T22:53:41.331069+0000","last_became_active":"2024-06-02T22:53:39.228175+0000","last_became_peered":"2024-06-02T22:53:39.228175+0000","last_unstale":"2024-06-02T22:53:41.331069+0000","last_undegraded":"2024-06-02T22:53:41.331069+0000","last_fullsized":"2024-06-02T22:53:41.331069+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:11:01.522661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330044+0000","last_change":"2024-06-02T22:53:38.517431+0000","last_active":"2024-06-02T22:53:41.330044+0000","last_peered":"2024-06-02T22:53:41.330044+0000","last_clean":"2024-06-02T22:53:41.330044+0000","last_became_active":"2024-06-02T22:53:38.517149+0000","last_became_peered":"2024-06-02T22:53:38.517149+0000","last_unstale":"2024-06-02T22:53:41.330044+0000","last_undegraded":"2024-06-02T22:53:41.330044+0000","last_fullsized":"2024-06-02T22:53:41.330044+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:25:23.153899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329961+0000","last_change":"2024-06-02T22:53:39.227213+0000","last_active":"2024-06-02T22:53:41.329961+0000","last_peered":"2024-06-02T22:53:41.329961+0000","last_clean":"2024-06-02T22:53:41.329961+0000","last_became_active":"2024-06-02T22:53:39.226738+0000","last_became_peered":"2024-06-02T22:53:39.226738+0000","last_unstale":"2024-06-02T22:53:41.329961+0000","last_undegraded":"2024-06-02T22:53:41.329961+0000","last_fullsized":"2024-06-02T22:53:41.329961+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:09:44.012150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218002+0000","last_change":"2024-06-02T22:53:38.517846+0000","last_active":"2024-06-02T22:53:40.218002+0000","last_peered":"2024-06-02T22:53:40.218002+0000","last_clean":"2024-06-02T22:53:40.218002+0000","last_became_active":"2024-06-02T22:53:38.517527+0000","last_became_peered":"2024-06-02T22:53:38.517527+0000","last_unstale":"2024-06-02T22:53:40.218002+0000","last_undegraded":"2024-06-02T22:53:40.218002+0000","last_fullsized":"2024-06-02T22:53:40.218002+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:19:38.973859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681556+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:53:40.681556+0000","last_peered":"2024-06-02T22:53:40.681556+0000","last_clean":"2024-06-02T22:53:40.681556+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:53:40.681556+0000","last_undegraded":"2024-06-02T22:53:40.681556+0000","last_fullsized":"2024-06-02T22:53:40.681556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":882305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":647168,"data_stored":291777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":292429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":659456,"data_stored":293389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":643072,"data_stored":285141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":643072,"data_stored":285141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":291867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1245184,"data_stored":877647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:53:45.499 INFO:tasks.ceph.mds.a.smithi082.stderr:2024-06-02T22:53:45.499+0000 7fad29f71640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T22:53:46.871 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:53:46.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.982+0000 7fe492c12640 1 Processor -- start 2024-06-02T22:53:46.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.982+0000 7fe492c12640 1 -- start start 2024-06-02T22:53:46.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe492c12640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe48c1553c0 0x7fe48c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:46.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe492c12640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe48c0cec50 0x7fe48c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:46.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe492c12640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48c0b31a0 con 0x7fe48c0b2cf0 2024-06-02T22:53:46.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe492c12640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe48c0b3420 con 0x7fe48c1553c0 2024-06-02T22:53:46.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe492c12640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fe48c0cc750 con 0x7fe48c0cec50 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe4909ae640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe48c1553c0 0x7fe48c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe4909ae640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe48c1553c0 0x7fe48c0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40830/0 (socket says 172.21.15.82:40830) 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe483fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe48c0b2cf0 0x7fe48c15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52944/0 (socket says 172.21.15.82:52944) 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe4909ae640 1 -- 172.21.15.82:0/1725472109 learned_addr learned my addr 172.21.15.82:0/1725472109 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe4911af640 1 --2- 172.21.15.82:0/1725472109 >> v2:172.21.15.184:3300/0 conn(0x7fe48c0cec50 0x7fe48c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe4909ae640 1 -- 172.21.15.82:0/1725472109 >> v2:172.21.15.184:3300/0 conn(0x7fe48c0cec50 msgr2=0x7fe48c0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe4909ae640 1 --2- 172.21.15.82:0/1725472109 >> v2:172.21.15.184:3300/0 conn(0x7fe48c0cec50 0x7fe48c0cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.983+0000 7fe4909ae640 1 -- 172.21.15.82:0/1725472109 >> v1:172.21.15.82:6789/0 conn(0x7fe48c0b2cf0 legacy=0x7fe48c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.984+0000 7fe4909ae640 1 -- 172.21.15.82:0/1725472109 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c0cca30 con 0x7fe48c1553c0 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.984+0000 7fe4837fe640 1 -- 172.21.15.82:0/1725472109 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155989971 0 0) 0x7fe47c001110 con 0x7fe48c0b2cf0 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.984+0000 7fe4909ae640 1 --2- 172.21.15.82:0/1725472109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe48c1553c0 0x7fe48c0cd230 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe488009870 tx=0x7fe48802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fad77a20c86fbc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:46.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.984+0000 7fe4837fe640 1 -- 172.21.15.82:0/1725472109 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe488037070 con 0x7fe48c1553c0 2024-06-02T22:53:46.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.984+0000 7fe4837fe640 1 -- 172.21.15.82:0/1725472109 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe488032440 con 0x7fe48c1553c0 2024-06-02T22:53:46.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.984+0000 7fe4837fe640 1 -- 172.21.15.82:0/1725472109 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe488032810 con 0x7fe48c1553c0 2024-06-02T22:53:46.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.985+0000 7fe492c12640 1 -- 172.21.15.82:0/1725472109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe48c1553c0 msgr2=0x7fe48c0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.985+0000 7fe492c12640 1 --2- 172.21.15.82:0/1725472109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe48c1553c0 0x7fe48c0cd230 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe488009870 tx=0x7fe48802a2a0 comp rx=0 tx=0).stop 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.985+0000 7fe492c12640 1 -- 172.21.15.82:0/1725472109 shutdown_connections 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.985+0000 7fe492c12640 1 --2- 172.21.15.82:0/1725472109 >> v2:172.21.15.184:3300/0 conn(0x7fe48c0cec50 0x7fe48c0cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.985+0000 7fe492c12640 1 --2- 172.21.15.82:0/1725472109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe48c1553c0 0x7fe48c0cd230 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.985+0000 7fe492c12640 1 -- 172.21.15.82:0/1725472109 >> 172.21.15.82:0/1725472109 conn(0x7fe48c0b19f0 msgr2=0x7fe48c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.985+0000 7fe492c12640 1 -- 172.21.15.82:0/1725472109 shutdown_connections 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.985+0000 7fe492c12640 1 -- 172.21.15.82:0/1725472109 wait complete. 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.986+0000 7fe492c12640 1 Processor -- start 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.986+0000 7fe492c12640 1 -- start start 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.987+0000 7fe492c12640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48c0b2cf0 0x7fe48c140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.987+0000 7fe492c12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe48c0cec50 0x7fe48c09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.987+0000 7fe492c12640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe48c1553c0 0x7fe48c09d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.987+0000 7fe492c12640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c1557a0 con 0x7fe48c0cec50 2024-06-02T22:53:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.987+0000 7fe492c12640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c0b3700 con 0x7fe48c0b2cf0 2024-06-02T22:53:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.987+0000 7fe492c12640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe48c155920 con 0x7fe48c1553c0 2024-06-02T22:53:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.987+0000 7fe483fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe48c0cec50 0x7fe48c09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.987+0000 7fe483fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe48c0cec50 0x7fe48c09cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40834/0 (socket says 172.21.15.82:40834) 2024-06-02T22:53:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.987+0000 7fe483fff640 1 -- 172.21.15.82:0/2037477061 learned_addr learned my addr 172.21.15.82:0/2037477061 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.987+0000 7fe4909ae640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48c0b2cf0 0x7fe48c140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.987+0000 7fe4911af640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe48c1553c0 0x7fe48c09d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.988+0000 7fe483fff640 1 -- 172.21.15.82:0/2037477061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe48c1553c0 msgr2=0x7fe48c09d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.988+0000 7fe483fff640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe48c1553c0 0x7fe48c09d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.988+0000 7fe483fff640 1 -- 172.21.15.82:0/2037477061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48c0b2cf0 msgr2=0x7fe48c140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.988+0000 7fe483fff640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48c0b2cf0 0x7fe48c140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.988+0000 7fe483fff640 1 -- 172.21.15.82:0/2037477061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c1418e0 con 0x7fe48c0cec50 2024-06-02T22:53:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.988+0000 7fe483fff640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe48c0cec50 0x7fe48c09cc20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00c7b0 tx=0x7fe47c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.988+0000 7fe4817fa640 1 -- 172.21.15.82:0/2037477061 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c018070 con 0x7fe48c0cec50 2024-06-02T22:53:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.988+0000 7fe4817fa640 1 -- 172.21.15.82:0/2037477061 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47c0072d0 con 0x7fe48c0cec50 2024-06-02T22:53:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.988+0000 7fe492c12640 1 -- 172.21.15.82:0/2037477061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48c141510 con 0x7fe48c0cec50 2024-06-02T22:53:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.988+0000 7fe4817fa640 1 -- 172.21.15.82:0/2037477061 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0047e0 con 0x7fe48c0cec50 2024-06-02T22:53:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.988+0000 7fe492c12640 1 -- 172.21.15.82:0/2037477061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe48c15e920 con 0x7fe48c0cec50 2024-06-02T22:53:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.989+0000 7fe492c12640 1 -- 172.21.15.82:0/2037477061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48c068430 con 0x7fe48c0cec50 2024-06-02T22:53:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.990+0000 7fe4817fa640 1 -- 172.21.15.82:0/2037477061 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe47c01b070 con 0x7fe48c0cec50 2024-06-02T22:53:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.990+0000 7fe4817fa640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe47806be60 0x7fe47806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.990+0000 7fe4817fa640 1 -- 172.21.15.82:0/2037477061 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fe47c08a240 con 0x7fe48c0cec50 2024-06-02T22:53:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.990+0000 7fe4909ae640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe47806be60 0x7fe47806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.991+0000 7fe4909ae640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe47806be60 0x7fe47806e320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe488034000 tx=0x7fe48802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:46.995+0000 7fe4817fa640 1 -- 172.21.15.82:0/2037477061 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe48c0b31a0 con 0x7fe48c0cec50 2024-06-02T22:53:47.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.166+0000 7fe492c12640 1 -- 172.21.15.82:0/2037477061 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe48c15f910 con 0x7fe47806be60 2024-06-02T22:53:47.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.172+0000 7fe4817fa640 1 -- 172.21.15.82:0/2037477061 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251954 (secure 0 0 0) 0x7fe48c15f910 con 0x7fe47806be60 2024-06-02T22:53:47.175 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:53:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 -- 172.21.15.82:0/2037477061 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe47806be60 msgr2=0x7fe47806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe47806be60 0x7fe47806e320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe488034000 tx=0x7fe48802e000 comp rx=0 tx=0).stop 2024-06-02T22:53:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 -- 172.21.15.82:0/2037477061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe48c0cec50 msgr2=0x7fe48c09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe48c0cec50 0x7fe48c09cc20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00c7b0 tx=0x7fe47c00cc70 comp rx=0 tx=0).stop 2024-06-02T22:53:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 -- 172.21.15.82:0/2037477061 shutdown_connections 2024-06-02T22:53:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe47806be60 0x7fe47806e320 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe48c1553c0 0x7fe48c09d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe48c0cec50 0x7fe48c09cc20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 --2- 172.21.15.82:0/2037477061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48c0b2cf0 0x7fe48c140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 -- 172.21.15.82:0/2037477061 >> 172.21.15.82:0/2037477061 conn(0x7fe48c0b19f0 msgr2=0x7fe48c0b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 -- 172.21.15.82:0/2037477061 shutdown_connections 2024-06-02T22:53:47.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.175+0000 7fe492c12640 1 -- 172.21.15.82:0/2037477061 wait complete. 2024-06-02T22:53:47.186 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-06-02T22:53:45.844662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222452,"kb_used_data":6244,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752268,"statfs":{"total":773094113280,"available":772866322432,"internally_reserved":0,"allocated":6393856,"data_stored":3499696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.342600"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329680+0000","last_change":"2024-06-02T22:53:39.229801+0000","last_active":"2024-06-02T22:53:41.329680+0000","last_peered":"2024-06-02T22:53:41.329680+0000","last_clean":"2024-06-02T22:53:41.329680+0000","last_became_active":"2024-06-02T22:53:39.229550+0000","last_became_peered":"2024-06-02T22:53:39.229550+0000","last_unstale":"2024-06-02T22:53:41.329680+0000","last_undegraded":"2024-06-02T22:53:41.329680+0000","last_fullsized":"2024-06-02T22:53:41.329680+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:47.102349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330074+0000","last_change":"2024-06-02T22:53:39.226821+0000","last_active":"2024-06-02T22:53:41.330074+0000","last_peered":"2024-06-02T22:53:41.330074+0000","last_clean":"2024-06-02T22:53:41.330074+0000","last_became_active":"2024-06-02T22:53:39.226527+0000","last_became_peered":"2024-06-02T22:53:39.226527+0000","last_unstale":"2024-06-02T22:53:41.330074+0000","last_undegraded":"2024-06-02T22:53:41.330074+0000","last_fullsized":"2024-06-02T22:53:41.330074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:28:06.448260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681951+0000","last_change":"2024-06-02T22:53:39.236715+0000","last_active":"2024-06-02T22:53:40.681951+0000","last_peered":"2024-06-02T22:53:40.681951+0000","last_clean":"2024-06-02T22:53:40.681951+0000","last_became_active":"2024-06-02T22:53:39.236395+0000","last_became_peered":"2024-06-02T22:53:39.236395+0000","last_unstale":"2024-06-02T22:53:40.681951+0000","last_undegraded":"2024-06-02T22:53:40.681951+0000","last_fullsized":"2024-06-02T22:53:40.681951+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:05:10.982237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370537+0000","last_change":"2024-06-02T22:53:39.230699+0000","last_active":"2024-06-02T22:53:40.370537+0000","last_peered":"2024-06-02T22:53:40.370537+0000","last_clean":"2024-06-02T22:53:40.370537+0000","last_became_active":"2024-06-02T22:53:39.230377+0000","last_became_peered":"2024-06-02T22:53:39.230377+0000","last_unstale":"2024-06-02T22:53:40.370537+0000","last_undegraded":"2024-06-02T22:53:40.370537+0000","last_fullsized":"2024-06-02T22:53:40.370537+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:25:24.155798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329541+0000","last_change":"2024-06-02T22:53:39.222421+0000","last_active":"2024-06-02T22:53:41.329541+0000","last_peered":"2024-06-02T22:53:41.329541+0000","last_clean":"2024-06-02T22:53:41.329541+0000","last_became_active":"2024-06-02T22:53:39.222152+0000","last_became_peered":"2024-06-02T22:53:39.222152+0000","last_unstale":"2024-06-02T22:53:41.329541+0000","last_undegraded":"2024-06-02T22:53:41.329541+0000","last_fullsized":"2024-06-02T22:53:41.329541+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:41.233138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330151+0000","last_change":"2024-06-02T22:53:39.224031+0000","last_active":"2024-06-02T22:53:41.330151+0000","last_peered":"2024-06-02T22:53:41.330151+0000","last_clean":"2024-06-02T22:53:41.330151+0000","last_became_active":"2024-06-02T22:53:39.223512+0000","last_became_peered":"2024-06-02T22:53:39.223512+0000","last_unstale":"2024-06-02T22:53:41.330151+0000","last_undegraded":"2024-06-02T22:53:41.330151+0000","last_fullsized":"2024-06-02T22:53:41.330151+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:08:46.066561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217525+0000","last_change":"2024-06-02T22:53:39.223058+0000","last_active":"2024-06-02T22:53:40.217525+0000","last_peered":"2024-06-02T22:53:40.217525+0000","last_clean":"2024-06-02T22:53:40.217525+0000","last_became_active":"2024-06-02T22:53:39.222788+0000","last_became_peered":"2024-06-02T22:53:39.222788+0000","last_unstale":"2024-06-02T22:53:40.217525+0000","last_undegraded":"2024-06-02T22:53:40.217525+0000","last_fullsized":"2024-06-02T22:53:40.217525+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:15:22.317641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329872+0000","last_change":"2024-06-02T22:53:39.232404+0000","last_active":"2024-06-02T22:53:41.329872+0000","last_peered":"2024-06-02T22:53:41.329872+0000","last_clean":"2024-06-02T22:53:41.329872+0000","last_became_active":"2024-06-02T22:53:39.232155+0000","last_became_peered":"2024-06-02T22:53:39.232155+0000","last_unstale":"2024-06-02T22:53:41.329872+0000","last_undegraded":"2024-06-02T22:53:41.329872+0000","last_fullsized":"2024-06-02T22:53:41.329872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:22:33.568403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217784+0000","last_change":"2024-06-02T22:53:39.222118+0000","last_active":"2024-06-02T22:53:40.217784+0000","last_peered":"2024-06-02T22:53:40.217784+0000","last_clean":"2024-06-02T22:53:40.217784+0000","last_became_active":"2024-06-02T22:53:39.221837+0000","last_became_peered":"2024-06-02T22:53:39.221837+0000","last_unstale":"2024-06-02T22:53:40.217784+0000","last_undegraded":"2024-06-02T22:53:40.217784+0000","last_fullsized":"2024-06-02T22:53:40.217784+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:00.375651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217007+0000","last_change":"2024-06-02T22:53:39.220238+0000","last_active":"2024-06-02T22:53:40.217007+0000","last_peered":"2024-06-02T22:53:40.217007+0000","last_clean":"2024-06-02T22:53:40.217007+0000","last_became_active":"2024-06-02T22:53:39.219984+0000","last_became_peered":"2024-06-02T22:53:39.219984+0000","last_unstale":"2024-06-02T22:53:40.217007+0000","last_undegraded":"2024-06-02T22:53:40.217007+0000","last_fullsized":"2024-06-02T22:53:40.217007+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:43.041962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216824+0000","last_change":"2024-06-02T22:53:39.227116+0000","last_active":"2024-06-02T22:53:40.216824+0000","last_peered":"2024-06-02T22:53:40.216824+0000","last_clean":"2024-06-02T22:53:40.216824+0000","last_became_active":"2024-06-02T22:53:39.226860+0000","last_became_peered":"2024-06-02T22:53:39.226860+0000","last_unstale":"2024-06-02T22:53:40.216824+0000","last_undegraded":"2024-06-02T22:53:40.216824+0000","last_fullsized":"2024-06-02T22:53:40.216824+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:00.375651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370535+0000","last_change":"2024-06-02T22:53:39.229861+0000","last_active":"2024-06-02T22:53:40.370535+0000","last_peered":"2024-06-02T22:53:40.370535+0000","last_clean":"2024-06-02T22:53:40.370535+0000","last_became_active":"2024-06-02T22:53:39.229587+0000","last_became_peered":"2024-06-02T22:53:39.229587+0000","last_unstale":"2024-06-02T22:53:40.370535+0000","last_undegraded":"2024-06-02T22:53:40.370535+0000","last_fullsized":"2024-06-02T22:53:40.370535+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:43:24.396305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218361+0000","last_change":"2024-06-02T22:53:39.220077+0000","last_active":"2024-06-02T22:53:40.218361+0000","last_peered":"2024-06-02T22:53:40.218361+0000","last_clean":"2024-06-02T22:53:40.218361+0000","last_became_active":"2024-06-02T22:53:39.219751+0000","last_became_peered":"2024-06-02T22:53:39.219751+0000","last_unstale":"2024-06-02T22:53:40.218361+0000","last_undegraded":"2024-06-02T22:53:40.218361+0000","last_fullsized":"2024-06-02T22:53:40.218361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:50.567016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217902+0000","last_change":"2024-06-02T22:53:39.225797+0000","last_active":"2024-06-02T22:53:40.217902+0000","last_peered":"2024-06-02T22:53:40.217902+0000","last_clean":"2024-06-02T22:53:40.217902+0000","last_became_active":"2024-06-02T22:53:39.225538+0000","last_became_peered":"2024-06-02T22:53:39.225538+0000","last_unstale":"2024-06-02T22:53:40.217902+0000","last_undegraded":"2024-06-02T22:53:40.217902+0000","last_fullsized":"2024-06-02T22:53:40.217902+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:05:18.549306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217677+0000","last_change":"2024-06-02T22:53:39.218569+0000","last_active":"2024-06-02T22:53:40.217677+0000","last_peered":"2024-06-02T22:53:40.217677+0000","last_clean":"2024-06-02T22:53:40.217677+0000","last_became_active":"2024-06-02T22:53:39.217921+0000","last_became_peered":"2024-06-02T22:53:39.217921+0000","last_unstale":"2024-06-02T22:53:40.217677+0000","last_undegraded":"2024-06-02T22:53:40.217677+0000","last_fullsized":"2024-06-02T22:53:40.217677+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:34.437279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330814+0000","last_change":"2024-06-02T22:53:39.226767+0000","last_active":"2024-06-02T22:53:41.330814+0000","last_peered":"2024-06-02T22:53:41.330814+0000","last_clean":"2024-06-02T22:53:41.330814+0000","last_became_active":"2024-06-02T22:53:39.225677+0000","last_became_peered":"2024-06-02T22:53:39.225677+0000","last_unstale":"2024-06-02T22:53:41.330814+0000","last_undegraded":"2024-06-02T22:53:41.330814+0000","last_fullsized":"2024-06-02T22:53:41.330814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:13:01.894721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330304+0000","last_change":"2024-06-02T22:53:39.228364+0000","last_active":"2024-06-02T22:53:41.330304+0000","last_peered":"2024-06-02T22:53:41.330304+0000","last_clean":"2024-06-02T22:53:41.330304+0000","last_became_active":"2024-06-02T22:53:39.228116+0000","last_became_peered":"2024-06-02T22:53:39.228116+0000","last_unstale":"2024-06-02T22:53:41.330304+0000","last_undegraded":"2024-06-02T22:53:41.330304+0000","last_fullsized":"2024-06-02T22:53:41.330304+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:15:58.297664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682116+0000","last_change":"2024-06-02T22:53:39.228280+0000","last_active":"2024-06-02T22:53:40.682116+0000","last_peered":"2024-06-02T22:53:40.682116+0000","last_clean":"2024-06-02T22:53:40.682116+0000","last_became_active":"2024-06-02T22:53:39.227900+0000","last_became_peered":"2024-06-02T22:53:39.227900+0000","last_unstale":"2024-06-02T22:53:40.682116+0000","last_undegraded":"2024-06-02T22:53:40.682116+0000","last_fullsized":"2024-06-02T22:53:40.682116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:44:43.528239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329656+0000","last_change":"2024-06-02T22:53:39.230261+0000","last_active":"2024-06-02T22:53:41.329656+0000","last_peered":"2024-06-02T22:53:41.329656+0000","last_clean":"2024-06-02T22:53:41.329656+0000","last_became_active":"2024-06-02T22:53:39.230019+0000","last_became_peered":"2024-06-02T22:53:39.230019+0000","last_unstale":"2024-06-02T22:53:41.329656+0000","last_undegraded":"2024-06-02T22:53:41.329656+0000","last_fullsized":"2024-06-02T22:53:41.329656+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:43:34.729351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330290+0000","last_change":"2024-06-02T22:53:39.230447+0000","last_active":"2024-06-02T22:53:41.330290+0000","last_peered":"2024-06-02T22:53:41.330290+0000","last_clean":"2024-06-02T22:53:41.330290+0000","last_became_active":"2024-06-02T22:53:39.230139+0000","last_became_peered":"2024-06-02T22:53:39.230139+0000","last_unstale":"2024-06-02T22:53:41.330290+0000","last_undegraded":"2024-06-02T22:53:41.330290+0000","last_fullsized":"2024-06-02T22:53:41.330290+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:23:27.432198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681750+0000","last_change":"2024-06-02T22:53:39.237669+0000","last_active":"2024-06-02T22:53:40.681750+0000","last_peered":"2024-06-02T22:53:40.681750+0000","last_clean":"2024-06-02T22:53:40.681750+0000","last_became_active":"2024-06-02T22:53:39.237322+0000","last_became_peered":"2024-06-02T22:53:39.237322+0000","last_unstale":"2024-06-02T22:53:40.681750+0000","last_undegraded":"2024-06-02T22:53:40.681750+0000","last_fullsized":"2024-06-02T22:53:40.681750+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:05.997684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329892+0000","last_change":"2024-06-02T22:53:39.231342+0000","last_active":"2024-06-02T22:53:41.329892+0000","last_peered":"2024-06-02T22:53:41.329892+0000","last_clean":"2024-06-02T22:53:41.329892+0000","last_became_active":"2024-06-02T22:53:39.231066+0000","last_became_peered":"2024-06-02T22:53:39.231066+0000","last_unstale":"2024-06-02T22:53:41.329892+0000","last_undegraded":"2024-06-02T22:53:41.329892+0000","last_fullsized":"2024-06-02T22:53:41.329892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:44:37.835649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681811+0000","last_change":"2024-06-02T22:53:39.238588+0000","last_active":"2024-06-02T22:53:40.681811+0000","last_peered":"2024-06-02T22:53:40.681811+0000","last_clean":"2024-06-02T22:53:40.681811+0000","last_became_active":"2024-06-02T22:53:39.237590+0000","last_became_peered":"2024-06-02T22:53:39.237590+0000","last_unstale":"2024-06-02T22:53:40.681811+0000","last_undegraded":"2024-06-02T22:53:40.681811+0000","last_fullsized":"2024-06-02T22:53:40.681811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:13:01.894721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218159+0000","last_change":"2024-06-02T22:53:39.223653+0000","last_active":"2024-06-02T22:53:40.218159+0000","last_peered":"2024-06-02T22:53:40.218159+0000","last_clean":"2024-06-02T22:53:40.218159+0000","last_became_active":"2024-06-02T22:53:39.223381+0000","last_became_peered":"2024-06-02T22:53:39.223381+0000","last_unstale":"2024-06-02T22:53:40.218159+0000","last_undegraded":"2024-06-02T22:53:40.218159+0000","last_fullsized":"2024-06-02T22:53:40.218159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:07:48.891951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329712+0000","last_change":"2024-06-02T22:53:39.226486+0000","last_active":"2024-06-02T22:53:41.329712+0000","last_peered":"2024-06-02T22:53:41.329712+0000","last_clean":"2024-06-02T22:53:41.329712+0000","last_became_active":"2024-06-02T22:53:39.226223+0000","last_became_peered":"2024-06-02T22:53:39.226223+0000","last_unstale":"2024-06-02T22:53:41.329712+0000","last_undegraded":"2024-06-02T22:53:41.329712+0000","last_fullsized":"2024-06-02T22:53:41.329712+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:25:27.058614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370469+0000","last_change":"2024-06-02T22:53:39.231112+0000","last_active":"2024-06-02T22:53:40.370469+0000","last_peered":"2024-06-02T22:53:40.370469+0000","last_clean":"2024-06-02T22:53:40.370469+0000","last_became_active":"2024-06-02T22:53:39.230764+0000","last_became_peered":"2024-06-02T22:53:39.230764+0000","last_unstale":"2024-06-02T22:53:40.370469+0000","last_undegraded":"2024-06-02T22:53:40.370469+0000","last_fullsized":"2024-06-02T22:53:40.370469+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:08:46.066561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330611+0000","last_change":"2024-06-02T22:53:39.225929+0000","last_active":"2024-06-02T22:53:41.330611+0000","last_peered":"2024-06-02T22:53:41.330611+0000","last_clean":"2024-06-02T22:53:41.330611+0000","last_became_active":"2024-06-02T22:53:39.225412+0000","last_became_peered":"2024-06-02T22:53:39.225412+0000","last_unstale":"2024-06-02T22:53:41.330611+0000","last_undegraded":"2024-06-02T22:53:41.330611+0000","last_fullsized":"2024-06-02T22:53:41.330611+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:34:27.118218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329695+0000","last_change":"2024-06-02T22:53:39.231770+0000","last_active":"2024-06-02T22:53:41.329695+0000","last_peered":"2024-06-02T22:53:41.329695+0000","last_clean":"2024-06-02T22:53:41.329695+0000","last_became_active":"2024-06-02T22:53:39.231418+0000","last_became_peered":"2024-06-02T22:53:39.231418+0000","last_unstale":"2024-06-02T22:53:41.329695+0000","last_undegraded":"2024-06-02T22:53:41.329695+0000","last_fullsized":"2024-06-02T22:53:41.329695+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:15:57.043235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330407+0000","last_change":"2024-06-02T22:53:39.226619+0000","last_active":"2024-06-02T22:53:41.330407+0000","last_peered":"2024-06-02T22:53:41.330407+0000","last_clean":"2024-06-02T22:53:41.330407+0000","last_became_active":"2024-06-02T22:53:39.225946+0000","last_became_peered":"2024-06-02T22:53:39.225946+0000","last_unstale":"2024-06-02T22:53:41.330407+0000","last_undegraded":"2024-06-02T22:53:41.330407+0000","last_fullsized":"2024-06-02T22:53:41.330407+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:59:30.098876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681743+0000","last_change":"2024-06-02T22:53:39.237697+0000","last_active":"2024-06-02T22:53:40.681743+0000","last_peered":"2024-06-02T22:53:40.681743+0000","last_clean":"2024-06-02T22:53:40.681743+0000","last_became_active":"2024-06-02T22:53:39.236964+0000","last_became_peered":"2024-06-02T22:53:39.236964+0000","last_unstale":"2024-06-02T22:53:40.681743+0000","last_undegraded":"2024-06-02T22:53:40.681743+0000","last_fullsized":"2024-06-02T22:53:40.681743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:09:25.874398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329509+0000","last_change":"2024-06-02T22:53:39.222767+0000","last_active":"2024-06-02T22:53:41.329509+0000","last_peered":"2024-06-02T22:53:41.329509+0000","last_clean":"2024-06-02T22:53:41.329509+0000","last_became_active":"2024-06-02T22:53:39.222498+0000","last_became_peered":"2024-06-02T22:53:39.222498+0000","last_unstale":"2024-06-02T22:53:41.329509+0000","last_undegraded":"2024-06-02T22:53:41.329509+0000","last_fullsized":"2024-06-02T22:53:41.329509+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:13:01.891277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330966+0000","last_change":"2024-06-02T22:53:39.225434+0000","last_active":"2024-06-02T22:53:41.330966+0000","last_peered":"2024-06-02T22:53:41.330966+0000","last_clean":"2024-06-02T22:53:41.330966+0000","last_became_active":"2024-06-02T22:53:39.225082+0000","last_became_peered":"2024-06-02T22:53:39.225082+0000","last_unstale":"2024-06-02T22:53:41.330966+0000","last_undegraded":"2024-06-02T22:53:41.330966+0000","last_fullsized":"2024-06-02T22:53:41.330966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:05:10.982237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330713+0000","last_change":"2024-06-02T22:53:39.229166+0000","last_active":"2024-06-02T22:53:41.330713+0000","last_peered":"2024-06-02T22:53:41.330713+0000","last_clean":"2024-06-02T22:53:41.330713+0000","last_became_active":"2024-06-02T22:53:39.228798+0000","last_became_peered":"2024-06-02T22:53:39.228798+0000","last_unstale":"2024-06-02T22:53:41.330713+0000","last_undegraded":"2024-06-02T22:53:41.330713+0000","last_fullsized":"2024-06-02T22:53:41.330713+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:05.997684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330716+0000","last_change":"2024-06-02T22:53:38.522751+0000","last_active":"2024-06-02T22:53:41.330716+0000","last_peered":"2024-06-02T22:53:41.330716+0000","last_clean":"2024-06-02T22:53:41.330716+0000","last_became_active":"2024-06-02T22:53:38.522361+0000","last_became_peered":"2024-06-02T22:53:38.522361+0000","last_unstale":"2024-06-02T22:53:41.330716+0000","last_undegraded":"2024-06-02T22:53:41.330716+0000","last_fullsized":"2024-06-02T22:53:41.330716+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:15:21.315741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216885+0000","last_change":"2024-06-02T22:53:39.228688+0000","last_active":"2024-06-02T22:53:40.216885+0000","last_peered":"2024-06-02T22:53:40.216885+0000","last_clean":"2024-06-02T22:53:40.216885+0000","last_became_active":"2024-06-02T22:53:39.228455+0000","last_became_peered":"2024-06-02T22:53:39.228455+0000","last_unstale":"2024-06-02T22:53:40.216885+0000","last_undegraded":"2024-06-02T22:53:40.216885+0000","last_fullsized":"2024-06-02T22:53:40.216885+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:05:18.549306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330171+0000","last_change":"2024-06-02T22:53:38.522514+0000","last_active":"2024-06-02T22:53:41.330171+0000","last_peered":"2024-06-02T22:53:41.330171+0000","last_clean":"2024-06-02T22:53:41.330171+0000","last_became_active":"2024-06-02T22:53:38.522215+0000","last_became_peered":"2024-06-02T22:53:38.522215+0000","last_unstale":"2024-06-02T22:53:41.330171+0000","last_undegraded":"2024-06-02T22:53:41.330171+0000","last_fullsized":"2024-06-02T22:53:41.330171+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:08:45.064661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330583+0000","last_change":"2024-06-02T22:53:39.220368+0000","last_active":"2024-06-02T22:53:41.330583+0000","last_peered":"2024-06-02T22:53:41.330583+0000","last_clean":"2024-06-02T22:53:41.330583+0000","last_became_active":"2024-06-02T22:53:39.220073+0000","last_became_peered":"2024-06-02T22:53:39.220073+0000","last_unstale":"2024-06-02T22:53:41.330583+0000","last_undegraded":"2024-06-02T22:53:41.330583+0000","last_fullsized":"2024-06-02T22:53:41.330583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:25:24.155798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330824+0000","last_change":"2024-06-02T22:53:38.521131+0000","last_active":"2024-06-02T22:53:41.330824+0000","last_peered":"2024-06-02T22:53:41.330824+0000","last_clean":"2024-06-02T22:53:41.330824+0000","last_became_active":"2024-06-02T22:53:38.520810+0000","last_became_peered":"2024-06-02T22:53:38.520810+0000","last_unstale":"2024-06-02T22:53:41.330824+0000","last_undegraded":"2024-06-02T22:53:41.330824+0000","last_fullsized":"2024-06-02T22:53:41.330824+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:05:17.547407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330743+0000","last_change":"2024-06-02T22:53:39.223944+0000","last_active":"2024-06-02T22:53:41.330743+0000","last_peered":"2024-06-02T22:53:41.330743+0000","last_clean":"2024-06-02T22:53:41.330743+0000","last_became_active":"2024-06-02T22:53:39.223376+0000","last_became_peered":"2024-06-02T22:53:39.223376+0000","last_unstale":"2024-06-02T22:53:41.330743+0000","last_undegraded":"2024-06-02T22:53:41.330743+0000","last_fullsized":"2024-06-02T22:53:41.330743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:51:00.587950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370648+0000","last_change":"2024-06-02T22:53:38.522297+0000","last_active":"2024-06-02T22:53:40.370648+0000","last_peered":"2024-06-02T22:53:40.370648+0000","last_clean":"2024-06-02T22:53:40.370648+0000","last_became_active":"2024-06-02T22:53:38.521981+0000","last_became_peered":"2024-06-02T22:53:38.521981+0000","last_unstale":"2024-06-02T22:53:40.370648+0000","last_undegraded":"2024-06-02T22:53:40.370648+0000","last_fullsized":"2024-06-02T22:53:40.370648+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:42.040063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330835+0000","last_change":"2024-06-02T22:53:39.231298+0000","last_active":"2024-06-02T22:53:41.330835+0000","last_peered":"2024-06-02T22:53:41.330835+0000","last_clean":"2024-06-02T22:53:41.330835+0000","last_became_active":"2024-06-02T22:53:39.230730+0000","last_became_peered":"2024-06-02T22:53:39.230730+0000","last_unstale":"2024-06-02T22:53:41.330835+0000","last_undegraded":"2024-06-02T22:53:41.330835+0000","last_fullsized":"2024-06-02T22:53:41.330835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:06:06.067588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217730+0000","last_change":"2024-06-02T22:53:38.520747+0000","last_active":"2024-06-02T22:53:40.217730+0000","last_peered":"2024-06-02T22:53:40.217730+0000","last_clean":"2024-06-02T22:53:40.217730+0000","last_became_active":"2024-06-02T22:53:38.520520+0000","last_became_peered":"2024-06-02T22:53:38.520520+0000","last_unstale":"2024-06-02T22:53:40.217730+0000","last_undegraded":"2024-06-02T22:53:40.217730+0000","last_fullsized":"2024-06-02T22:53:40.217730+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:19:38.973859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329989+0000","last_change":"2024-06-02T22:53:39.226835+0000","last_active":"2024-06-02T22:53:41.329989+0000","last_peered":"2024-06-02T22:53:41.329989+0000","last_clean":"2024-06-02T22:53:41.329989+0000","last_became_active":"2024-06-02T22:53:39.226320+0000","last_became_peered":"2024-06-02T22:53:39.226320+0000","last_unstale":"2024-06-02T22:53:41.329989+0000","last_undegraded":"2024-06-02T22:53:41.329989+0000","last_fullsized":"2024-06-02T22:53:41.329989+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:13.991919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330301+0000","last_change":"2024-06-02T22:53:38.512688+0000","last_active":"2024-06-02T22:53:41.330301+0000","last_peered":"2024-06-02T22:53:41.330301+0000","last_clean":"2024-06-02T22:53:41.330301+0000","last_became_active":"2024-06-02T22:53:38.512371+0000","last_became_peered":"2024-06-02T22:53:38.512371+0000","last_unstale":"2024-06-02T22:53:41.330301+0000","last_undegraded":"2024-06-02T22:53:41.330301+0000","last_fullsized":"2024-06-02T22:53:41.330301+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:59.373751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218296+0000","last_change":"2024-06-02T22:53:39.229208+0000","last_active":"2024-06-02T22:53:40.218296+0000","last_peered":"2024-06-02T22:53:40.218296+0000","last_clean":"2024-06-02T22:53:40.218296+0000","last_became_active":"2024-06-02T22:53:39.228866+0000","last_became_peered":"2024-06-02T22:53:39.228866+0000","last_unstale":"2024-06-02T22:53:40.218296+0000","last_undegraded":"2024-06-02T22:53:40.218296+0000","last_fullsized":"2024-06-02T22:53:40.218296+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:20.011764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370222+0000","last_change":"2024-06-02T22:53:38.522212+0000","last_active":"2024-06-02T22:53:40.370222+0000","last_peered":"2024-06-02T22:53:40.370222+0000","last_clean":"2024-06-02T22:53:40.370222+0000","last_became_active":"2024-06-02T22:53:38.521831+0000","last_became_peered":"2024-06-02T22:53:38.521831+0000","last_unstale":"2024-06-02T22:53:40.370222+0000","last_undegraded":"2024-06-02T22:53:40.370222+0000","last_fullsized":"2024-06-02T22:53:40.370222+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:33.435379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.331049+0000","last_change":"2024-06-02T22:53:39.231155+0000","last_active":"2024-06-02T22:53:41.331049+0000","last_peered":"2024-06-02T22:53:41.331049+0000","last_clean":"2024-06-02T22:53:41.331049+0000","last_became_active":"2024-06-02T22:53:39.228519+0000","last_became_peered":"2024-06-02T22:53:39.228519+0000","last_unstale":"2024-06-02T22:53:41.331049+0000","last_undegraded":"2024-06-02T22:53:41.331049+0000","last_fullsized":"2024-06-02T22:53:41.331049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:04:12.890590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217474+0000","last_change":"2024-06-02T22:53:38.515279+0000","last_active":"2024-06-02T22:53:40.217474+0000","last_peered":"2024-06-02T22:53:40.217474+0000","last_clean":"2024-06-02T22:53:40.217474+0000","last_became_active":"2024-06-02T22:53:38.514983+0000","last_became_peered":"2024-06-02T22:53:38.514983+0000","last_unstale":"2024-06-02T22:53:40.217474+0000","last_undegraded":"2024-06-02T22:53:40.217474+0000","last_fullsized":"2024-06-02T22:53:40.217474+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:52:48.120405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217926+0000","last_change":"2024-06-02T22:53:39.218223+0000","last_active":"2024-06-02T22:53:40.217926+0000","last_peered":"2024-06-02T22:53:40.217926+0000","last_clean":"2024-06-02T22:53:40.217926+0000","last_became_active":"2024-06-02T22:53:39.217866+0000","last_became_peered":"2024-06-02T22:53:39.217866+0000","last_unstale":"2024-06-02T22:53:40.217926+0000","last_undegraded":"2024-06-02T22:53:40.217926+0000","last_fullsized":"2024-06-02T22:53:40.217926+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:43.041962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682180+0000","last_change":"2024-06-02T22:53:38.520159+0000","last_active":"2024-06-02T22:53:40.682180+0000","last_peered":"2024-06-02T22:53:40.682180+0000","last_clean":"2024-06-02T22:53:40.682180+0000","last_became_active":"2024-06-02T22:53:38.519837+0000","last_became_peered":"2024-06-02T22:53:38.519837+0000","last_unstale":"2024-06-02T22:53:40.682180+0000","last_undegraded":"2024-06-02T22:53:40.682180+0000","last_fullsized":"2024-06-02T22:53:40.682180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:37:06.108356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682223+0000","last_change":"2024-06-02T22:53:39.232736+0000","last_active":"2024-06-02T22:53:40.682223+0000","last_peered":"2024-06-02T22:53:40.682223+0000","last_clean":"2024-06-02T22:53:40.682223+0000","last_became_active":"2024-06-02T22:53:39.232419+0000","last_became_peered":"2024-06-02T22:53:39.232419+0000","last_unstale":"2024-06-02T22:53:40.682223+0000","last_undegraded":"2024-06-02T22:53:40.682223+0000","last_fullsized":"2024-06-02T22:53:40.682223+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:43:39.467852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330254+0000","last_change":"2024-06-02T22:53:38.521237+0000","last_active":"2024-06-02T22:53:41.330254+0000","last_peered":"2024-06-02T22:53:41.330254+0000","last_clean":"2024-06-02T22:53:41.330254+0000","last_became_active":"2024-06-02T22:53:38.520966+0000","last_became_peered":"2024-06-02T22:53:38.520966+0000","last_unstale":"2024-06-02T22:53:41.330254+0000","last_undegraded":"2024-06-02T22:53:41.330254+0000","last_fullsized":"2024-06-02T22:53:41.330254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:43:23.394406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216677+0000","last_change":"2024-06-02T22:53:39.218650+0000","last_active":"2024-06-02T22:53:40.216677+0000","last_peered":"2024-06-02T22:53:40.216677+0000","last_clean":"2024-06-02T22:53:40.216677+0000","last_became_active":"2024-06-02T22:53:39.218401+0000","last_became_peered":"2024-06-02T22:53:39.218401+0000","last_unstale":"2024-06-02T22:53:40.216677+0000","last_undegraded":"2024-06-02T22:53:40.216677+0000","last_fullsized":"2024-06-02T22:53:40.216677+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:15:22.317641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682246+0000","last_change":"2024-06-02T22:53:38.519276+0000","last_active":"2024-06-02T22:53:40.682246+0000","last_peered":"2024-06-02T22:53:40.682246+0000","last_clean":"2024-06-02T22:53:40.682246+0000","last_became_active":"2024-06-02T22:53:38.519001+0000","last_became_peered":"2024-06-02T22:53:38.519001+0000","last_unstale":"2024-06-02T22:53:40.682246+0000","last_undegraded":"2024-06-02T22:53:40.682246+0000","last_fullsized":"2024-06-02T22:53:40.682246+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:07:20.915834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682106+0000","last_change":"2024-06-02T22:53:39.230534+0000","last_active":"2024-06-02T22:53:40.682106+0000","last_peered":"2024-06-02T22:53:40.682106+0000","last_clean":"2024-06-02T22:53:40.682106+0000","last_became_active":"2024-06-02T22:53:39.228668+0000","last_became_peered":"2024-06-02T22:53:39.228668+0000","last_unstale":"2024-06-02T22:53:40.682106+0000","last_undegraded":"2024-06-02T22:53:40.682106+0000","last_fullsized":"2024-06-02T22:53:40.682106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:11:13.964052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218092+0000","last_change":"2024-06-02T22:53:38.517458+0000","last_active":"2024-06-02T22:53:40.218092+0000","last_peered":"2024-06-02T22:53:40.218092+0000","last_clean":"2024-06-02T22:53:40.218092+0000","last_became_active":"2024-06-02T22:53:38.517211+0000","last_became_peered":"2024-06-02T22:53:38.517211+0000","last_unstale":"2024-06-02T22:53:40.218092+0000","last_undegraded":"2024-06-02T22:53:40.218092+0000","last_fullsized":"2024-06-02T22:53:40.218092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:19:18.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370222+0000","last_change":"2024-06-02T22:53:39.226924+0000","last_active":"2024-06-02T22:53:40.370222+0000","last_peered":"2024-06-02T22:53:40.370222+0000","last_clean":"2024-06-02T22:53:40.370222+0000","last_became_active":"2024-06-02T22:53:39.226655+0000","last_became_peered":"2024-06-02T22:53:39.226655+0000","last_unstale":"2024-06-02T22:53:40.370222+0000","last_undegraded":"2024-06-02T22:53:40.370222+0000","last_fullsized":"2024-06-02T22:53:40.370222+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:14:21.846516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330084+0000","last_change":"2024-06-02T22:53:38.523424+0000","last_active":"2024-06-02T22:53:41.330084+0000","last_peered":"2024-06-02T22:53:41.330084+0000","last_clean":"2024-06-02T22:53:41.330084+0000","last_became_active":"2024-06-02T22:53:38.523001+0000","last_became_peered":"2024-06-02T22:53:38.523001+0000","last_unstale":"2024-06-02T22:53:41.330084+0000","last_undegraded":"2024-06-02T22:53:41.330084+0000","last_fullsized":"2024-06-02T22:53:41.330084+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:32.950818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681792+0000","last_change":"2024-06-02T22:53:39.231475+0000","last_active":"2024-06-02T22:53:40.681792+0000","last_peered":"2024-06-02T22:53:40.681792+0000","last_clean":"2024-06-02T22:53:40.681792+0000","last_became_active":"2024-06-02T22:53:39.231156+0000","last_became_peered":"2024-06-02T22:53:39.231156+0000","last_unstale":"2024-06-02T22:53:40.681792+0000","last_undegraded":"2024-06-02T22:53:40.681792+0000","last_fullsized":"2024-06-02T22:53:40.681792+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:51:00.587950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218275+0000","last_change":"2024-06-02T22:53:38.515112+0000","last_active":"2024-06-02T22:53:40.218275+0000","last_peered":"2024-06-02T22:53:40.218275+0000","last_clean":"2024-06-02T22:53:40.218275+0000","last_became_active":"2024-06-02T22:53:38.514823+0000","last_became_peered":"2024-06-02T22:53:38.514823+0000","last_unstale":"2024-06-02T22:53:40.218275+0000","last_undegraded":"2024-06-02T22:53:40.218275+0000","last_fullsized":"2024-06-02T22:53:40.218275+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:35:19.337672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.217527+0000","last_change":"2024-06-02T22:53:39.228281+0000","last_active":"2024-06-02T22:53:40.217527+0000","last_peered":"2024-06-02T22:53:40.217527+0000","last_clean":"2024-06-02T22:53:40.217527+0000","last_became_active":"2024-06-02T22:53:39.227961+0000","last_became_peered":"2024-06-02T22:53:39.227961+0000","last_unstale":"2024-06-02T22:53:40.217527+0000","last_undegraded":"2024-06-02T22:53:40.217527+0000","last_fullsized":"2024-06-02T22:53:40.217527+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:29:57.640178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370242+0000","last_change":"2024-06-02T22:53:38.522532+0000","last_active":"2024-06-02T22:53:40.370242+0000","last_peered":"2024-06-02T22:53:40.370242+0000","last_clean":"2024-06-02T22:53:40.370242+0000","last_became_active":"2024-06-02T22:53:38.522230+0000","last_became_peered":"2024-06-02T22:53:38.522230+0000","last_unstale":"2024-06-02T22:53:40.370242+0000","last_undegraded":"2024-06-02T22:53:40.370242+0000","last_fullsized":"2024-06-02T22:53:40.370242+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:59.373751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681793+0000","last_change":"2024-06-02T22:53:39.238581+0000","last_active":"2024-06-02T22:53:40.681793+0000","last_peered":"2024-06-02T22:53:40.681793+0000","last_clean":"2024-06-02T22:53:40.681793+0000","last_became_active":"2024-06-02T22:53:39.238225+0000","last_became_peered":"2024-06-02T22:53:39.238225+0000","last_unstale":"2024-06-02T22:53:40.681793+0000","last_undegraded":"2024-06-02T22:53:40.681793+0000","last_fullsized":"2024-06-02T22:53:40.681793+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:49:11.033805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681827+0000","last_change":"2024-06-02T22:53:38.522015+0000","last_active":"2024-06-02T22:53:40.681827+0000","last_peered":"2024-06-02T22:53:40.681827+0000","last_clean":"2024-06-02T22:53:40.681827+0000","last_became_active":"2024-06-02T22:53:38.521648+0000","last_became_peered":"2024-06-02T22:53:38.521648+0000","last_unstale":"2024-06-02T22:53:40.681827+0000","last_undegraded":"2024-06-02T22:53:40.681827+0000","last_fullsized":"2024-06-02T22:53:40.681827+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:17.919301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682165+0000","last_change":"2024-06-02T22:53:39.238175+0000","last_active":"2024-06-02T22:53:40.682165+0000","last_peered":"2024-06-02T22:53:40.682165+0000","last_clean":"2024-06-02T22:53:40.682165+0000","last_became_active":"2024-06-02T22:53:39.236799+0000","last_became_peered":"2024-06-02T22:53:39.236799+0000","last_unstale":"2024-06-02T22:53:40.682165+0000","last_undegraded":"2024-06-02T22:53:40.682165+0000","last_fullsized":"2024-06-02T22:53:40.682165+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:47:11.690417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330400+0000","last_change":"2024-06-02T22:53:38.520955+0000","last_active":"2024-06-02T22:53:41.330400+0000","last_peered":"2024-06-02T22:53:41.330400+0000","last_clean":"2024-06-02T22:53:41.330400+0000","last_became_active":"2024-06-02T22:53:38.520683+0000","last_became_peered":"2024-06-02T22:53:38.520683+0000","last_unstale":"2024-06-02T22:53:41.330400+0000","last_undegraded":"2024-06-02T22:53:41.330400+0000","last_fullsized":"2024-06-02T22:53:41.330400+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:26:12.529239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370672+0000","last_change":"2024-06-02T22:53:39.226111+0000","last_active":"2024-06-02T22:53:40.370672+0000","last_peered":"2024-06-02T22:53:40.370672+0000","last_clean":"2024-06-02T22:53:40.370672+0000","last_became_active":"2024-06-02T22:53:39.225839+0000","last_became_peered":"2024-06-02T22:53:39.225839+0000","last_unstale":"2024-06-02T22:53:40.370672+0000","last_undegraded":"2024-06-02T22:53:40.370672+0000","last_fullsized":"2024-06-02T22:53:40.370672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:05.997684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330547+0000","last_change":"2024-06-02T22:53:38.520305+0000","last_active":"2024-06-02T22:53:41.330547+0000","last_peered":"2024-06-02T22:53:41.330547+0000","last_clean":"2024-06-02T22:53:41.330547+0000","last_became_active":"2024-06-02T22:53:38.519650+0000","last_became_peered":"2024-06-02T22:53:38.519650+0000","last_unstale":"2024-06-02T22:53:41.330547+0000","last_undegraded":"2024-06-02T22:53:41.330547+0000","last_fullsized":"2024-06-02T22:53:41.330547+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:19:42.040063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330401+0000","last_change":"2024-06-02T22:53:39.232298+0000","last_active":"2024-06-02T22:53:41.330401+0000","last_peered":"2024-06-02T22:53:41.330401+0000","last_clean":"2024-06-02T22:53:41.330401+0000","last_became_active":"2024-06-02T22:53:39.231840+0000","last_became_peered":"2024-06-02T22:53:39.231840+0000","last_unstale":"2024-06-02T22:53:41.330401+0000","last_undegraded":"2024-06-02T22:53:41.330401+0000","last_fullsized":"2024-06-02T22:53:41.330401+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:26.001190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370468+0000","last_change":"2024-06-02T22:53:38.522098+0000","last_active":"2024-06-02T22:53:40.370468+0000","last_peered":"2024-06-02T22:53:40.370468+0000","last_clean":"2024-06-02T22:53:40.370468+0000","last_became_active":"2024-06-02T22:53:38.521757+0000","last_became_peered":"2024-06-02T22:53:38.521757+0000","last_unstale":"2024-06-02T22:53:40.370468+0000","last_undegraded":"2024-06-02T22:53:40.370468+0000","last_fullsized":"2024-06-02T22:53:40.370468+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:05:17.547407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.682178+0000","last_change":"2024-06-02T22:53:39.232107+0000","last_active":"2024-06-02T22:53:40.682178+0000","last_peered":"2024-06-02T22:53:40.682178+0000","last_clean":"2024-06-02T22:53:40.682178+0000","last_became_active":"2024-06-02T22:53:39.231488+0000","last_became_peered":"2024-06-02T22:53:39.231488+0000","last_unstale":"2024-06-02T22:53:40.682178+0000","last_undegraded":"2024-06-02T22:53:40.682178+0000","last_fullsized":"2024-06-02T22:53:40.682178+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:57.784028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330584+0000","last_change":"2024-06-02T22:53:38.520503+0000","last_active":"2024-06-02T22:53:41.330584+0000","last_peered":"2024-06-02T22:53:41.330584+0000","last_clean":"2024-06-02T22:53:41.330584+0000","last_became_active":"2024-06-02T22:53:38.520199+0000","last_became_peered":"2024-06-02T22:53:38.520199+0000","last_unstale":"2024-06-02T22:53:41.330584+0000","last_undegraded":"2024-06-02T22:53:41.330584+0000","last_fullsized":"2024-06-02T22:53:41.330584+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:33.435379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370450+0000","last_change":"2024-06-02T22:53:39.226895+0000","last_active":"2024-06-02T22:53:40.370450+0000","last_peered":"2024-06-02T22:53:40.370450+0000","last_clean":"2024-06-02T22:53:40.370450+0000","last_became_active":"2024-06-02T22:53:39.226556+0000","last_became_peered":"2024-06-02T22:53:39.226556+0000","last_unstale":"2024-06-02T22:53:40.370450+0000","last_undegraded":"2024-06-02T22:53:40.370450+0000","last_fullsized":"2024-06-02T22:53:40.370450+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:26:13.531139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330522+0000","last_change":"2024-06-02T22:53:38.514056+0000","last_active":"2024-06-02T22:53:41.330522+0000","last_peered":"2024-06-02T22:53:41.330522+0000","last_clean":"2024-06-02T22:53:41.330522+0000","last_became_active":"2024-06-02T22:53:38.513758+0000","last_became_peered":"2024-06-02T22:53:38.513758+0000","last_unstale":"2024-06-02T22:53:41.330522+0000","last_undegraded":"2024-06-02T22:53:41.330522+0000","last_fullsized":"2024-06-02T22:53:41.330522+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:14:20.844616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330410+0000","last_change":"2024-06-02T22:53:39.219365+0000","last_active":"2024-06-02T22:53:41.330410+0000","last_peered":"2024-06-02T22:53:41.330410+0000","last_clean":"2024-06-02T22:53:41.330410+0000","last_became_active":"2024-06-02T22:53:39.218932+0000","last_became_peered":"2024-06-02T22:53:39.218932+0000","last_unstale":"2024-06-02T22:53:41.330410+0000","last_undegraded":"2024-06-02T22:53:41.330410+0000","last_fullsized":"2024-06-02T22:53:41.330410+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:43:24.396305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216534+0000","last_change":"2024-06-02T22:53:38.520364+0000","last_active":"2024-06-02T22:53:40.216534+0000","last_peered":"2024-06-02T22:53:40.216534+0000","last_clean":"2024-06-02T22:53:40.216534+0000","last_became_active":"2024-06-02T22:53:38.520052+0000","last_became_peered":"2024-06-02T22:53:38.520052+0000","last_unstale":"2024-06-02T22:53:40.216534+0000","last_undegraded":"2024-06-02T22:53:40.216534+0000","last_fullsized":"2024-06-02T22:53:40.216534+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:19:38.973859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330659+0000","last_change":"2024-06-02T22:53:39.229115+0000","last_active":"2024-06-02T22:53:41.330659+0000","last_peered":"2024-06-02T22:53:41.330659+0000","last_clean":"2024-06-02T22:53:41.330659+0000","last_became_active":"2024-06-02T22:53:39.228840+0000","last_became_peered":"2024-06-02T22:53:39.228840+0000","last_unstale":"2024-06-02T22:53:41.330659+0000","last_undegraded":"2024-06-02T22:53:41.330659+0000","last_fullsized":"2024-06-02T22:53:41.330659+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:09:25.874398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370205+0000","last_change":"2024-06-02T22:53:38.519974+0000","last_active":"2024-06-02T22:53:40.370205+0000","last_peered":"2024-06-02T22:53:40.370205+0000","last_clean":"2024-06-02T22:53:40.370205+0000","last_became_active":"2024-06-02T22:53:38.519672+0000","last_became_peered":"2024-06-02T22:53:38.519672+0000","last_unstale":"2024-06-02T22:53:40.370205+0000","last_undegraded":"2024-06-02T22:53:40.370205+0000","last_fullsized":"2024-06-02T22:53:40.370205+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:15:21.315741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370673+0000","last_change":"2024-06-02T22:53:39.225897+0000","last_active":"2024-06-02T22:53:40.370673+0000","last_peered":"2024-06-02T22:53:40.370673+0000","last_clean":"2024-06-02T22:53:40.370673+0000","last_became_active":"2024-06-02T22:53:39.225597+0000","last_became_peered":"2024-06-02T22:53:39.225597+0000","last_unstale":"2024-06-02T22:53:40.370673+0000","last_undegraded":"2024-06-02T22:53:40.370673+0000","last_fullsized":"2024-06-02T22:53:40.370673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:09:25.874398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216855+0000","last_change":"2024-06-02T22:53:38.515823+0000","last_active":"2024-06-02T22:53:40.216855+0000","last_peered":"2024-06-02T22:53:40.216855+0000","last_clean":"2024-06-02T22:53:40.216855+0000","last_became_active":"2024-06-02T22:53:38.515511+0000","last_became_peered":"2024-06-02T22:53:38.515511+0000","last_unstale":"2024-06-02T22:53:40.216855+0000","last_undegraded":"2024-06-02T22:53:40.216855+0000","last_fullsized":"2024-06-02T22:53:40.216855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:10:10.965478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370664+0000","last_change":"2024-06-02T22:53:39.236459+0000","last_active":"2024-06-02T22:53:40.370664+0000","last_peered":"2024-06-02T22:53:40.370664+0000","last_clean":"2024-06-02T22:53:40.370664+0000","last_became_active":"2024-06-02T22:53:39.236024+0000","last_became_peered":"2024-06-02T22:53:39.236024+0000","last_unstale":"2024-06-02T22:53:40.370664+0000","last_undegraded":"2024-06-02T22:53:40.370664+0000","last_fullsized":"2024-06-02T22:53:40.370664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:34:27.118218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"54'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.518829+0000","last_change":"2024-06-02T22:53:38.518505+0000","last_active":"2024-06-02T22:53:41.518829+0000","last_peered":"2024-06-02T22:53:41.518829+0000","last_clean":"2024-06-02T22:53:41.518829+0000","last_became_active":"2024-06-02T22:53:38.518190+0000","last_became_peered":"2024-06-02T22:53:38.518190+0000","last_unstale":"2024-06-02T22:53:41.518829+0000","last_undegraded":"2024-06-02T22:53:41.518829+0000","last_fullsized":"2024-06-02T22:53:41.518829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:17.919301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216779+0000","last_change":"2024-06-02T22:53:39.218572+0000","last_active":"2024-06-02T22:53:40.216779+0000","last_peered":"2024-06-02T22:53:40.216779+0000","last_clean":"2024-06-02T22:53:40.216779+0000","last_became_active":"2024-06-02T22:53:39.218304+0000","last_became_peered":"2024-06-02T22:53:39.218304+0000","last_unstale":"2024-06-02T22:53:40.216779+0000","last_undegraded":"2024-06-02T22:53:40.216779+0000","last_fullsized":"2024-06-02T22:53:40.216779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:52:34.437279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218199+0000","last_change":"2024-06-02T22:53:38.509588+0000","last_active":"2024-06-02T22:53:40.218199+0000","last_peered":"2024-06-02T22:53:40.218199+0000","last_clean":"2024-06-02T22:53:40.218199+0000","last_became_active":"2024-06-02T22:53:38.509305+0000","last_became_peered":"2024-06-02T22:53:38.509305+0000","last_unstale":"2024-06-02T22:53:40.218199+0000","last_undegraded":"2024-06-02T22:53:40.218199+0000","last_fullsized":"2024-06-02T22:53:40.218199+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:19:18.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330774+0000","last_change":"2024-06-02T22:53:39.223582+0000","last_active":"2024-06-02T22:53:41.330774+0000","last_peered":"2024-06-02T22:53:41.330774+0000","last_clean":"2024-06-02T22:53:41.330774+0000","last_became_active":"2024-06-02T22:53:39.223310+0000","last_became_peered":"2024-06-02T22:53:39.223310+0000","last_unstale":"2024-06-02T22:53:41.330774+0000","last_undegraded":"2024-06-02T22:53:41.330774+0000","last_fullsized":"2024-06-02T22:53:41.330774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:49:11.033805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.370677+0000","last_change":"2024-06-02T22:53:38.519652+0000","last_active":"2024-06-02T22:53:40.370677+0000","last_peered":"2024-06-02T22:53:40.370677+0000","last_clean":"2024-06-02T22:53:40.370677+0000","last_became_active":"2024-06-02T22:53:38.519353+0000","last_became_peered":"2024-06-02T22:53:38.519353+0000","last_unstale":"2024-06-02T22:53:40.370677+0000","last_undegraded":"2024-06-02T22:53:40.370677+0000","last_fullsized":"2024-06-02T22:53:40.370677+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:17.919301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330838+0000","last_change":"2024-06-02T22:53:39.225199+0000","last_active":"2024-06-02T22:53:41.330838+0000","last_peered":"2024-06-02T22:53:41.330838+0000","last_clean":"2024-06-02T22:53:41.330838+0000","last_became_active":"2024-06-02T22:53:39.224748+0000","last_became_peered":"2024-06-02T22:53:39.224748+0000","last_unstale":"2024-06-02T22:53:41.330838+0000","last_undegraded":"2024-06-02T22:53:41.330838+0000","last_fullsized":"2024-06-02T22:53:41.330838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:33:30.567837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216488+0000","last_change":"2024-06-02T22:53:38.514739+0000","last_active":"2024-06-02T22:53:40.216488+0000","last_peered":"2024-06-02T22:53:40.216488+0000","last_clean":"2024-06-02T22:53:40.216488+0000","last_became_active":"2024-06-02T22:53:38.514418+0000","last_became_peered":"2024-06-02T22:53:38.514418+0000","last_unstale":"2024-06-02T22:53:40.216488+0000","last_undegraded":"2024-06-02T22:53:40.216488+0000","last_fullsized":"2024-06-02T22:53:40.216488+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:19:18.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681951+0000","last_change":"2024-06-02T22:53:39.237819+0000","last_active":"2024-06-02T22:53:40.681951+0000","last_peered":"2024-06-02T22:53:40.681951+0000","last_clean":"2024-06-02T22:53:40.681951+0000","last_became_active":"2024-06-02T22:53:39.236619+0000","last_became_peered":"2024-06-02T22:53:39.236619+0000","last_unstale":"2024-06-02T22:53:40.681951+0000","last_undegraded":"2024-06-02T22:53:40.681951+0000","last_fullsized":"2024-06-02T22:53:40.681951+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:10:52.547924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218113+0000","last_change":"2024-06-02T22:53:38.513604+0000","last_active":"2024-06-02T22:53:40.218113+0000","last_peered":"2024-06-02T22:53:40.218113+0000","last_clean":"2024-06-02T22:53:40.218113+0000","last_became_active":"2024-06-02T22:53:38.513331+0000","last_became_peered":"2024-06-02T22:53:38.513331+0000","last_unstale":"2024-06-02T22:53:40.218113+0000","last_undegraded":"2024-06-02T22:53:40.218113+0000","last_fullsized":"2024-06-02T22:53:40.218113+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:35:19.337672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216414+0000","last_change":"2024-06-02T22:53:39.220193+0000","last_active":"2024-06-02T22:53:40.216414+0000","last_peered":"2024-06-02T22:53:40.216414+0000","last_clean":"2024-06-02T22:53:40.216414+0000","last_became_active":"2024-06-02T22:53:39.219946+0000","last_became_peered":"2024-06-02T22:53:39.219946+0000","last_unstale":"2024-06-02T22:53:40.216414+0000","last_undegraded":"2024-06-02T22:53:40.216414+0000","last_fullsized":"2024-06-02T22:53:40.216414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:29:57.640178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.216424+0000","last_change":"2024-06-02T22:53:38.519894+0000","last_active":"2024-06-02T22:53:40.216424+0000","last_peered":"2024-06-02T22:53:40.216424+0000","last_clean":"2024-06-02T22:53:40.216424+0000","last_became_active":"2024-06-02T22:53:38.519642+0000","last_became_peered":"2024-06-02T22:53:38.519642+0000","last_unstale":"2024-06-02T22:53:40.216424+0000","last_undegraded":"2024-06-02T22:53:40.216424+0000","last_fullsized":"2024-06-02T22:53:40.216424+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:35:19.337672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.331069+0000","last_change":"2024-06-02T22:53:39.229208+0000","last_active":"2024-06-02T22:53:41.331069+0000","last_peered":"2024-06-02T22:53:41.331069+0000","last_clean":"2024-06-02T22:53:41.331069+0000","last_became_active":"2024-06-02T22:53:39.228175+0000","last_became_peered":"2024-06-02T22:53:39.228175+0000","last_unstale":"2024-06-02T22:53:41.331069+0000","last_undegraded":"2024-06-02T22:53:41.331069+0000","last_fullsized":"2024-06-02T22:53:41.331069+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:11:01.522661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.330044+0000","last_change":"2024-06-02T22:53:38.517431+0000","last_active":"2024-06-02T22:53:41.330044+0000","last_peered":"2024-06-02T22:53:41.330044+0000","last_clean":"2024-06-02T22:53:41.330044+0000","last_became_active":"2024-06-02T22:53:38.517149+0000","last_became_peered":"2024-06-02T22:53:38.517149+0000","last_unstale":"2024-06-02T22:53:41.330044+0000","last_undegraded":"2024-06-02T22:53:41.330044+0000","last_fullsized":"2024-06-02T22:53:41.330044+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:25:23.153899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:41.329961+0000","last_change":"2024-06-02T22:53:39.227213+0000","last_active":"2024-06-02T22:53:41.329961+0000","last_peered":"2024-06-02T22:53:41.329961+0000","last_clean":"2024-06-02T22:53:41.329961+0000","last_became_active":"2024-06-02T22:53:39.226738+0000","last_became_peered":"2024-06-02T22:53:39.226738+0000","last_unstale":"2024-06-02T22:53:41.329961+0000","last_undegraded":"2024-06-02T22:53:41.329961+0000","last_fullsized":"2024-06-02T22:53:41.329961+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:38.497665+0000","last_clean_scrub_stamp":"2024-06-02T22:53:38.497665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:09:44.012150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.218002+0000","last_change":"2024-06-02T22:53:38.517846+0000","last_active":"2024-06-02T22:53:40.218002+0000","last_peered":"2024-06-02T22:53:40.218002+0000","last_clean":"2024-06-02T22:53:40.218002+0000","last_became_active":"2024-06-02T22:53:38.517527+0000","last_became_peered":"2024-06-02T22:53:38.517527+0000","last_unstale":"2024-06-02T22:53:40.218002+0000","last_undegraded":"2024-06-02T22:53:40.218002+0000","last_fullsized":"2024-06-02T22:53:40.218002+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:53:37.495765+0000","last_clean_scrub_stamp":"2024-06-02T22:53:37.495765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:19:38.973859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-06-02T22:53:40.681556+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:53:40.681556+0000","last_peered":"2024-06-02T22:53:40.681556+0000","last_clean":"2024-06-02T22:53:40.681556+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:53:40.681556+0000","last_undegraded":"2024-06-02T22:53:40.681556+0000","last_fullsized":"2024-06-02T22:53:40.681556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":882305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":647168,"data_stored":291777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":292429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":659456,"data_stored":293389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":643072,"data_stored":285141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":643072,"data_stored":285141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":291867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1245184,"data_stored":877647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:53:47.189 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T22:53:47.190 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-02T22:53:47.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.332+0000 7fd7207fb640 1 Processor -- start 2024-06-02T22:53:47.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.332+0000 7fd7207fb640 1 -- start start 2024-06-02T22:53:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.333+0000 7fd7207fb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd71815e1c0 0x7fd7180d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.333+0000 7fd7207fb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7180b2f60 0x7fd7180d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.333+0000 7fd7207fb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7180cf9a0 con 0x7fd71815e5a0 2024-06-02T22:53:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.333+0000 7fd7207fb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd7180d3270 con 0x7fd71815e1c0 2024-06-02T22:53:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.333+0000 7fd7207fb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd7180cfc70 con 0x7fd7180b2f60 2024-06-02T22:53:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.333+0000 7fd71e597640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd71815e1c0 0x7fd7180d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.334+0000 7fd71e597640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd71815e1c0 0x7fd7180d4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40836/0 (socket says 172.21.15.82:40836) 2024-06-02T22:53:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.334+0000 7fd71e597640 1 -- 172.21.15.82:0/979208689 learned_addr learned my addr 172.21.15.82:0/979208689 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.334+0000 7fd71ed98640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd71815e5a0 0x7fd718161f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52950/0 (socket says 172.21.15.82:52950) 2024-06-02T22:53:47.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.334+0000 7fd71dd96640 1 --2- 172.21.15.82:0/979208689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7180b2f60 0x7fd7180d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:47.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.334+0000 7fd71e597640 1 -- 172.21.15.82:0/979208689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7180b2f60 msgr2=0x7fd7180d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:47.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.334+0000 7fd71e597640 1 --2- 172.21.15.82:0/979208689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7180b2f60 0x7fd7180d0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.334+0000 7fd71e597640 1 -- 172.21.15.82:0/979208689 >> v1:172.21.15.82:6789/0 conn(0x7fd71815e5a0 legacy=0x7fd718161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.334+0000 7fd71e597640 1 -- 172.21.15.82:0/979208689 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7180cff50 con 0x7fd71815e1c0 2024-06-02T22:53:47.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.334+0000 7fd71d595640 1 -- 172.21.15.82:0/979208689 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250463513 0 0) 0x7fd7180cf9a0 con 0x7fd71815e5a0 2024-06-02T22:53:47.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.334+0000 7fd71dd96640 1 --2- 172.21.15.82:0/979208689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7180b2f60 0x7fd7180d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:47.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.334+0000 7fd71e597640 1 --2- 172.21.15.82:0/979208689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71815e1c0 0x7fd7180d4bc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd708009e50 tx=0x7fd70802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d0cdb85ba251eb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:47.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.335+0000 7fd71d595640 1 -- 172.21.15.82:0/979208689 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708036070 con 0x7fd71815e1c0 2024-06-02T22:53:47.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.335+0000 7fd71d595640 1 -- 172.21.15.82:0/979208689 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd708031600 con 0x7fd71815e1c0 2024-06-02T22:53:47.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.335+0000 7fd71d595640 1 -- 172.21.15.82:0/979208689 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7080319d0 con 0x7fd71815e1c0 2024-06-02T22:53:47.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.335+0000 7fd7207fb640 1 -- 172.21.15.82:0/979208689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71815e1c0 msgr2=0x7fd7180d4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.335+0000 7fd7207fb640 1 --2- 172.21.15.82:0/979208689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71815e1c0 0x7fd7180d4bc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd708009e50 tx=0x7fd70802a710 comp rx=0 tx=0).stop 2024-06-02T22:53:47.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.335+0000 7fd7207fb640 1 -- 172.21.15.82:0/979208689 shutdown_connections 2024-06-02T22:53:47.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.335+0000 7fd7207fb640 1 --2- 172.21.15.82:0/979208689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7180b2f60 0x7fd7180d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.335+0000 7fd7207fb640 1 --2- 172.21.15.82:0/979208689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71815e1c0 0x7fd7180d4bc0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.335+0000 7fd7207fb640 1 -- 172.21.15.82:0/979208689 >> 172.21.15.82:0/979208689 conn(0x7fd71809d3e0 msgr2=0x7fd7180d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:47.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.335+0000 7fd7207fb640 1 -- 172.21.15.82:0/979208689 shutdown_connections 2024-06-02T22:53:47.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.335+0000 7fd7207fb640 1 -- 172.21.15.82:0/979208689 wait complete. 2024-06-02T22:53:47.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.336+0000 7fd7207fb640 1 Processor -- start 2024-06-02T22:53:47.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.336+0000 7fd7207fb640 1 -- start start 2024-06-02T22:53:47.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.337+0000 7fd7207fb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7180b2f60 0x7fd7180d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.337+0000 7fd7207fb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd71815e1c0 0x7fd718160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.337+0000 7fd7207fb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71815e5a0 0x7fd718160e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.337+0000 7fd7207fb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7180d1d40 con 0x7fd71815e5a0 2024-06-02T22:53:47.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.337+0000 7fd7207fb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd7180d0510 con 0x7fd71815e1c0 2024-06-02T22:53:47.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.337+0000 7fd7207fb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd7180b0cd0 con 0x7fd7180b2f60 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.337+0000 7fd71ed98640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71815e5a0 0x7fd718160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.337+0000 7fd71ed98640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71815e5a0 0x7fd718160e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40846/0 (socket says 172.21.15.82:40846) 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.337+0000 7fd71ed98640 1 -- 172.21.15.82:0/2512544023 learned_addr learned my addr 172.21.15.82:0/2512544023 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd71e597640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7180b2f60 0x7fd7180d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd71dd96640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd71815e1c0 0x7fd718160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd71ed98640 1 -- 172.21.15.82:0/2512544023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7180b2f60 msgr2=0x7fd7180d24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd71ed98640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7180b2f60 0x7fd7180d24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd71ed98640 1 -- 172.21.15.82:0/2512544023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd71815e1c0 msgr2=0x7fd718160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd71ed98640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd71815e1c0 0x7fd718160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd71ed98640 1 -- 172.21.15.82:0/2512544023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7181525c0 con 0x7fd71815e5a0 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd71dd96640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd71815e1c0 0x7fd718160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd71ed98640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71815e5a0 0x7fd718160e50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd71000c3e0 tx=0x7fd71000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd716ffd640 1 -- 172.21.15.82:0/2512544023 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7100074e0 con 0x7fd71815e5a0 2024-06-02T22:53:47.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd716ffd640 1 -- 172.21.15.82:0/2512544023 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7100047e0 con 0x7fd71815e5a0 2024-06-02T22:53:47.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd716ffd640 1 -- 172.21.15.82:0/2512544023 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710004bd0 con 0x7fd71815e5a0 2024-06-02T22:53:47.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd7207fb640 1 -- 172.21.15.82:0/2512544023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd718161580 con 0x7fd71815e5a0 2024-06-02T22:53:47.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.338+0000 7fd7207fb640 1 -- 172.21.15.82:0/2512544023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7180b7090 con 0x7fd71815e5a0 2024-06-02T22:53:47.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.339+0000 7fd7207fb640 1 -- 172.21.15.82:0/2512544023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7180683c0 con 0x7fd71815e5a0 2024-06-02T22:53:47.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.339+0000 7fd716ffd640 1 -- 172.21.15.82:0/2512544023 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd710011070 con 0x7fd71815e5a0 2024-06-02T22:53:47.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.340+0000 7fd716ffd640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd70406be30 0x7fd70406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.340+0000 7fd716ffd640 1 -- 172.21.15.82:0/2512544023 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd71008aac0 con 0x7fd71815e5a0 2024-06-02T22:53:47.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.340+0000 7fd71e597640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd70406be30 0x7fd70406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:47.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.340+0000 7fd71e597640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd70406be30 0x7fd70406e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd708033000 tx=0x7fd708009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:47.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.344+0000 7fd716ffd640 1 -- 172.21.15.82:0/2512544023 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd710059370 con 0x7fd71815e5a0 2024-06-02T22:53:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.583+0000 7fd7207fb640 1 -- 172.21.15.82:0/2512544023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd71808c0c0 con 0x7fd71815e5a0 2024-06-02T22:53:47.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.586+0000 7fd716ffd640 1 -- 172.21.15.82:0/2512544023 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fd71005f020 con 0x7fd71815e5a0 2024-06-02T22:53:47.586 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-06-02T22:53:47.586 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g== 2024-06-02T22:53:47.586 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2024-06-02T22:53:47.586 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2024-06-02T22:53:47.586 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-02T22:53:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2024-06-02T22:53:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 -- 172.21.15.82:0/2512544023 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd70406be30 msgr2=0x7fd70406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd70406be30 0x7fd70406e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd708033000 tx=0x7fd708009000 comp rx=0 tx=0).stop 2024-06-02T22:53:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 -- 172.21.15.82:0/2512544023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71815e5a0 msgr2=0x7fd718160e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71815e5a0 0x7fd718160e50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd71000c3e0 tx=0x7fd71000c8a0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 -- 172.21.15.82:0/2512544023 shutdown_connections 2024-06-02T22:53:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd70406be30 0x7fd70406e2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71815e5a0 0x7fd718160e50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd71815e1c0 0x7fd718160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 --2- 172.21.15.82:0/2512544023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7180b2f60 0x7fd7180d24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 -- 172.21.15.82:0/2512544023 >> 172.21.15.82:0/2512544023 conn(0x7fd71809d3e0 msgr2=0x7fd7180d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 -- 172.21.15.82:0/2512544023 shutdown_connections 2024-06-02T22:53:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.588+0000 7fd7207fb640 1 -- 172.21.15.82:0/2512544023 wait complete. 2024-06-02T22:53:47.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:53:47.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.698+0000 7feebc0f5640 1 Processor -- start 2024-06-02T22:53:47.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.698+0000 7feebc0f5640 1 -- start start 2024-06-02T22:53:47.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feebc0f5640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7feeb40cc6d0 0x7feeb40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feebc0f5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feeb4071c60 0x7feeb4072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feebc0f5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb40ccff0 con 0x7feeb40b36c0 2024-06-02T22:53:47.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feebc0f5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7feeb4072820 con 0x7feeb4071c60 2024-06-02T22:53:47.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feebc0f5640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7feeb4072b00 con 0x7feeb40cc6d0 2024-06-02T22:53:47.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feeb9690640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feeb4071c60 0x7feeb4072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:47.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feeb9690640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feeb4071c60 0x7feeb4072110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40858/0 (socket says 172.21.15.82:40858) 2024-06-02T22:53:47.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feeb9690640 1 -- 172.21.15.82:0/1136747811 learned_addr learned my addr 172.21.15.82:0/1136747811 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:47.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feeb9690640 1 -- 172.21.15.82:0/1136747811 >> v2:172.21.15.184:3300/0 conn(0x7feeb40cc6d0 msgr2=0x7feeb40ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:47.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feeb9690640 1 --2- 172.21.15.82:0/1136747811 >> v2:172.21.15.184:3300/0 conn(0x7feeb40cc6d0 0x7feeb40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feeb9690640 1 -- 172.21.15.82:0/1136747811 >> v1:172.21.15.184:6789/0 conn(0x7feeb40b36c0 legacy=0x7feeb40b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.699+0000 7feeb9690640 1 -- 172.21.15.82:0/1136747811 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb4072de0 con 0x7feeb4071c60 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.700+0000 7feeb9690640 1 --2- 172.21.15.82:0/1136747811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb4071c60 0x7feeb4072110 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7feeb409e090 tx=0x7feeb002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4cdef05c4da4273 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.700+0000 7feeb8e8f640 1 -- 172.21.15.82:0/1136747811 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0037070 con 0x7feeb4071c60 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.700+0000 7feeb8e8f640 1 -- 172.21.15.82:0/1136747811 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb0032440 con 0x7feeb4071c60 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.700+0000 7feeb8e8f640 1 -- 172.21.15.82:0/1136747811 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0032810 con 0x7feeb4071c60 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.701+0000 7feebc0f5640 1 -- 172.21.15.82:0/1136747811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb4071c60 msgr2=0x7feeb4072110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.701+0000 7feebc0f5640 1 --2- 172.21.15.82:0/1136747811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb4071c60 0x7feeb4072110 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7feeb409e090 tx=0x7feeb002a230 comp rx=0 tx=0).stop 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.701+0000 7feebc0f5640 1 -- 172.21.15.82:0/1136747811 shutdown_connections 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.701+0000 7feebc0f5640 1 --2- 172.21.15.82:0/1136747811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb4071c60 0x7feeb4072110 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.701+0000 7feebc0f5640 1 --2- 172.21.15.82:0/1136747811 >> v2:172.21.15.184:3300/0 conn(0x7feeb40cc6d0 0x7feeb40ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.701+0000 7feebc0f5640 1 -- 172.21.15.82:0/1136747811 >> 172.21.15.82:0/1136747811 conn(0x7feeb40b19f0 msgr2=0x7feeb40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:47.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.701+0000 7feebc0f5640 1 -- 172.21.15.82:0/1136747811 shutdown_connections 2024-06-02T22:53:47.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.701+0000 7feebc0f5640 1 -- 172.21.15.82:0/1136747811 wait complete. 2024-06-02T22:53:47.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.702+0000 7feebc0f5640 1 Processor -- start 2024-06-02T22:53:47.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.702+0000 7feebc0f5640 1 -- start start 2024-06-02T22:53:47.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feebc0f5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb4071c60 0x7feeb4153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feebc0f5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb40b36c0 0x7feeb406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feebc0f5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb40cc6d0 0x7feeb41f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feebc0f5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4159f60 con 0x7feeb40b36c0 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feebc0f5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7feeb415c890 con 0x7feeb4071c60 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feebc0f5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7feeb40b4200 con 0x7feeb40cc6d0 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeb9690640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb40b36c0 0x7feeb406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeb9690640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb40b36c0 0x7feeb406d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40868/0 (socket says 172.21.15.82:40868) 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeb9690640 1 -- 172.21.15.82:0/3641952924 learned_addr learned my addr 172.21.15.82:0/3641952924 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeb9e91640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb4071c60 0x7feeb4153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeba692640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb40cc6d0 0x7feeb41f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeb9690640 1 -- 172.21.15.82:0/3641952924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb40cc6d0 msgr2=0x7feeb41f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeb9690640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb40cc6d0 0x7feeb41f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeb9690640 1 -- 172.21.15.82:0/3641952924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb4071c60 msgr2=0x7feeb4153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeb9690640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb4071c60 0x7feeb4153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeb9690640 1 -- 172.21.15.82:0/3641952924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb41f4fb0 con 0x7feeb40b36c0 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeb9e91640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb4071c60 0x7feeb4153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeb9690640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb40b36c0 0x7feeb406d7c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7feeb0000c00 tx=0x7feeb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeaa7fc640 1 -- 172.21.15.82:0/3641952924 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0041070 con 0x7feeb40b36c0 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeaa7fc640 1 -- 172.21.15.82:0/3641952924 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb003c870 con 0x7feeb40b36c0 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feeaa7fc640 1 -- 172.21.15.82:0/3641952924 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0037040 con 0x7feeb40b36c0 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.703+0000 7feebc0f5640 1 -- 172.21.15.82:0/3641952924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb41f5290 con 0x7feeb40b36c0 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.704+0000 7feebc0f5640 1 -- 172.21.15.82:0/3641952924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb406d2a0 con 0x7feeb40b36c0 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.704+0000 7feebc0f5640 1 -- 172.21.15.82:0/3641952924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb406cdb0 con 0x7feeb40b36c0 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.705+0000 7feeaa7fc640 1 -- 172.21.15.82:0/3641952924 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feeb0044070 con 0x7feeb40b36c0 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.705+0000 7feeaa7fc640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee9806be30 0x7fee9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.705+0000 7feeaa7fc640 1 -- 172.21.15.82:0/3641952924 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7feeb00abbc0 con 0x7feeb40b36c0 2024-06-02T22:53:47.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.705+0000 7feeb9e91640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee9806be30 0x7fee9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:47.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.706+0000 7feeb9e91640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee9806be30 0x7fee9806e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feeb409dc50 tx=0x7feea4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.710+0000 7feeaa7fc640 1 -- 172.21.15.82:0/3641952924 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7feeb007a470 con 0x7feeb40b36c0 2024-06-02T22:53:47.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.919+0000 7feebc0f5640 1 -- 172.21.15.82:0/3641952924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feeb4068430 con 0x7feeb40b36c0 2024-06-02T22:53:47.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.919+0000 7feeaa7fc640 1 -- 172.21.15.82:0/3641952924 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5187 (secure 0 0 0) 0x7feeb0079d70 con 0x7feeb40b36c0 2024-06-02T22:53:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:53:47.920 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2836777878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2836777878},{"type":"v1","addr":"172.21.15.184:6834","nonce":2836777878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1408890584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":1408890584},{"type":"v1","addr":"172.21.15.184:6835","nonce":1408890584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3064310162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3064310162},{"type":"v1","addr":"172.21.15.82:6835","nonce":3064310162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:53:38.862365+0000","modified":"2024-06-02T22:53:40.857453+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2390078487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2390078487},{"type":"v1","addr":"172.21.15.82:6837","nonce":2390078487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5403,"qdb_cluster":[5403]},"id":3}]} 2024-06-02T22:53:47.920 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2024-06-02T22:53:47.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.921+0000 7feebc0f5640 1 -- 172.21.15.82:0/3641952924 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee9806be30 msgr2=0x7fee9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.921+0000 7feebc0f5640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee9806be30 0x7fee9806e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feeb409dc50 tx=0x7feea4008040 comp rx=0 tx=0).stop 2024-06-02T22:53:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.921+0000 7feebc0f5640 1 -- 172.21.15.82:0/3641952924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb40b36c0 msgr2=0x7feeb406d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.921+0000 7feebc0f5640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb40b36c0 0x7feeb406d7c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7feeb0000c00 tx=0x7feeb00046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.921+0000 7feebc0f5640 1 -- 172.21.15.82:0/3641952924 shutdown_connections 2024-06-02T22:53:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.921+0000 7feebc0f5640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fee9806be30 0x7fee9806e2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.921+0000 7feebc0f5640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feeb40cc6d0 0x7feeb41f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.921+0000 7feebc0f5640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feeb40b36c0 0x7feeb406d7c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.921+0000 7feebc0f5640 1 --2- 172.21.15.82:0/3641952924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feeb4071c60 0x7feeb4153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.922+0000 7feebc0f5640 1 -- 172.21.15.82:0/3641952924 >> 172.21.15.82:0/3641952924 conn(0x7feeb40b19f0 msgr2=0x7feeb40afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.922+0000 7feebc0f5640 1 -- 172.21.15.82:0/3641952924 shutdown_connections 2024-06-02T22:53:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:47.922+0000 7feebc0f5640 1 -- 172.21.15.82:0/3641952924 wait complete. 2024-06-02T22:53:48.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T22:53:38.862365+0000', 'modified': '2024-06-02T22:53:40.857453+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5403}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5403': {'gid': 5403, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/2390078487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 2390078487}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 2390078487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5403, 'qdb_cluster': [5403]} 2024-06-02T22:53:48.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T22:53:48.334 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-02T22:53:48.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.435+0000 7f65d3729640 1 Processor -- start 2024-06-02T22:53:48.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.436+0000 7f65d3729640 1 -- start start 2024-06-02T22:53:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.436+0000 7f65d3729640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65cc0d2680 0x7f65cc15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.436+0000 7f65d3729640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65cc0d1fc0 0x7f65cc0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.436+0000 7f65d3729640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65cc0d2fa0 con 0x7f65cc161fa0 2024-06-02T22:53:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.436+0000 7f65d3729640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f65cc0cff80 con 0x7f65cc0d1fc0 2024-06-02T22:53:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.436+0000 7f65d3729640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f65cc0d13e0 con 0x7f65cc0d2680 2024-06-02T22:53:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.437+0000 7f65d0cc4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65cc0d1fc0 0x7f65cc0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.437+0000 7f65d0cc4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65cc0d1fc0 0x7f65cc0d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40870/0 (socket says 172.21.15.82:40870) 2024-06-02T22:53:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.437+0000 7f65d1cc6640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f65cc161fa0 0x7f65cc162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52964/0 (socket says 172.21.15.82:52964) 2024-06-02T22:53:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.437+0000 7f65d0cc4640 1 -- 172.21.15.82:0/1188607190 learned_addr learned my addr 172.21.15.82:0/1188607190 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.437+0000 7f65d14c5640 1 --2- 172.21.15.82:0/1188607190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65cc0d2680 0x7f65cc15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.437+0000 7f65d0cc4640 1 -- 172.21.15.82:0/1188607190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65cc0d2680 msgr2=0x7f65cc15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.437+0000 7f65d0cc4640 1 --2- 172.21.15.82:0/1188607190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65cc0d2680 0x7f65cc15f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.437+0000 7f65cbfff640 1 -- 172.21.15.82:0/1188607190 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729227231 0 0) 0x7f65cc0d2fa0 con 0x7f65cc161fa0 2024-06-02T22:53:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.437+0000 7f65d0cc4640 1 -- 172.21.15.82:0/1188607190 >> v1:172.21.15.82:6789/0 conn(0x7f65cc161fa0 legacy=0x7f65cc162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.437+0000 7f65d0cc4640 1 -- 172.21.15.82:0/1188607190 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc0d0ad0 con 0x7f65cc0d1fc0 2024-06-02T22:53:48.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65d0cc4640 1 --2- 172.21.15.82:0/1188607190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65cc0d1fc0 0x7f65cc0d2a60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009870 tx=0x7f65c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca07386617f5df34 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65cbfff640 1 -- 172.21.15.82:0/1188607190 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0037070 con 0x7f65cc0d1fc0 2024-06-02T22:53:48.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65cbfff640 1 -- 172.21.15.82:0/1188607190 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c0032440 con 0x7f65cc0d1fc0 2024-06-02T22:53:48.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65cbfff640 1 -- 172.21.15.82:0/1188607190 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0032810 con 0x7f65cc0d1fc0 2024-06-02T22:53:48.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65d3729640 1 -- 172.21.15.82:0/1188607190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65cc0d1fc0 msgr2=0x7f65cc0d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65d3729640 1 --2- 172.21.15.82:0/1188607190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65cc0d1fc0 0x7f65cc0d2a60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009870 tx=0x7f65c002a270 comp rx=0 tx=0).stop 2024-06-02T22:53:48.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65d3729640 1 -- 172.21.15.82:0/1188607190 shutdown_connections 2024-06-02T22:53:48.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65d3729640 1 --2- 172.21.15.82:0/1188607190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65cc0d1fc0 0x7f65cc0d2a60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65d3729640 1 --2- 172.21.15.82:0/1188607190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65cc0d2680 0x7f65cc15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65d3729640 1 -- 172.21.15.82:0/1188607190 >> 172.21.15.82:0/1188607190 conn(0x7f65cc09d3f0 msgr2=0x7f65cc0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:48.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65d3729640 1 -- 172.21.15.82:0/1188607190 shutdown_connections 2024-06-02T22:53:48.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.438+0000 7f65d3729640 1 -- 172.21.15.82:0/1188607190 wait complete. 2024-06-02T22:53:48.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.439+0000 7f65d3729640 1 Processor -- start 2024-06-02T22:53:48.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.440+0000 7f65d3729640 1 -- start start 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.440+0000 7f65d3729640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65cc0d1fc0 0x7f65cc0b9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.440+0000 7f65d3729640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65cc0d2680 0x7f65cc15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.440+0000 7f65d3729640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65cc161fa0 0x7f65cc0cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.440+0000 7f65d3729640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc0d1070 con 0x7f65cc0d2680 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.440+0000 7f65d3729640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc0d0d90 con 0x7f65cc0d1fc0 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.440+0000 7f65d3729640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f65cc0d2400 con 0x7f65cc161fa0 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.440+0000 7f65d0cc4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65cc0d2680 0x7f65cc15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.440+0000 7f65d0cc4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65cc0d2680 0x7f65cc15a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40880/0 (socket says 172.21.15.82:40880) 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.440+0000 7f65d0cc4640 1 -- 172.21.15.82:0/3069190595 learned_addr learned my addr 172.21.15.82:0/3069190595 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d14c5640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65cc0d1fc0 0x7f65cc0b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d1cc6640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65cc161fa0 0x7f65cc0cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d0cc4640 1 -- 172.21.15.82:0/3069190595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65cc161fa0 msgr2=0x7f65cc0cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d0cc4640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65cc161fa0 0x7f65cc0cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d0cc4640 1 -- 172.21.15.82:0/3069190595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65cc0d1fc0 msgr2=0x7f65cc0b9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d0cc4640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65cc0d1fc0 0x7f65cc0b9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d0cc4640 1 -- 172.21.15.82:0/3069190595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc0b87a0 con 0x7f65cc0d2680 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d14c5640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65cc0d1fc0 0x7f65cc0b9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d1cc6640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65cc161fa0 0x7f65cc0cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d0cc4640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65cc0d2680 0x7f65cc15a1e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f65c0000c00 tx=0x7f65c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65c9ffb640 1 -- 172.21.15.82:0/3069190595 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0037040 con 0x7f65cc0d2680 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65c9ffb640 1 -- 172.21.15.82:0/3069190595 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c0042070 con 0x7f65cc0d2680 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d3729640 1 -- 172.21.15.82:0/3069190595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65cc0b8a80 con 0x7f65cc0d2680 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65c9ffb640 1 -- 172.21.15.82:0/3069190595 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0030bd0 con 0x7f65cc0d2680 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.441+0000 7f65d3729640 1 -- 172.21.15.82:0/3069190595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65cc0b9040 con 0x7f65cc0d2680 2024-06-02T22:53:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.443+0000 7f65c9ffb640 1 -- 172.21.15.82:0/3069190595 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65c0047460 con 0x7f65cc0d2680 2024-06-02T22:53:48.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.443+0000 7f65c9ffb640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f65b806be30 0x7f65b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.443+0000 7f65c9ffb640 1 -- 172.21.15.82:0/3069190595 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f65c00abcd0 con 0x7f65cc0d2680 2024-06-02T22:53:48.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.443+0000 7f65d14c5640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f65b806be30 0x7f65b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.443+0000 7f65d14c5640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f65b806be30 0x7f65b806e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f65c4008890 tx=0x7f65c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.444+0000 7f65d643a740 1 Processor -- start 2024-06-02T22:53:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.444+0000 7f65d643a740 1 -- start start 2024-06-02T22:53:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d643a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a919d4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d643a740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d20e0 0x559a919d4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d643a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919a4960 0x559a919a8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d643a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559a9190d740 con 0x559a919d1d00 2024-06-02T22:53:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d643a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559a918aba80 con 0x559a919a4960 2024-06-02T22:53:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d643a740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x559a91909700 con 0x559a919d20e0 2024-06-02T22:53:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d14c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a919d4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d14c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a919d4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40890/0 (socket says 172.21.15.82:40890) 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d14c5640 1 -- 172.21.15.82:0/1216454135 learned_addr learned my addr 172.21.15.82:0/1216454135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d14c5640 1 -- 172.21.15.82:0/1216454135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d20e0 msgr2=0x559a919d4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d14c5640 1 --2- 172.21.15.82:0/1216454135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d20e0 0x559a919d4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d14c5640 1 -- 172.21.15.82:0/1216454135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919a4960 msgr2=0x559a919a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d14c5640 1 --2- 172.21.15.82:0/1216454135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919a4960 0x559a919a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d14c5640 1 -- 172.21.15.82:0/1216454135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a918d6fb0 con 0x559a919d1d00 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65d14c5640 1 --2- 172.21.15.82:0/1216454135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a919d4510 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f65c400dad0 tx=0x7f65c4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc925f38a9341ed server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65b2ffd640 1 -- 172.21.15.82:0/1216454135 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4019050 con 0x559a919d1d00 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65b2ffd640 1 -- 172.21.15.82:0/1216454135 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4023070 con 0x559a919d1d00 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.445+0000 7f65b2ffd640 1 -- 172.21.15.82:0/1216454135 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4012c50 con 0x559a919d1d00 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.446+0000 7f65d643a740 1 -- 172.21.15.82:0/1216454135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 msgr2=0x559a919d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.446+0000 7f65d643a740 1 --2- 172.21.15.82:0/1216454135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a919d4510 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f65c400dad0 tx=0x7f65c4010000 comp rx=0 tx=0).stop 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.446+0000 7f65d643a740 1 -- 172.21.15.82:0/1216454135 shutdown_connections 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.446+0000 7f65d643a740 1 --2- 172.21.15.82:0/1216454135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919a4960 0x559a919a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.446+0000 7f65d643a740 1 --2- 172.21.15.82:0/1216454135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d20e0 0x559a919d4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.446+0000 7f65d643a740 1 --2- 172.21.15.82:0/1216454135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a919d4510 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.446+0000 7f65d643a740 1 -- 172.21.15.82:0/1216454135 >> 172.21.15.82:0/1216454135 conn(0x559a919a6bd0 msgr2=0x559a919ef510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.446+0000 7f65d643a740 1 -- 172.21.15.82:0/1216454135 shutdown_connections 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.446+0000 7f65d643a740 1 -- 172.21.15.82:0/1216454135 wait complete. 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.447+0000 7f65d643a740 1 -- start start 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.447+0000 7f65d643a740 1 Processor -- start 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d643a740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d1d00 0x559a919f1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d643a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d20e0 0x559a91a02480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d643a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d6600 0x559a919a9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d643a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559a919a9d80 con 0x559a919d6600 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d643a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559a91896c30 con 0x559a919d20e0 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d643a740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x559a919aa060 con 0x559a919d1d00 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d643a740 10 client.0 _ll_register_callbacks cb 0x559a918c87f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d1cc6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d6600 0x559a919a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d1cc6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d6600 0x559a919a9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40900/0 (socket says 172.21.15.82:40900) 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d1cc6640 1 -- 172.21.15.82:0/1320461020 learned_addr learned my addr 172.21.15.82:0/1320461020 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d0cc4640 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d20e0 0x559a91a02480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d14c5640 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d1d00 0x559a919f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d1cc6640 1 -- 172.21.15.82:0/1320461020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d1d00 msgr2=0x559a919f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d1cc6640 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d1d00 0x559a919f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d1cc6640 1 -- 172.21.15.82:0/1320461020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d20e0 msgr2=0x559a91a02480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d1cc6640 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d20e0 0x559a91a02480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d1cc6640 1 -- 172.21.15.82:0/1320461020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a916212d0 con 0x559a919d6600 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d14c5640 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d1d00 0x559a919f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d1cc6640 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d6600 0x559a919a9180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00d480 tx=0x7f65bc00d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5799a3aaf12b30e2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65abfff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65abfff640 1 -- 172.21.15.82:0/1320461020 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0070d0 con 0x559a919d6600 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65abfff640 1 -- 172.21.15.82:0/1320461020 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f65bc013c10 con 0x559a919d6600 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d643a740 1 -- 172.21.15.82:0/1320461020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65c4023070 con 0x559a919d6600 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65abfff640 1 -- 172.21.15.82:0/1320461020 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f65bc013e10 con 0x559a919d6600 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d643a740 10 client.5571 fetch_fsmap learned FSMap version 23 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65d643a740 1 -- 172.21.15.82:0/1320461020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x559a916eb6b0 con 0x559a919d6600 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.448+0000 7f65abfff640 1 -- 172.21.15.82:0/1320461020 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4023070 con 0x559a919d6600 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.449+0000 7f65abfff640 1 -- 172.21.15.82:0/1320461020 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 23) ==== 3494+0+0 (secure 0 0 0) 0x7f65bc013420 con 0x559a919d6600 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.449+0000 7f65d643a740 10 client.5571 fetch_fsmap finished waiting for FSMap version 23 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.449+0000 7f65d643a740 10 client.5571 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-02T22:53:48.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.449+0000 7f65d643a740 20 client.5571 populate_metadata read hostname 'smithi082' 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.449+0000 7f65d643a740 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.82:6836/2390078487,v1:172.21.15.82:6837/2390078487] conn(0x559a919d5a30 0x559a919ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.449+0000 7f65d643a740 4 client.5571 mds_command: new command op to 5403 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.449+0000 7f65d643a740 1 -- 172.21.15.82:0/1320461020 --> [v2:172.21.15.82:6836/2390078487,v1:172.21.15.82:6837/2390078487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a9191ae70 con 0x559a919d5a30 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.449+0000 7f65d14c5640 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.82:6836/2390078487,v1:172.21.15.82:6837/2390078487] conn(0x559a919d5a30 0x559a919ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.449+0000 7f65abfff640 10 client.5571 ms_handle_connect on v2:172.21.15.82:6836/2390078487 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.449+0000 7f65d14c5640 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.82:6836/2390078487,v1:172.21.15.82:6837/2390078487] conn(0x559a919d5a30 0x559a919ffee0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0293fe547a24eda server_cookie=853fa13293e3c452 in_seq=0 out_seq=0 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65abfff640 1 -- 172.21.15.82:0/1320461020 <== mds.0 v2:172.21.15.82:6836/2390078487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559a9191ae70 con 0x559a919d5a30 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65abfff640 10 client.5571 handle_command_reply: tid=0 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 1 client.5571 shutdown 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 1 -- 172.21.15.82:0/1320461020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d6600 msgr2=0x559a919a9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d6600 0x559a919a9180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00d480 tx=0x7f65bc00d940 comp rx=0 tx=0).stop 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 1 -- 172.21.15.82:0/1320461020 shutdown_connections 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.82:6836/2390078487,v1:172.21.15.82:6837/2390078487] conn(0x559a919d5a30 0x559a919ffee0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d6600 0x559a919a9180 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d20e0 0x559a91a02480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65abfff640 0 client.5571 ms_handle_reset on v2:172.21.15.82:6836/2390078487 2024-06-02T22:53:48.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 1 --2- 172.21.15.82:0/1320461020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d1d00 0x559a919f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 1 -- 172.21.15.82:0/1320461020 >> 172.21.15.82:0/1320461020 conn(0x559a919a4960 msgr2=0x559a919d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:48.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 1 -- 172.21.15.82:0/1320461020 shutdown_connections 2024-06-02T22:53:48.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 1 -- 172.21.15.82:0/1320461020 wait complete. 2024-06-02T22:53:48.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.450+0000 7f65d643a740 20 client.5571 trim_cache size 0 max 16384 2024-06-02T22:53:48.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.469+0000 7f65d643a740 1 Processor -- start 2024-06-02T22:53:48.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.469+0000 7f65d643a740 1 -- start start 2024-06-02T22:53:48.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.469+0000 7f65d643a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a13420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.469+0000 7f65d643a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d20e0 0x559a919ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.469+0000 7f65d643a740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d6600 0x559a91a003f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d643a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc1fff50 con 0x559a919d1d00 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d643a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc0b7a50 con 0x559a919d20e0 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d643a740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f65cc1f50f0 con 0x559a919d6600 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d14c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a13420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d14c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a13420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40916/0 (socket says 172.21.15.82:40916) 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d14c5640 1 -- 172.21.15.82:0/2472663505 learned_addr learned my addr 172.21.15.82:0/2472663505 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d0cc4640 1 --2- 172.21.15.82:0/2472663505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d20e0 0x559a919ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d1cc6640 1 --2- 172.21.15.82:0/2472663505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d6600 0x559a91a003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d14c5640 1 -- 172.21.15.82:0/2472663505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d6600 msgr2=0x559a91a003f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d14c5640 1 --2- 172.21.15.82:0/2472663505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d6600 0x559a91a003f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d14c5640 1 -- 172.21.15.82:0/2472663505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d20e0 msgr2=0x559a919ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d14c5640 1 --2- 172.21.15.82:0/2472663505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d20e0 0x559a919ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d14c5640 1 -- 172.21.15.82:0/2472663505 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9199f610 con 0x559a919d1d00 2024-06-02T22:53:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65d14c5640 1 --2- 172.21.15.82:0/2472663505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a13420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f65c401f000 tx=0x7f65c4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bacbe34a57c3ef server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65b27fc640 1 -- 172.21.15.82:0/2472663505 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4019040 con 0x559a919d1d00 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65b27fc640 1 -- 172.21.15.82:0/2472663505 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4023040 con 0x559a919d1d00 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.470+0000 7f65b27fc640 1 -- 172.21.15.82:0/2472663505 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4012cd0 con 0x559a919d1d00 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.471+0000 7f65d643a740 1 -- 172.21.15.82:0/2472663505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 msgr2=0x559a91a13420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.471+0000 7f65d643a740 1 --2- 172.21.15.82:0/2472663505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a13420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f65c401f000 tx=0x7f65c4012000 comp rx=0 tx=0).stop 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.471+0000 7f65d643a740 1 -- 172.21.15.82:0/2472663505 shutdown_connections 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.471+0000 7f65d643a740 1 --2- 172.21.15.82:0/2472663505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d6600 0x559a91a003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.471+0000 7f65d643a740 1 --2- 172.21.15.82:0/2472663505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d20e0 0x559a919ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.471+0000 7f65d643a740 1 --2- 172.21.15.82:0/2472663505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a13420 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.471+0000 7f65d643a740 1 -- 172.21.15.82:0/2472663505 >> 172.21.15.82:0/2472663505 conn(0x559a919a4960 msgr2=0x559a919f1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.471+0000 7f65d643a740 1 -- 172.21.15.82:0/2472663505 shutdown_connections 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.471+0000 7f65d643a740 1 -- 172.21.15.82:0/2472663505 wait complete. 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.471+0000 7f65d643a740 1 -- start start 2024-06-02T22:53:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.471+0000 7f65d643a740 1 Processor -- start 2024-06-02T22:53:48.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.472+0000 7f65d643a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a57ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.472+0000 7f65d643a740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d20e0 0x559a919c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.472+0000 7f65d643a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d6600 0x559a919eb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.472+0000 7f65d643a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559a919d58b0 con 0x559a919d1d00 2024-06-02T22:53:48.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.472+0000 7f65d643a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559a919d75b0 con 0x559a919d6600 2024-06-02T22:53:48.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.472+0000 7f65d643a740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x559a919d5f00 con 0x559a919d20e0 2024-06-02T22:53:48.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.472+0000 7f65d643a740 10 client.0 _ll_register_callbacks cb 0x7f65bc001fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.472+0000 7f65d14c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a57ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.472+0000 7f65d14c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a57ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40918/0 (socket says 172.21.15.82:40918) 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.472+0000 7f65d14c5640 1 -- 172.21.15.82:0/233236462 learned_addr learned my addr 172.21.15.82:0/233236462 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d14c5640 1 -- 172.21.15.82:0/233236462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d20e0 msgr2=0x559a919c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d14c5640 1 --2- 172.21.15.82:0/233236462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d20e0 0x559a919c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d14c5640 1 -- 172.21.15.82:0/233236462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d6600 msgr2=0x559a919eb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d14c5640 1 --2- 172.21.15.82:0/233236462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d6600 0x559a919eb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d14c5640 1 -- 172.21.15.82:0/233236462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a919ecbe0 con 0x559a919d1d00 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d14c5640 1 --2- 172.21.15.82:0/233236462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a57ac0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f65c400d590 tx=0x7f65c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b7eeee1c72457b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65abfff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65abfff640 1 -- 172.21.15.82:0/233236462 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4019040 con 0x559a919d1d00 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65abfff640 1 -- 172.21.15.82:0/233236462 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f65c402e040 con 0x559a919d1d00 2024-06-02T22:53:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d643a740 1 -- 172.21.15.82:0/233236462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65c4023040 con 0x559a919d1d00 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65abfff640 1 -- 172.21.15.82:0/233236462 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f65c4046050 con 0x559a919d1d00 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d643a740 10 client.5577 fetch_fsmap learned FSMap version 23 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d643a740 1 -- 172.21.15.82:0/233236462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) -- 0x559a919c8900 con 0x559a919d1d00 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65abfff640 1 -- 172.21.15.82:0/233236462 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4023040 con 0x559a919d1d00 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65abfff640 1 -- 172.21.15.82:0/233236462 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 23) ==== 3494+0+0 (secure 0 0 0) 0x7f65c4049020 con 0x559a919d1d00 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d643a740 10 client.5577 fetch_fsmap finished waiting for FSMap version 23 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d643a740 10 client.5577 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d643a740 20 client.5577 populate_metadata read hostname 'smithi082' 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d643a740 1 --2- 172.21.15.82:0/233236462 >> [v2:172.21.15.82:6836/2390078487,v1:172.21.15.82:6837/2390078487] conn(0x559a91a120e0 0x559a91a124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d643a740 4 client.5577 mds_command: new command op to 5403 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d643a740 1 -- 172.21.15.82:0/233236462 --> [v2:172.21.15.82:6836/2390078487,v1:172.21.15.82:6837/2390078487] -- command(tid 0: {"prefix": "status"}) -- 0x559a919151c0 con 0x559a91a120e0 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.473+0000 7f65d0cc4640 1 --2- 172.21.15.82:0/233236462 >> [v2:172.21.15.82:6836/2390078487,v1:172.21.15.82:6837/2390078487] conn(0x559a91a120e0 0x559a91a124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65abfff640 10 client.5577 ms_handle_connect on v2:172.21.15.82:6836/2390078487 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d0cc4640 1 --2- 172.21.15.82:0/233236462 >> [v2:172.21.15.82:6836/2390078487,v1:172.21.15.82:6837/2390078487] conn(0x559a91a120e0 0x559a91a124c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae6d9791003fc306 server_cookie=5588dc9442711ec3 in_seq=0 out_seq=0 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65abfff640 1 -- 172.21.15.82:0/233236462 <== mds.0 v2:172.21.15.82:6836/2390078487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x559a919151c0 con 0x559a91a120e0 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65abfff640 10 client.5577 handle_command_reply: tid=0 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 1 client.5577 shutdown 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 1 -- 172.21.15.82:0/233236462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 msgr2=0x559a91a57ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 1 --2- 172.21.15.82:0/233236462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a57ac0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f65c400d590 tx=0x7f65c4004730 comp rx=0 tx=0).stop 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 1 -- 172.21.15.82:0/233236462 shutdown_connections 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 1 --2- 172.21.15.82:0/233236462 >> [v2:172.21.15.82:6836/2390078487,v1:172.21.15.82:6837/2390078487] conn(0x559a91a120e0 0x559a91a124c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 1 --2- 172.21.15.82:0/233236462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559a919d6600 0x559a919eb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65abfff640 0 client.5577 ms_handle_reset on v2:172.21.15.82:6836/2390078487 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 1 --2- 172.21.15.82:0/233236462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559a919d20e0 0x559a919c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 1 --2- 172.21.15.82:0/233236462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559a919d1d00 0x559a91a57ac0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 1 -- 172.21.15.82:0/233236462 >> 172.21.15.82:0/233236462 conn(0x559a919a4960 msgr2=0x559a919f0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:48.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 1 -- 172.21.15.82:0/233236462 shutdown_connections 2024-06-02T22:53:48.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 1 -- 172.21.15.82:0/233236462 wait complete. 2024-06-02T22:53:48.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.474+0000 7f65d643a740 20 client.5577 trim_cache size 0 max 16384 2024-06-02T22:53:48.481 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:53:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "6f85057c-cf41-4021-ae61-b6064b1147d0", 2024-06-02T22:53:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-06-02T22:53:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5403, 2024-06-02T22:53:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-06-02T22:53:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-06-02T22:53:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-06-02T22:53:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 8.9610141710000004, 2024-06-02T22:53:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 23, 2024-06-02T22:53:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 54, 2024-06-02T22:53:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 54, 2024-06-02T22:53:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 13.303240227 2024-06-02T22:53:48.482 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:53:48.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 -- 172.21.15.82:0/3069190595 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f65b806be30 msgr2=0x7f65b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f65b806be30 0x7f65b806e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f65c4008890 tx=0x7f65c4008040 comp rx=0 tx=0).stop 2024-06-02T22:53:48.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 -- 172.21.15.82:0/3069190595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65cc0d2680 msgr2=0x7f65cc15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65cc0d2680 0x7f65cc15a1e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f65c0000c00 tx=0x7f65c00046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 -- 172.21.15.82:0/3069190595 shutdown_connections 2024-06-02T22:53:48.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f65b806be30 0x7f65b806e2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65cc161fa0 0x7f65cc0cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65cc0d2680 0x7f65cc15a1e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 --2- 172.21.15.82:0/3069190595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65cc0d1fc0 0x7f65cc0b9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 -- 172.21.15.82:0/3069190595 >> 172.21.15.82:0/3069190595 conn(0x7f65cc09d3f0 msgr2=0x7f65cc1605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:48.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 -- 172.21.15.82:0/3069190595 shutdown_connections 2024-06-02T22:53:48.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.475+0000 7f65d3729640 1 -- 172.21.15.82:0/3069190595 wait complete. 2024-06-02T22:53:48.485 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T22:53:48.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.586+0000 7f22a3064640 1 Processor -- start 2024-06-02T22:53:48.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.586+0000 7f22a3064640 1 -- start start 2024-06-02T22:53:48.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.587+0000 7f22a3064640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f229c0add50 0x7f229c165c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.587+0000 7f22a3064640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f229c06d130 con 0x7f229c06ebf0 2024-06-02T22:53:48.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.587+0000 7f22a3064640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f229c06d410 con 0x7f229c0ae910 2024-06-02T22:53:48.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.587+0000 7f22a3064640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f229c06d6f0 con 0x7f229c0add50 2024-06-02T22:53:48.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.587+0000 7f229bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f229c06ebf0 0x7f229c0cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52970/0 (socket says 172.21.15.82:52970) 2024-06-02T22:53:48.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.587+0000 7f229bfff640 1 -- 172.21.15.82:0/3497278295 learned_addr learned my addr 172.21.15.82:0/3497278295 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:48.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.587+0000 7f22a1601640 1 --2- 172.21.15.82:0/3497278295 >> v2:172.21.15.82:3300/0 conn(0x7f229c0add50 0x7f229c165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.587+0000 7f22a1601640 1 -- 172.21.15.82:0/3497278295 >> v1:172.21.15.184:6789/0 conn(0x7f229c0ae910 legacy=0x7f229c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.587+0000 7f22a1601640 1 -- 172.21.15.82:0/3497278295 >> v1:172.21.15.82:6789/0 conn(0x7f229c06ebf0 legacy=0x7f229c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.587+0000 7f22a1601640 1 -- 172.21.15.82:0/3497278295 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229c06d9d0 con 0x7f229c0add50 2024-06-02T22:53:48.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.588+0000 7f22a1601640 1 --2- 172.21.15.82:0/3497278295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0add50 0x7f229c165c30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f228c0097a0 tx=0x7f228c02c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb3dbc5e9774e29 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.589+0000 7f229b7fe640 1 -- 172.21.15.82:0/3497278295 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c039070 con 0x7f229c0add50 2024-06-02T22:53:48.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.589+0000 7f229b7fe640 1 -- 172.21.15.82:0/3497278295 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228c034640 con 0x7f229c0add50 2024-06-02T22:53:48.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.589+0000 7f229b7fe640 1 -- 172.21.15.82:0/3497278295 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c034a10 con 0x7f229c0add50 2024-06-02T22:53:48.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.589+0000 7f22a3064640 1 -- 172.21.15.82:0/3497278295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0add50 msgr2=0x7f229c165c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.589+0000 7f22a3064640 1 --2- 172.21.15.82:0/3497278295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0add50 0x7f229c165c30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f228c0097a0 tx=0x7f228c02c3b0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.589+0000 7f22a3064640 1 -- 172.21.15.82:0/3497278295 shutdown_connections 2024-06-02T22:53:48.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.589+0000 7f22a3064640 1 --2- 172.21.15.82:0/3497278295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0add50 0x7f229c165c30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.589+0000 7f22a3064640 1 -- 172.21.15.82:0/3497278295 >> 172.21.15.82:0/3497278295 conn(0x7f229c0b19f0 msgr2=0x7f229c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:48.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.590+0000 7f22a3064640 1 -- 172.21.15.82:0/3497278295 shutdown_connections 2024-06-02T22:53:48.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.590+0000 7f22a3064640 1 -- 172.21.15.82:0/3497278295 wait complete. 2024-06-02T22:53:48.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.591+0000 7f22a3064640 1 Processor -- start 2024-06-02T22:53:48.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.591+0000 7f22a3064640 1 -- start start 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22a3064640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f229c06ebf0 0x7f229c0cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22a3064640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0add50 0x7f229c15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22a3064640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f229c0ae910 0x7f229c14ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22a3064640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f229c0cf4e0 con 0x7f229c0add50 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22a3064640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f229c0cf360 con 0x7f229c0ae910 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22a3064640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f229c0cf660 con 0x7f229c06ebf0 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f229bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0add50 0x7f229c15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f229bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0add50 0x7f229c15b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40928/0 (socket says 172.21.15.82:40928) 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f229bfff640 1 -- 172.21.15.82:0/1834657319 learned_addr learned my addr 172.21.15.82:0/1834657319 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22a1601640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f229c0ae910 0x7f229c14ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22a0e00640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f229c06ebf0 0x7f229c0cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f229bfff640 1 -- 172.21.15.82:0/1834657319 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f229c06ebf0 msgr2=0x7f229c0cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f229bfff640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f229c06ebf0 0x7f229c0cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f229bfff640 1 -- 172.21.15.82:0/1834657319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f229c0ae910 msgr2=0x7f229c14ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f229bfff640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f229c0ae910 0x7f229c14ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f229bfff640 1 -- 172.21.15.82:0/1834657319 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229c14d380 con 0x7f229c0add50 2024-06-02T22:53:48.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f229bfff640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0add50 0x7f229c15b4c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f229000c480 tx=0x7f229000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22997fa640 1 -- 172.21.15.82:0/1834657319 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290017070 con 0x7f229c0add50 2024-06-02T22:53:48.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22997fa640 1 -- 172.21.15.82:0/1834657319 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2290005ce0 con 0x7f229c0add50 2024-06-02T22:53:48.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22997fa640 1 -- 172.21.15.82:0/1834657319 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22900072f0 con 0x7f229c0add50 2024-06-02T22:53:48.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.592+0000 7f22a3064640 1 -- 172.21.15.82:0/1834657319 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229c15bc60 con 0x7f229c0add50 2024-06-02T22:53:48.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.593+0000 7f22a3064640 1 -- 172.21.15.82:0/1834657319 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f229c15c220 con 0x7f229c0add50 2024-06-02T22:53:48.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.594+0000 7f22a3064640 1 -- 172.21.15.82:0/1834657319 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f229c068430 con 0x7f229c0add50 2024-06-02T22:53:48.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.594+0000 7f22997fa640 1 -- 172.21.15.82:0/1834657319 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f229001a070 con 0x7f229c0add50 2024-06-02T22:53:48.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.594+0000 7f22997fa640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f228806be60 0x7f228806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.594+0000 7f22997fa640 1 -- 172.21.15.82:0/1834657319 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f229008a1d0 con 0x7f229c0add50 2024-06-02T22:53:48.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.595+0000 7f22a0e00640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f228806be60 0x7f228806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.595+0000 7f22a0e00640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f228806be60 0x7f228806e320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2294001f10 tx=0x7f2294009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.599+0000 7f22997fa640 1 -- 172.21.15.82:0/1834657319 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2290058430 con 0x7f229c0add50 2024-06-02T22:53:48.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.811+0000 7f22a3064640 1 -- 172.21.15.82:0/1834657319 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f229c15ab10 con 0x7f229c0add50 2024-06-02T22:53:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.811+0000 7f22997fa640 1 -- 172.21.15.82:0/1834657319 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7f229005c730 con 0x7f229c0add50 2024-06-02T22:53:48.811 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T22:53:48.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 -- 172.21.15.82:0/1834657319 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f228806be60 msgr2=0x7f228806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f228806be60 0x7f228806e320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2294001f10 tx=0x7f2294009040 comp rx=0 tx=0).stop 2024-06-02T22:53:48.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 -- 172.21.15.82:0/1834657319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0add50 msgr2=0x7f229c15b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0add50 0x7f229c15b4c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f229000c480 tx=0x7f229000c940 comp rx=0 tx=0).stop 2024-06-02T22:53:48.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 -- 172.21.15.82:0/1834657319 shutdown_connections 2024-06-02T22:53:48.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f228806be60 0x7f228806e320 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f229c0ae910 0x7f229c14ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0add50 0x7f229c15b4c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 --2- 172.21.15.82:0/1834657319 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f229c06ebf0 0x7f229c0cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 -- 172.21.15.82:0/1834657319 >> 172.21.15.82:0/1834657319 conn(0x7f229c0b19f0 msgr2=0x7f229c071800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:48.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 -- 172.21.15.82:0/1834657319 shutdown_connections 2024-06-02T22:53:48.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:48.813+0000 7f22a3064640 1 -- 172.21.15.82:0/1834657319 wait complete. 2024-06-02T22:53:48.824 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T22:53:48.824 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:53:48.824 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-06-02T22:53:48.824 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T22:53:48.824 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:48.824 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T22:53:48.824 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:53:48.824 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:53:48.824 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:48.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:48.825 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-06-02T22:53:48.840 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42669sec preferred_lft 42669sec 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::6847:90ff:fe09:5afd/64 scope link 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:48.842 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:53:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 7e:10:3a:74:07:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::7c10:3aff:fe74:7cf/64 scope link 2024-06-02T22:53:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:48.843 INFO:teuthology.orchestra.run.smithi082.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:53:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::103e:51ff:fe43:acf3/64 scope link 2024-06-02T22:53:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:48.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:48.843 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:53:48.904 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-06-02T22:53:48.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:48.906 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-06-02T22:53:48.961 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-06-02T22:53:48.961 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:53:48.961 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T22:53:48.961 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T22:53:48.961 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:53:48.962 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:53:48.962 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:53:48.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T22:53:48.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T22:53:48.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T22:53:48.962 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:53:49.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:53:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:53:49.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:49.087 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-02T22:53:49.102 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T22:53:49.102 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T22:53:49.103 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:49.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:49.103 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-06-02T22:53:49.167 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-02T22:53:49.167 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:53:49.167 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:49.223 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:49.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:53:49.223 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:49.278 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:53:49.343 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:53:49.399 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:53:49.399 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:53:49.400 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:53:49.401 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:53:49.402 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:49.402 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:49.402 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:49.402 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:49.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:49.402 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:53:49.458 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T22:53:49.458 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-02T22:53:49.500 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:53:49.525 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:53:49.581 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2024-06-02T22:53:49.582+0000 7f5591372480 -1 init, newargv = 0x55f0f03a3310 newargc=15 2024-06-02T22:53:49.582 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:53:49.582 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:53:49.582 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:53:49.582 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:53:49.582 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:53:49.582 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:53:49.582 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:53:49.582 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:53:49.583 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:49.584 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:49.585 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[54935]: starting ceph client 2024-06-02T22:53:49.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:49.586 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:53:49.586 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[54935]: starting fuse 2024-06-02T22:53:49.601 INFO:teuthology.orchestra.run.smithi082.stdout:40 2024-06-02T22:53:49.602 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T22:53:49.602 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:53:49.602 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-06-02T22:53:49.602 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-06-02T22:53:49.602 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-06-02T22:53:49.602 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-06-02T22:53:49.602 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:49.602 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-06-02T22:53:49.602 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T22:53:49.602 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-06-02T22:53:49.603 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-06-02T22:53:49.604 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-06-02T22:53:49.604 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:53:49.604 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:49.604 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2024-06-02T22:53:49.604 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-06-02T22:53:49.720 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.54935.asok 2024-06-02T22:53:49.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:53:49.730 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54935.asok 2024-06-02T22:53:49.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:49.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54935.asok status 2024-06-02T22:53:49.865 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:53:49.865 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-06-02T22:53:49.865 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:53:49.865 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:53:49.866 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2024-06-02T22:53:49.866 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-06-02T22:53:49.866 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-02T22:53:49.866 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "54935", 2024-06-02T22:53:49.866 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-06-02T22:53:49.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:49.866 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-06-02T22:53:49.866 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-06-02T22:53:49.866 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5592, 2024-06-02T22:53:49.866 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-06-02T22:53:49.866 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 5592 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1511726324 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:53:49.867 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1511726324 2024-06-02T22:53:49.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:49.868 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.5592 192.168.0.1:0/1511726324", 2024-06-02T22:53:49.868 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/1511726324", 2024-06-02T22:53:49.868 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-06-02T22:53:49.868 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 23, 2024-06-02T22:53:49.868 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 54, 2024-06-02T22:53:49.868 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:53:49.868 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-06-02T22:53:49.868 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-06-02T22:53:49.868 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:53:49.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:49.874 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-06-02T22:53:49.874 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:49.891 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-06-02T22:53:49.891 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:49.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:49.891 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:49.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:49.958 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2024-06-02T22:53:50.019 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2024-06-02T22:53:50.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.164+0000 7f6a46010640 1 Processor -- start 2024-06-02T22:53:50.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.164+0000 7f6a46010640 1 -- start start 2024-06-02T22:53:50.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.165+0000 7f6a46010640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a400d06e0 0x7f6a40165cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.165+0000 7f6a46010640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a40158dc0 con 0x7f6a4015ea40 2024-06-02T22:53:50.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.165+0000 7f6a46010640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a400721b0 con 0x7f6a401589e0 2024-06-02T22:53:50.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.165+0000 7f6a46010640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6a40072490 con 0x7f6a400d06e0 2024-06-02T22:53:50.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.165+0000 7f6a3effd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6a4015ea40 0x7f6a400cffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52972/0 (socket says 172.21.15.82:52972) 2024-06-02T22:53:50.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.165+0000 7f6a3effd640 1 -- 172.21.15.82:0/1268527573 learned_addr learned my addr 172.21.15.82:0/1268527573 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:50.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.165+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3875576663 0 0) 0x7f6a40158dc0 con 0x7f6a4015ea40 2024-06-02T22:53:50.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.165+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a28003520 con 0x7f6a4015ea40 2024-06-02T22:53:50.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.165+0000 7f6a3ffff640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a400d06e0 0x7f6a40165cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3750165090 0 0) 0x7f6a28003520 con 0x7f6a4015ea40 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a400d06e0 msgr2=0x7f6a40165cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a400d06e0 0x7f6a40165cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 >> v1:172.21.15.184:6789/0 conn(0x7f6a401589e0 legacy=0x7f6a4015f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a40072770 con 0x7f6a4015ea40 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f6a34001670 con 0x7f6a4015ea40 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 >> v1:172.21.15.82:6789/0 conn(0x7f6a4015ea40 legacy=0x7f6a400cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a400d06e0 0x7f6a280039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a28003f60 0x7f6a28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a28004d40 0x7f6a280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40072490 con 0x7f6a28003f60 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2800baa0 con 0x7f6a28004d40 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2800deb0 con 0x7f6a400d06e0 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3effd640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a28003f60 0x7f6a28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3ffff640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a28004d40 0x7f6a280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3f7fe640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a400d06e0 0x7f6a280039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3effd640 1 -- 172.21.15.82:0/1268527573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a400d06e0 msgr2=0x7f6a280039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3effd640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a400d06e0 0x7f6a280039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3effd640 1 -- 172.21.15.82:0/1268527573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a28004d40 msgr2=0x7f6a280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3effd640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a28004d40 0x7f6a280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.166+0000 7f6a3effd640 1 -- 172.21.15.82:0/1268527573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a28003520 con 0x7f6a28003f60 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.167+0000 7f6a3effd640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a28003f60 0x7f6a28004800 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c240 tx=0x7f6a28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd24fb171939229 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.167+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34007d10 con 0x7f6a28003f60 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.167+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a34005ad0 con 0x7f6a28003f60 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.167+0000 7f6a3e7fc640 1 -- 172.21.15.82:0/1268527573 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34007070 con 0x7f6a28003f60 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.168+0000 7f6a46010640 1 -- 172.21.15.82:0/1268527573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a28003f60 msgr2=0x7f6a28004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.168+0000 7f6a46010640 1 --2- 172.21.15.82:0/1268527573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a28003f60 0x7f6a28004800 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c240 tx=0x7f6a28005830 comp rx=0 tx=0).stop 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.168+0000 7f6a3ffff640 1 -- 172.21.15.82:0/1268527573 reap_dead start 2024-06-02T22:53:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.168+0000 7f6a46010640 1 -- 172.21.15.82:0/1268527573 shutdown_connections 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.168+0000 7f6a46010640 1 -- 172.21.15.82:0/1268527573 >> 172.21.15.82:0/1268527573 conn(0x7f6a4006b7e0 msgr2=0x7f6a4006bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.168+0000 7f6a46010640 1 -- 172.21.15.82:0/1268527573 shutdown_connections 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.168+0000 7f6a46010640 1 -- 172.21.15.82:0/1268527573 wait complete. 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.169+0000 7f6a46010640 1 Processor -- start 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.169+0000 7f6a46010640 1 -- start start 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a46010640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a28003f60 0x7f6a40143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a46010640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a40155bd0 0x7f6a4009ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a46010640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a40156050 0x7f6a4009bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a46010640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40073250 con 0x7f6a40156050 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a46010640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40072d30 con 0x7f6a40155bd0 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a46010640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6a400ae6a0 con 0x7f6a28003f60 2024-06-02T22:53:50.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a3ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a40156050 0x7f6a4009bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a3ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a40156050 0x7f6a4009bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40948/0 (socket says 172.21.15.82:40948) 2024-06-02T22:53:50.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a3ffff640 1 -- 172.21.15.82:0/2048474591 learned_addr learned my addr 172.21.15.82:0/2048474591 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:50.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a3f7fe640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a28003f60 0x7f6a40143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a3effd640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a40155bd0 0x7f6a4009ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a3ffff640 1 -- 172.21.15.82:0/2048474591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a28003f60 msgr2=0x7f6a40143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a3ffff640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a28003f60 0x7f6a40143600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a3ffff640 1 -- 172.21.15.82:0/2048474591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a40155bd0 msgr2=0x7f6a4009ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a3ffff640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a40155bd0 0x7f6a4009ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a3ffff640 1 -- 172.21.15.82:0/2048474591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a40143b40 con 0x7f6a40156050 2024-06-02T22:53:50.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a3ffff640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a40156050 0x7f6a4009bfd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6a400af8a0 tx=0x7f6a38011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:50.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a27fff640 1 -- 172.21.15.82:0/2048474591 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38019020 con 0x7f6a40156050 2024-06-02T22:53:50.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a27fff640 1 -- 172.21.15.82:0/2048474591 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a38004240 con 0x7f6a40156050 2024-06-02T22:53:50.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a46010640 1 -- 172.21.15.82:0/2048474591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a40154850 con 0x7f6a40156050 2024-06-02T22:53:50.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.170+0000 7f6a27fff640 1 -- 172.21.15.82:0/2048474591 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800f710 con 0x7f6a40156050 2024-06-02T22:53:50.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.171+0000 7f6a46010640 1 -- 172.21.15.82:0/2048474591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a40154e10 con 0x7f6a40156050 2024-06-02T22:53:50.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.171+0000 7f6a46010640 1 -- 172.21.15.82:0/2048474591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a400b3b40 con 0x7f6a40156050 2024-06-02T22:53:50.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.172+0000 7f6a27fff640 1 -- 172.21.15.82:0/2048474591 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a3801c020 con 0x7f6a40156050 2024-06-02T22:53:50.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.172+0000 7f6a27fff640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a2c06be60 0x7f6a2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.172+0000 7f6a27fff640 1 -- 172.21.15.82:0/2048474591 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f6a3808b160 con 0x7f6a40156050 2024-06-02T22:53:50.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.172+0000 7f6a3f7fe640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a2c06be60 0x7f6a2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.173+0000 7f6a3f7fe640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a2c06be60 0x7f6a2c06e320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6a30001ee0 tx=0x7f6a30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:50.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.177+0000 7f6a27fff640 1 -- 172.21.15.82:0/2048474591 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6a400b3b40 con 0x7f6a40156050 2024-06-02T22:53:50.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.415+0000 7f6a46010640 1 -- 172.21.15.82:0/2048474591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) -- 0x7f6a400683c0 con 0x7f6a40156050 2024-06-02T22:53:50.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.417+0000 7f6a27fff640 1 -- 172.21.15.82:0/2048474591 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v14) ==== 183+0+140 (secure 0 0 0) 0x7f6a38023020 con 0x7f6a40156050 2024-06-02T22:53:50.417 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-06-02T22:53:50.417 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g== 2024-06-02T22:53:50.417 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2024-06-02T22:53:50.417 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2024-06-02T22:53:50.417 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow r pool=cephfs_data" 2024-06-02T22:53:50.417 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2024-06-02T22:53:50.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 -- 172.21.15.82:0/2048474591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a2c06be60 msgr2=0x7f6a2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a2c06be60 0x7f6a2c06e320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6a30001ee0 tx=0x7f6a30009040 comp rx=0 tx=0).stop 2024-06-02T22:53:50.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 -- 172.21.15.82:0/2048474591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a40156050 msgr2=0x7f6a4009bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a40156050 0x7f6a4009bfd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6a400af8a0 tx=0x7f6a38011cf0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 -- 172.21.15.82:0/2048474591 shutdown_connections 2024-06-02T22:53:50.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a2c06be60 0x7f6a2c06e320 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a40156050 0x7f6a4009bfd0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a40155bd0 0x7f6a4009ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 --2- 172.21.15.82:0/2048474591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a28003f60 0x7f6a40143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 -- 172.21.15.82:0/2048474591 >> 172.21.15.82:0/2048474591 conn(0x7f6a4006b7e0 msgr2=0x7f6a40158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:50.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 -- 172.21.15.82:0/2048474591 shutdown_connections 2024-06-02T22:53:50.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.419+0000 7f6a46010640 1 -- 172.21.15.82:0/2048474591 wait complete. 2024-06-02T22:53:50.430 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:50.430 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:50.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:53:50.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.586+0000 7fe6ecf5a640 1 Processor -- start 2024-06-02T22:53:50.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.586+0000 7fe6ecf5a640 1 -- start start 2024-06-02T22:53:50.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6ecf5a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6e80ae910 0x7fe6e806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6ecf5a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6e806ea20 0x7fe6e80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6ecf5a640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e80cf620 con 0x7fe6e80cf190 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6ecf5a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe6e806ee60 con 0x7fe6e80ae910 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6ecf5a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e806d130 con 0x7fe6e806ea20 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6e659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6e80ae910 0x7fe6e806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6e659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe6e80ae910 0x7fe6e806e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40952/0 (socket says 172.21.15.82:40952) 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6e659c640 1 -- 172.21.15.82:0/3197970468 learned_addr learned my addr 172.21.15.82:0/3197970468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6e5d9b640 1 --2- 172.21.15.82:0/3197970468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6e806ea20 0x7fe6e80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6e659c640 1 -- 172.21.15.82:0/3197970468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6e806ea20 msgr2=0x7fe6e80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6e659c640 1 --2- 172.21.15.82:0/3197970468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6e806ea20 0x7fe6e80cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6e659c640 1 -- 172.21.15.82:0/3197970468 >> v1:172.21.15.184:6789/0 conn(0x7fe6e80cf190 legacy=0x7fe6e815ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:50.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.587+0000 7fe6e659c640 1 -- 172.21.15.82:0/3197970468 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e806d410 con 0x7fe6e80ae910 2024-06-02T22:53:50.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.588+0000 7fe6e659c640 1 --2- 172.21.15.82:0/3197970468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e80ae910 0x7fe6e806e4e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80098a0 tx=0x7fe6d802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d086f54156a867d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:50.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.588+0000 7fe6e559a640 1 -- 172.21.15.82:0/3197970468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8037070 con 0x7fe6e80ae910 2024-06-02T22:53:50.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.588+0000 7fe6e559a640 1 -- 172.21.15.82:0/3197970468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d8032440 con 0x7fe6e80ae910 2024-06-02T22:53:50.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.588+0000 7fe6e559a640 1 -- 172.21.15.82:0/3197970468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8032810 con 0x7fe6e80ae910 2024-06-02T22:53:50.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.589+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3197970468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e80ae910 msgr2=0x7fe6e806e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.589+0000 7fe6ecf5a640 1 --2- 172.21.15.82:0/3197970468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e80ae910 0x7fe6e806e4e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80098a0 tx=0x7fe6d802a1a0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.589+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3197970468 shutdown_connections 2024-06-02T22:53:50.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.589+0000 7fe6ecf5a640 1 --2- 172.21.15.82:0/3197970468 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6e806ea20 0x7fe6e80cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.589+0000 7fe6ecf5a640 1 --2- 172.21.15.82:0/3197970468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e80ae910 0x7fe6e806e4e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.589+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3197970468 >> 172.21.15.82:0/3197970468 conn(0x7fe6e80b19f0 msgr2=0x7fe6e80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:50.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.589+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3197970468 shutdown_connections 2024-06-02T22:53:50.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.589+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3197970468 wait complete. 2024-06-02T22:53:50.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.591+0000 7fe6ecf5a640 1 Processor -- start 2024-06-02T22:53:50.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.591+0000 7fe6ecf5a640 1 -- start start 2024-06-02T22:53:50.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6ecf5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e806ea20 0x7fe6e814f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6ecf5a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6e80ae910 0x7fe6e809d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6ecf5a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6e80cf190 0x7fe6e8156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6ecf5a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e80aecf0 con 0x7fe6e806ea20 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6ecf5a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e806d9d0 con 0x7fe6e80cf190 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6ecf5a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e80add50 con 0x7fe6e80ae910 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6e659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e806ea20 0x7fe6e814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6e659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e806ea20 0x7fe6e814f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40964/0 (socket says 172.21.15.82:40964) 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6e659c640 1 -- 172.21.15.82:0/3765947687 learned_addr learned my addr 172.21.15.82:0/3765947687 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6e5d9b640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6e80ae910 0x7fe6e809d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6e6d9d640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6e80cf190 0x7fe6e8156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6e659c640 1 -- 172.21.15.82:0/3765947687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6e80ae910 msgr2=0x7fe6e809d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6e659c640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6e80ae910 0x7fe6e809d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6e659c640 1 -- 172.21.15.82:0/3765947687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6e80cf190 msgr2=0x7fe6e8156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6e659c640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6e80cf190 0x7fe6e8156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.592+0000 7fe6e659c640 1 -- 172.21.15.82:0/3765947687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e809dd00 con 0x7fe6e806ea20 2024-06-02T22:53:50.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.593+0000 7fe6e659c640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e806ea20 0x7fe6e814f910 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80098a0 tx=0x7fe6d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.594+0000 7fe6d6ffd640 1 -- 172.21.15.82:0/3765947687 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8037040 con 0x7fe6e806ea20 2024-06-02T22:53:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.594+0000 7fe6d6ffd640 1 -- 172.21.15.82:0/3765947687 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d8004250 con 0x7fe6e806ea20 2024-06-02T22:53:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.594+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3765947687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e815c720 con 0x7fe6e806ea20 2024-06-02T22:53:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.594+0000 7fe6d6ffd640 1 -- 172.21.15.82:0/3765947687 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8003610 con 0x7fe6e806ea20 2024-06-02T22:53:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.594+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3765947687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e814fe50 con 0x7fe6e806ea20 2024-06-02T22:53:50.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.595+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3765947687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e815c510 con 0x7fe6e806ea20 2024-06-02T22:53:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.596+0000 7fe6d6ffd640 1 -- 172.21.15.82:0/3765947687 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6d80037b0 con 0x7fe6e806ea20 2024-06-02T22:53:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.596+0000 7fe6d6ffd640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe6c806be30 0x7fe6c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.596+0000 7fe6d6ffd640 1 -- 172.21.15.82:0/3765947687 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fe6d80abc00 con 0x7fe6e806ea20 2024-06-02T22:53:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.596+0000 7fe6e5d9b640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe6c806be30 0x7fe6c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.597+0000 7fe6e5d9b640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe6c806be30 0x7fe6c806e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe6e81f7400 tx=0x7fe6dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:50.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.600+0000 7fe6d6ffd640 1 -- 172.21.15.82:0/3765947687 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe6d80b2080 con 0x7fe6e806ea20 2024-06-02T22:53:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.788+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3765947687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe6e8071ce0 con 0x7fe6e806ea20 2024-06-02T22:53:50.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.788+0000 7fe6d6ffd640 1 -- 172.21.15.82:0/3765947687 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7fe6d8079ef0 con 0x7fe6e806ea20 2024-06-02T22:53:50.789 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:53:50.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3765947687 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe6c806be30 msgr2=0x7fe6c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe6c806be30 0x7fe6c806e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe6e81f7400 tx=0x7fe6dc008040 comp rx=0 tx=0).stop 2024-06-02T22:53:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3765947687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e806ea20 msgr2=0x7fe6e814f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e806ea20 0x7fe6e814f910 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80098a0 tx=0x7fe6d80046c0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3765947687 shutdown_connections 2024-06-02T22:53:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe6c806be30 0x7fe6c806e2f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6e80cf190 0x7fe6e8156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6e80ae910 0x7fe6e809d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 --2- 172.21.15.82:0/3765947687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e806ea20 0x7fe6e814f910 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3765947687 >> 172.21.15.82:0/3765947687 conn(0x7fe6e80b19f0 msgr2=0x7fe6e80acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:50.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3765947687 shutdown_connections 2024-06-02T22:53:50.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.790+0000 7fe6ecf5a640 1 -- 172.21.15.82:0/3765947687 wait complete. 2024-06-02T22:53:50.802 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:50.802 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:50.822 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:53:50.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.966+0000 7efec708c640 1 Processor -- start 2024-06-02T22:53:50.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.966+0000 7efec708c640 1 -- start start 2024-06-02T22:53:50.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.966+0000 7efec708c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efec015f1a0 0x7efec00d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.966+0000 7efec708c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00cef70 0x7efec00cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.966+0000 7efec708c640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec015f5e0 con 0x7efec00d2680 2024-06-02T22:53:50.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.966+0000 7efec708c640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7efec00d13e0 con 0x7efec015f1a0 2024-06-02T22:53:50.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.966+0000 7efec708c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7efec00d0ad0 con 0x7efec00cef70 2024-06-02T22:53:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.967+0000 7efec5629640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00cef70 0x7efec00cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.967+0000 7efebffff640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efec015f1a0 0x7efec00d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.967+0000 7efec4e28640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7efec00d2680 0x7efec00d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:53640/0 (socket says 172.21.15.82:53640) 2024-06-02T22:53:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.967+0000 7efebffff640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efec015f1a0 0x7efec00d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:51812/0 (socket says 172.21.15.82:51812) 2024-06-02T22:53:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.967+0000 7efec5629640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00cef70 0x7efec00cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:50238/0 (socket says 172.21.15.82:50238) 2024-06-02T22:53:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.967+0000 7efec4e28640 1 -- 172.21.15.82:0/2695358831 learned_addr learned my addr 172.21.15.82:0/2695358831 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.967+0000 7efebffff640 1 -- 172.21.15.82:0/2695358831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00cef70 msgr2=0x7efec00cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.967+0000 7efebffff640 1 --2- 172.21.15.82:0/2695358831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00cef70 0x7efec00cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.967+0000 7efebffff640 1 -- 172.21.15.82:0/2695358831 >> v1:172.21.15.184:6789/0 conn(0x7efec00d2680 legacy=0x7efec00d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.967+0000 7efebffff640 1 -- 172.21.15.82:0/2695358831 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec015f890 con 0x7efec015f1a0 2024-06-02T22:53:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.968+0000 7efebffff640 1 --2- 172.21.15.82:0/2695358831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec015f1a0 0x7efec00d1fc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009d90 tx=0x7efeb402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=804d40579e43aef1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.968+0000 7efebf7fe640 1 -- 172.21.15.82:0/2695358831 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4007740 con 0x7efec015f1a0 2024-06-02T22:53:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.968+0000 7efebf7fe640 1 -- 172.21.15.82:0/2695358831 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb40078e0 con 0x7efec015f1a0 2024-06-02T22:53:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.968+0000 7efebf7fe640 1 -- 172.21.15.82:0/2695358831 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4007cb0 con 0x7efec015f1a0 2024-06-02T22:53:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.969+0000 7efec708c640 1 -- 172.21.15.82:0/2695358831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec015f1a0 msgr2=0x7efec00d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.969+0000 7efec708c640 1 --2- 172.21.15.82:0/2695358831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec015f1a0 0x7efec00d1fc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009d90 tx=0x7efeb402a660 comp rx=0 tx=0).stop 2024-06-02T22:53:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.969+0000 7efec708c640 1 -- 172.21.15.82:0/2695358831 shutdown_connections 2024-06-02T22:53:50.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.969+0000 7efec708c640 1 --2- 172.21.15.82:0/2695358831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00cef70 0x7efec00cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.969+0000 7efec708c640 1 --2- 172.21.15.82:0/2695358831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec015f1a0 0x7efec00d1fc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.969+0000 7efec708c640 1 -- 172.21.15.82:0/2695358831 >> 172.21.15.82:0/2695358831 conn(0x7efec009d3f0 msgr2=0x7efec00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:50.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.969+0000 7efec708c640 1 -- 172.21.15.82:0/2695358831 shutdown_connections 2024-06-02T22:53:50.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.969+0000 7efec708c640 1 -- 172.21.15.82:0/2695358831 wait complete. 2024-06-02T22:53:50.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.970+0000 7efec708c640 1 Processor -- start 2024-06-02T22:53:50.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.970+0000 7efec708c640 1 -- start start 2024-06-02T22:53:50.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec708c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec00cef70 0x7efec015a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec708c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00d2680 0x7efec015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec708c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec015f1a0 0x7efec015d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec708c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efec00d4f00 con 0x7efec015f1a0 2024-06-02T22:53:50.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec708c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efec00d1070 con 0x7efec00cef70 2024-06-02T22:53:50.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec708c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7efec00d1870 con 0x7efec00d2680 2024-06-02T22:53:50.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec5629640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec015f1a0 0x7efec015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec5629640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec015f1a0 0x7efec015d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59138/0 (socket says 172.21.15.82:59138) 2024-06-02T22:53:50.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec5629640 1 -- 172.21.15.82:0/504347995 learned_addr learned my addr 172.21.15.82:0/504347995 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:50.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec4e28640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec00cef70 0x7efec015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efebffff640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00d2680 0x7efec015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec5629640 1 -- 172.21.15.82:0/504347995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00d2680 msgr2=0x7efec015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec5629640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00d2680 0x7efec015cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec5629640 1 -- 172.21.15.82:0/504347995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec00cef70 msgr2=0x7efec015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec5629640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec00cef70 0x7efec015a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec5629640 1 -- 172.21.15.82:0/504347995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec015d780 con 0x7efec015f1a0 2024-06-02T22:53:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efebffff640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00d2680 0x7efec015cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efec5629640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec015f1a0 0x7efec015d240 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e930 tx=0x7efeb800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efebd7fa640 1 -- 172.21.15.82:0/504347995 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8017070 con 0x7efec015f1a0 2024-06-02T22:53:50.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.971+0000 7efebd7fa640 1 -- 172.21.15.82:0/504347995 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb800c980 con 0x7efec015f1a0 2024-06-02T22:53:50.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.972+0000 7efec708c640 1 -- 172.21.15.82:0/504347995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec015c460 con 0x7efec015f1a0 2024-06-02T22:53:50.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.972+0000 7efebd7fa640 1 -- 172.21.15.82:0/504347995 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb800cd70 con 0x7efec015f1a0 2024-06-02T22:53:50.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.972+0000 7efec708c640 1 -- 172.21.15.82:0/504347995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec015ca20 con 0x7efec015f1a0 2024-06-02T22:53:50.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.972+0000 7efec708c640 1 -- 172.21.15.82:0/504347995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec00d4330 con 0x7efec015f1a0 2024-06-02T22:53:50.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.973+0000 7efebd7fa640 1 -- 172.21.15.82:0/504347995 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efeb801a070 con 0x7efec015f1a0 2024-06-02T22:53:50.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.973+0000 7efebd7fa640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efeac06be30 0x7efeac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:50.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.974+0000 7efec4e28640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efeac06be30 0x7efeac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:50.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.974+0000 7efebd7fa640 1 -- 172.21.15.82:0/504347995 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7efeb808af70 con 0x7efec015f1a0 2024-06-02T22:53:50.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.974+0000 7efec4e28640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efeac06be30 0x7efeac06e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efeb0000f60 tx=0x7efeb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:50.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:50.978+0000 7efebd7fa640 1 -- 172.21.15.82:0/504347995 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efec00d4330 con 0x7efec015f1a0 2024-06-02T22:53:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.163+0000 7efec708c640 1 -- 172.21.15.82:0/504347995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efec0068430 con 0x7efec015f1a0 2024-06-02T22:53:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.163+0000 7efebd7fa640 1 -- 172.21.15.82:0/504347995 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7efeb80598e0 con 0x7efec015f1a0 2024-06-02T22:53:51.164 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:53:51.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 -- 172.21.15.82:0/504347995 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efeac06be30 msgr2=0x7efeac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:51.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efeac06be30 0x7efeac06e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efeb0000f60 tx=0x7efeb0009040 comp rx=0 tx=0).stop 2024-06-02T22:53:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 -- 172.21.15.82:0/504347995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec015f1a0 msgr2=0x7efec015d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec015f1a0 0x7efec015d240 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e930 tx=0x7efeb800edf0 comp rx=0 tx=0).stop 2024-06-02T22:53:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 -- 172.21.15.82:0/504347995 shutdown_connections 2024-06-02T22:53:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efeac06be30 0x7efeac06e2f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec015f1a0 0x7efec015d240 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec00d2680 0x7efec015cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 --2- 172.21.15.82:0/504347995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec00cef70 0x7efec015a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 -- 172.21.15.82:0/504347995 >> 172.21.15.82:0/504347995 conn(0x7efec009d3f0 msgr2=0x7efec00c83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 -- 172.21.15.82:0/504347995 shutdown_connections 2024-06-02T22:53:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:51.165+0000 7efec708c640 1 -- 172.21.15.82:0/504347995 wait complete. 2024-06-02T22:53:51.176 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-06-02T22:53:51.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:51.176 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:51.199 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[54935]: fuse finished with error 0 and tester_r 0 2024-06-02T22:53:51.201 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:53:57.303 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:53:57.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:57.303 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T22:53:57.323 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T22:53:57.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.473+0000 7f4a091b7640 1 Processor -- start 2024-06-02T22:53:57.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.473+0000 7f4a091b7640 1 -- start start 2024-06-02T22:53:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.474+0000 7f4a091b7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a040d2680 0x7f4a0415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.474+0000 7f4a091b7640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4a040d1fc0 0x7f4a040d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.474+0000 7f4a091b7640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a040d2fa0 con 0x7f4a04161fa0 2024-06-02T22:53:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.474+0000 7f4a091b7640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f4a040cff80 con 0x7f4a040d1fc0 2024-06-02T22:53:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.474+0000 7f4a091b7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4a040d13e0 con 0x7f4a040d2680 2024-06-02T22:53:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.475+0000 7f4a02d9d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a040d2680 0x7f4a0415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.475+0000 7f4a0259c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4a040d1fc0 0x7f4a040d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.475+0000 7f4a0359e640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f4a04161fa0 0x7f4a04162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:53650/0 (socket says 172.21.15.82:53650) 2024-06-02T22:53:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.475+0000 7f4a0359e640 1 -- 172.21.15.82:0/2532703858 learned_addr learned my addr 172.21.15.82:0/2532703858 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.475+0000 7f4a0259c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4a040d1fc0 0x7f4a040d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:51828/0 (socket says 172.21.15.82:51828) 2024-06-02T22:53:57.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.475+0000 7f4a0259c640 1 -- 172.21.15.82:0/2532703858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a040d2680 msgr2=0x7f4a0415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:57.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.475+0000 7f4a0259c640 1 --2- 172.21.15.82:0/2532703858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a040d2680 0x7f4a0415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:57.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.475+0000 7f4a0259c640 1 -- 172.21.15.82:0/2532703858 >> v1:172.21.15.184:6789/0 conn(0x7f4a04161fa0 legacy=0x7f4a04162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:57.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.475+0000 7f4a0259c640 1 -- 172.21.15.82:0/2532703858 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a040d0ad0 con 0x7f4a040d1fc0 2024-06-02T22:53:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.476+0000 7f4a0259c640 1 --2- 172.21.15.82:0/2532703858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a040d1fc0 0x7f4a040d2a60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f49f80097a0 tx=0x7f49f802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f362b5a9dda361a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.476+0000 7f4a01d9b640 1 -- 172.21.15.82:0/2532703858 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8037070 con 0x7f4a040d1fc0 2024-06-02T22:53:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.476+0000 7f4a01d9b640 1 -- 172.21.15.82:0/2532703858 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f8032440 con 0x7f4a040d1fc0 2024-06-02T22:53:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.476+0000 7f4a01d9b640 1 -- 172.21.15.82:0/2532703858 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8032810 con 0x7f4a040d1fc0 2024-06-02T22:53:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.477+0000 7f4a091b7640 1 -- 172.21.15.82:0/2532703858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a040d1fc0 msgr2=0x7f4a040d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.477+0000 7f4a091b7640 1 --2- 172.21.15.82:0/2532703858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a040d1fc0 0x7f4a040d2a60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f49f80097a0 tx=0x7f49f802a180 comp rx=0 tx=0).stop 2024-06-02T22:53:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.477+0000 7f4a091b7640 1 -- 172.21.15.82:0/2532703858 shutdown_connections 2024-06-02T22:53:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.477+0000 7f4a091b7640 1 --2- 172.21.15.82:0/2532703858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a040d1fc0 0x7f4a040d2a60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:57.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.477+0000 7f4a091b7640 1 --2- 172.21.15.82:0/2532703858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a040d2680 0x7f4a0415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.477+0000 7f4a091b7640 1 -- 172.21.15.82:0/2532703858 >> 172.21.15.82:0/2532703858 conn(0x7f4a0409d3f0 msgr2=0x7f4a040d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.477+0000 7f4a091b7640 1 -- 172.21.15.82:0/2532703858 shutdown_connections 2024-06-02T22:53:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.477+0000 7f4a091b7640 1 -- 172.21.15.82:0/2532703858 wait complete. 2024-06-02T22:53:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.478+0000 7f4a091b7640 1 Processor -- start 2024-06-02T22:53:57.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.478+0000 7f4a091b7640 1 -- start start 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.479+0000 7f4a091b7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a040d1fc0 0x7f4a040cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.479+0000 7f4a091b7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a040d2680 0x7f4a0415de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.479+0000 7f4a091b7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a04161fa0 0x7f4a040b8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.479+0000 7f4a091b7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4a040d1070 con 0x7f4a04161fa0 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.479+0000 7f4a091b7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4a040d0d90 con 0x7f4a040d2680 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.479+0000 7f4a091b7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4a040d2400 con 0x7f4a040d1fc0 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.479+0000 7f4a0359e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a04161fa0 0x7f4a040b8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.479+0000 7f4a0359e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a04161fa0 0x7f4a040b8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59148/0 (socket says 172.21.15.82:59148) 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.479+0000 7f4a0359e640 1 -- 172.21.15.82:0/150794537 learned_addr learned my addr 172.21.15.82:0/150794537 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.479+0000 7f4a0259c640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a040d2680 0x7f4a0415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.479+0000 7f4a02d9d640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a040d1fc0 0x7f4a040cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.480+0000 7f4a0359e640 1 -- 172.21.15.82:0/150794537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a040d1fc0 msgr2=0x7f4a040cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.480+0000 7f4a0359e640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a040d1fc0 0x7f4a040cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:57.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.480+0000 7f4a0359e640 1 -- 172.21.15.82:0/150794537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a040d2680 msgr2=0x7f4a0415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.480+0000 7f4a0359e640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a040d2680 0x7f4a0415de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.480+0000 7f4a0359e640 1 -- 172.21.15.82:0/150794537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a040cc720 con 0x7f4a04161fa0 2024-06-02T22:53:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.480+0000 7f4a0359e640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a04161fa0 0x7f4a040b8e70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00c3a0 tx=0x7f49fc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.480+0000 7f49eb7fe640 1 -- 172.21.15.82:0/150794537 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc017070 con 0x7f4a04161fa0 2024-06-02T22:53:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.480+0000 7f49eb7fe640 1 -- 172.21.15.82:0/150794537 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49fc005ce0 con 0x7f4a04161fa0 2024-06-02T22:53:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.480+0000 7f49eb7fe640 1 -- 172.21.15.82:0/150794537 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0072d0 con 0x7f4a04161fa0 2024-06-02T22:53:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.480+0000 7f4a091b7640 1 -- 172.21.15.82:0/150794537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0415af30 con 0x7f4a04161fa0 2024-06-02T22:53:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.480+0000 7f4a091b7640 1 -- 172.21.15.82:0/150794537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0415b4f0 con 0x7f4a04161fa0 2024-06-02T22:53:57.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.481+0000 7f4a091b7640 1 -- 172.21.15.82:0/150794537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a04068430 con 0x7f4a04161fa0 2024-06-02T22:53:57.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.481+0000 7f49eb7fe640 1 -- 172.21.15.82:0/150794537 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f49fc01a070 con 0x7f4a04161fa0 2024-06-02T22:53:57.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.482+0000 7f49eb7fe640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f49f006be30 0x7f49f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:57.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.482+0000 7f4a02d9d640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f49f006be30 0x7f49f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:57.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.482+0000 7f49eb7fe640 1 -- 172.21.15.82:0/150794537 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f49fc08a200 con 0x7f4a04161fa0 2024-06-02T22:53:57.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.482+0000 7f4a02d9d640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f49f006be30 0x7f49f006e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f49f40113e0 tx=0x7f49f400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:57.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.486+0000 7f49eb7fe640 1 -- 172.21.15.82:0/150794537 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f49fc0583d0 con 0x7f4a04161fa0 2024-06-02T22:53:57.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.698+0000 7f4a091b7640 1 -- 172.21.15.82:0/150794537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4a040d04e0 con 0x7f4a04161fa0 2024-06-02T22:53:57.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.699+0000 7f49eb7fe640 1 -- 172.21.15.82:0/150794537 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7f49fc05c6d0 con 0x7f4a04161fa0 2024-06-02T22:53:57.699 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.700+0000 7f4a091b7640 1 -- 172.21.15.82:0/150794537 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f49f006be30 msgr2=0x7f49f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.700+0000 7f4a091b7640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f49f006be30 0x7f49f006e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f49f40113e0 tx=0x7f49f400b040 comp rx=0 tx=0).stop 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.701+0000 7f4a091b7640 1 -- 172.21.15.82:0/150794537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a04161fa0 msgr2=0x7f4a040b8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.701+0000 7f4a091b7640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a04161fa0 0x7f4a040b8e70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00c3a0 tx=0x7f49fc00c860 comp rx=0 tx=0).stop 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.701+0000 7f4a091b7640 1 -- 172.21.15.82:0/150794537 shutdown_connections 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.701+0000 7f4a091b7640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f49f006be30 0x7f49f006e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.701+0000 7f4a091b7640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a04161fa0 0x7f4a040b8e70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.701+0000 7f4a091b7640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a040d2680 0x7f4a0415de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.701+0000 7f4a091b7640 1 --2- 172.21.15.82:0/150794537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a040d1fc0 0x7f4a040cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.701+0000 7f4a091b7640 1 -- 172.21.15.82:0/150794537 >> 172.21.15.82:0/150794537 conn(0x7f4a0409d3f0 msgr2=0x7f4a04160710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.701+0000 7f4a091b7640 1 -- 172.21.15.82:0/150794537 shutdown_connections 2024-06-02T22:53:57.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57.701+0000 7f4a091b7640 1 -- 172.21.15.82:0/150794537 wait complete. 2024-06-02T22:53:57.711 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T22:53:57.711 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:53:57.711 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-06-02T22:53:57.711 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T22:53:57.712 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:57.712 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T22:53:57.712 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:53:57.712 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:53:57.712 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:57.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:57.712 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-06-02T22:53:57.728 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:53:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:53:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:53:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-02T22:53:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T22:53:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42660sec preferred_lft 42660sec 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::6847:90ff:fe09:5afd/64 scope link 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 7e:10:3a:74:07:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::7c10:3aff:fe74:7cf/64 scope link 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:57.730 INFO:teuthology.orchestra.run.smithi082.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:53:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::103e:51ff:fe43:acf3/64 scope link 2024-06-02T22:53:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:53:57.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:57.731 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:53:57.791 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-06-02T22:53:57.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:57.793 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-06-02T22:53:57.850 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-06-02T22:53:57.850 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:53:57.850 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T22:53:57.850 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T22:53:57.851 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:53:57.851 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:53:57.851 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:53:57.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T22:53:57.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T22:53:57.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T22:53:57.851 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:53:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:53:57.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:53:57.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:57.976 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-02T22:53:57.991 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T22:53:57.992 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T22:53:57.992 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:57.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:57.992 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-06-02T22:53:58.056 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-02T22:53:58.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:53:58.056 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:58.111 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:53:58.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:53:58.112 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:58.167 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:53:58.233 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:53:58.289 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:53:58.289 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:53:58.289 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:53:58.289 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:53:58.289 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:53:58.289 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:53:58.289 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:53:58.289 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:53:58.289 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:53:58.289 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:53:58.289 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:53:58.290 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:53:58.290 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:53:58.290 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:53:58.290 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:53:58.290 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:53:58.290 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:53:58.290 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:53:58.290 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:53:58.290 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:53:58.290 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:58.291 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:58.292 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:58.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:58.292 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:53:58.343 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T22:53:58.343 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-02T22:53:58.386 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:53:58.410 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:53:58.466 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:53:58.466 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:53:58.466 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:53:58.466 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:53:58.466 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:53:58.466 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:53:58.466 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:53:58.467 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:58.468 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:53:58.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:58.469 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:53:58.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2024-06-02T22:53:58.467+0000 7f693fe0d480 -1 init, newargv = 0x557cd58f82f0 newargc=15 2024-06-02T22:53:58.470 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[55563]: starting ceph client 2024-06-02T22:53:58.472 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[55563]: starting fuse 2024-06-02T22:53:58.484 INFO:teuthology.orchestra.run.smithi082.stdout:40 2024-06-02T22:53:58.485 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:58.485 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:53:58.486 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:58.487 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2024-06-02T22:53:58.487 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-06-02T22:53:58.603 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.55563.asok 2024-06-02T22:53:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:53:58.613 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55563.asok 2024-06-02T22:53:58.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:58.614 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55563.asok status 2024-06-02T22:53:58.748 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:53:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-06-02T22:53:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:53:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:53:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2024-06-02T22:53:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-06-02T22:53:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-02T22:53:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "55563", 2024-06-02T22:53:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-06-02T22:53:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-06-02T22:53:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-06-02T22:53:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5619, 2024-06-02T22:53:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-06-02T22:53:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-06-02T22:53:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-06-02T22:53:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 5619 2024-06-02T22:53:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:53:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:53:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:53:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 4229394846 2024-06-02T22:53:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:53:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:53:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:53:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:53:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 4229394846 2024-06-02T22:53:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:53:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.5619 192.168.0.1:0/4229394846", 2024-06-02T22:53:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/4229394846", 2024-06-02T22:53:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-06-02T22:53:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 23, 2024-06-02T22:53:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 54, 2024-06-02T22:53:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:53:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-06-02T22:53:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-06-02T22:53:58.755 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:53:58.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:58.757 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-06-02T22:53:58.757 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:58.774 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-06-02T22:53:58.774 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:58.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:58.775 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:53:58.840 DEBUG:teuthology.orchestra.run.smithi082:> stdin-killer -- python3 -c ' 2024-06-02T22:53:58.840 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-06-02T22:53:58.840 DEBUG:teuthology.orchestra.run.smithi082:> import errno 2024-06-02T22:53:58.840 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:53:58.841 DEBUG:teuthology.orchestra.run.smithi082:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-06-02T22:53:58.841 DEBUG:teuthology.orchestra.run.smithi082:> try: 2024-06-02T22:53:58.841 DEBUG:teuthology.orchestra.run.smithi082:> if False: 2024-06-02T22:53:58.841 DEBUG:teuthology.orchestra.run.smithi082:> ret = os.read(fd, 1024) 2024-06-02T22:53:58.841 DEBUG:teuthology.orchestra.run.smithi082:> else: 2024-06-02T22:53:58.842 DEBUG:teuthology.orchestra.run.smithi082:> os.write(fd, b'"'"'content'"'"') 2024-06-02T22:53:58.842 DEBUG:teuthology.orchestra.run.smithi082:> except OSError as e: 2024-06-02T22:53:58.842 DEBUG:teuthology.orchestra.run.smithi082:> if e.errno != errno.EPERM: 2024-06-02T22:53:58.842 DEBUG:teuthology.orchestra.run.smithi082:> raise 2024-06-02T22:53:58.842 DEBUG:teuthology.orchestra.run.smithi082:> else: 2024-06-02T22:53:58.843 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("client does not check permission of data pool") 2024-06-02T22:53:58.843 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-06-02T22:53:58.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:53:58.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2024-06-02T22:53:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.104+0000 7fed85aa5640 1 Processor -- start 2024-06-02T22:53:59.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.104+0000 7fed85aa5640 1 -- start start 2024-06-02T22:53:59.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.105+0000 7fed85aa5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed801589e0 0x7fed8015f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.105+0000 7fed85aa5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed800d06e0 0x7fed800ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.105+0000 7fed85aa5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed80158dc0 con 0x7fed8015ea40 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.105+0000 7fed85aa5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fed800721b0 con 0x7fed801589e0 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.105+0000 7fed85aa5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fed80072490 con 0x7fed800d06e0 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.105+0000 7fed7f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed801589e0 0x7fed8015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.105+0000 7fed7effd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fed8015ea40 0x7fed800cffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55994/0 (socket says 172.21.15.82:55994) 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.105+0000 7fed7effd640 1 -- 172.21.15.82:0/20853086 learned_addr learned my addr 172.21.15.82:0/20853086 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.106+0000 7fed7f7fe640 1 -- 172.21.15.82:0/20853086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed800d06e0 msgr2=0x7fed800ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.106+0000 7fed7ffff640 1 --2- 172.21.15.82:0/20853086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed800d06e0 0x7fed800ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.106+0000 7fed7f7fe640 1 --2- 172.21.15.82:0/20853086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed800d06e0 0x7fed800ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.106+0000 7fed7e7fc640 1 -- 172.21.15.82:0/20853086 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200811180 0 0) 0x7fed80158dc0 con 0x7fed8015ea40 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.106+0000 7fed7f7fe640 1 -- 172.21.15.82:0/20853086 >> v1:172.21.15.82:6789/0 conn(0x7fed8015ea40 legacy=0x7fed800cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.106+0000 7fed7f7fe640 1 -- 172.21.15.82:0/20853086 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed80072770 con 0x7fed801589e0 2024-06-02T22:53:59.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.106+0000 7fed7ffff640 1 --2- 172.21.15.82:0/20853086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed800d06e0 0x7fed800ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.106+0000 7fed7f7fe640 1 --2- 172.21.15.82:0/20853086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed801589e0 0x7fed8015f270 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fed7000ba40 tx=0x7fed7002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df683e016be02695 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.106+0000 7fed7e7fc640 1 -- 172.21.15.82:0/20853086 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70032750 con 0x7fed801589e0 2024-06-02T22:53:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.106+0000 7fed7e7fc640 1 -- 172.21.15.82:0/20853086 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed70030050 con 0x7fed801589e0 2024-06-02T22:53:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.107+0000 7fed7e7fc640 1 -- 172.21.15.82:0/20853086 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70032b10 con 0x7fed801589e0 2024-06-02T22:53:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.107+0000 7fed85aa5640 1 -- 172.21.15.82:0/20853086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed801589e0 msgr2=0x7fed8015f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.107+0000 7fed85aa5640 1 --2- 172.21.15.82:0/20853086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed801589e0 0x7fed8015f270 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fed7000ba40 tx=0x7fed7002c850 comp rx=0 tx=0).stop 2024-06-02T22:53:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.107+0000 7fed85aa5640 1 -- 172.21.15.82:0/20853086 shutdown_connections 2024-06-02T22:53:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.107+0000 7fed85aa5640 1 --2- 172.21.15.82:0/20853086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed800d06e0 0x7fed800ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.107+0000 7fed85aa5640 1 --2- 172.21.15.82:0/20853086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed801589e0 0x7fed8015f270 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.107+0000 7fed85aa5640 1 -- 172.21.15.82:0/20853086 >> 172.21.15.82:0/20853086 conn(0x7fed8006b7e0 msgr2=0x7fed8006bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.107+0000 7fed85aa5640 1 -- 172.21.15.82:0/20853086 shutdown_connections 2024-06-02T22:53:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.107+0000 7fed85aa5640 1 -- 172.21.15.82:0/20853086 wait complete. 2024-06-02T22:53:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.108+0000 7fed85aa5640 1 Processor -- start 2024-06-02T22:53:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.108+0000 7fed85aa5640 1 -- start start 2024-06-02T22:53:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.109+0000 7fed85aa5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed800d06e0 0x7fed80155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.109+0000 7fed85aa5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed801589e0 0x7fed801f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.109+0000 7fed85aa5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed8015ea40 0x7fed800cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.109+0000 7fed85aa5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fed8015f7b0 con 0x7fed801589e0 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.109+0000 7fed85aa5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fed80072d30 con 0x7fed800d06e0 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.109+0000 7fed85aa5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fed80073250 con 0x7fed8015ea40 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.109+0000 7fed7effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed801589e0 0x7fed801f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.109+0000 7fed7effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed801589e0 0x7fed801f7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59162/0 (socket says 172.21.15.82:59162) 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.109+0000 7fed7effd640 1 -- 172.21.15.82:0/2024908607 learned_addr learned my addr 172.21.15.82:0/2024908607 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.109+0000 7fed7f7fe640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed800d06e0 0x7fed80155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.109+0000 7fed7ffff640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed8015ea40 0x7fed800cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.110+0000 7fed7effd640 1 -- 172.21.15.82:0/2024908607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed8015ea40 msgr2=0x7fed800cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.110+0000 7fed7effd640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed8015ea40 0x7fed800cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.110+0000 7fed7effd640 1 -- 172.21.15.82:0/2024908607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed800d06e0 msgr2=0x7fed80155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.110+0000 7fed7effd640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed800d06e0 0x7fed80155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.110+0000 7fed7effd640 1 -- 172.21.15.82:0/2024908607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed800cdb10 con 0x7fed801589e0 2024-06-02T22:53:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.110+0000 7fed7effd640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed801589e0 0x7fed801f7630 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c4d0 tx=0x7fed7400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.110+0000 7fed67fff640 1 -- 172.21.15.82:0/2024908607 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74018070 con 0x7fed801589e0 2024-06-02T22:53:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.110+0000 7fed67fff640 1 -- 172.21.15.82:0/2024908607 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed74007500 con 0x7fed801589e0 2024-06-02T22:53:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.110+0000 7fed85aa5640 1 -- 172.21.15.82:0/2024908607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed80156600 con 0x7fed801589e0 2024-06-02T22:53:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.110+0000 7fed67fff640 1 -- 172.21.15.82:0/2024908607 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74004a20 con 0x7fed801589e0 2024-06-02T22:53:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.110+0000 7fed85aa5640 1 -- 172.21.15.82:0/2024908607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed80156bc0 con 0x7fed801589e0 2024-06-02T22:53:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.111+0000 7fed85aa5640 1 -- 172.21.15.82:0/2024908607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed800683c0 con 0x7fed801589e0 2024-06-02T22:53:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.111+0000 7fed67fff640 1 -- 172.21.15.82:0/2024908607 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed7401b070 con 0x7fed801589e0 2024-06-02T22:53:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.112+0000 7fed67fff640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fed6c06be30 0x7fed6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.112+0000 7fed67fff640 1 -- 172.21.15.82:0/2024908607 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fed7408a340 con 0x7fed801589e0 2024-06-02T22:53:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.112+0000 7fed7f7fe640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fed6c06be30 0x7fed6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.112+0000 7fed7f7fe640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fed6c06be30 0x7fed6c06e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fed70037000 tx=0x7fed70032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.116+0000 7fed67fff640 1 -- 172.21.15.82:0/2024908607 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fed74058b60 con 0x7fed801589e0 2024-06-02T22:53:59.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.354+0000 7fed85aa5640 1 -- 172.21.15.82:0/2024908607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) -- 0x7fed800cc290 con 0x7fed801589e0 2024-06-02T22:53:59.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.356+0000 7fed67fff640 1 -- 172.21.15.82:0/2024908607 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v15) ==== 183+0+140 (secure 0 0 0) 0x7fed74058460 con 0x7fed801589e0 2024-06-02T22:53:59.356 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-06-02T22:53:59.356 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g== 2024-06-02T22:53:59.356 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2024-06-02T22:53:59.356 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2024-06-02T22:53:59.356 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow w pool=cephfs_data" 2024-06-02T22:53:59.356 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2024-06-02T22:53:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 -- 172.21.15.82:0/2024908607 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fed6c06be30 msgr2=0x7fed6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fed6c06be30 0x7fed6c06e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fed70037000 tx=0x7fed70032000 comp rx=0 tx=0).stop 2024-06-02T22:53:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 -- 172.21.15.82:0/2024908607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed801589e0 msgr2=0x7fed801f7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed801589e0 0x7fed801f7630 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c4d0 tx=0x7fed7400c990 comp rx=0 tx=0).stop 2024-06-02T22:53:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 -- 172.21.15.82:0/2024908607 shutdown_connections 2024-06-02T22:53:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fed6c06be30 0x7fed6c06e2f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed8015ea40 0x7fed800cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed801589e0 0x7fed801f7630 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 --2- 172.21.15.82:0/2024908607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed800d06e0 0x7fed80155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 -- 172.21.15.82:0/2024908607 >> 172.21.15.82:0/2024908607 conn(0x7fed8006b7e0 msgr2=0x7fed8015c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:59.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 -- 172.21.15.82:0/2024908607 shutdown_connections 2024-06-02T22:53:59.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.358+0000 7fed85aa5640 1 -- 172.21.15.82:0/2024908607 wait complete. 2024-06-02T22:53:59.368 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:59.369 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:59.384 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:53:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.523+0000 7faaa32a3640 1 Processor -- start 2024-06-02T22:53:59.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.524+0000 7faaa32a3640 1 -- start start 2024-06-02T22:53:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.524+0000 7faaa32a3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 0x7faa9c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.524+0000 7faaa32a3640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faa9c0cef70 0x7faa9c0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa32a3640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa9c0d0ad0 con 0x7faa9c0d1fc0 2024-06-02T22:53:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa32a3640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7faa9c0d13e0 con 0x7faa9c0cef70 2024-06-02T22:53:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa32a3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7faa9c15f890 con 0x7faa9c0d2680 2024-06-02T22:53:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa103f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 0x7faa9c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa1840640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faa9c0cef70 0x7faa9c0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa083e640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7faa9c0d1fc0 0x7faa9c0d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:53662/0 (socket says 172.21.15.82:53662) 2024-06-02T22:53:59.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa103f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 0x7faa9c15f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:50276/0 (socket says 172.21.15.82:50276) 2024-06-02T22:53:59.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa083e640 1 -- 172.21.15.82:0/673894220 learned_addr learned my addr 172.21.15.82:0/673894220 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:59.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa1840640 1 -- 172.21.15.82:0/673894220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 msgr2=0x7faa9c15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:59.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa1840640 1 --2- 172.21.15.82:0/673894220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 0x7faa9c15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa1840640 1 -- 172.21.15.82:0/673894220 >> v1:172.21.15.184:6789/0 conn(0x7faa9c0d1fc0 legacy=0x7faa9c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa1840640 1 -- 172.21.15.82:0/673894220 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9c0d0d90 con 0x7faa9c0cef70 2024-06-02T22:53:59.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.525+0000 7faaa103f640 1 --2- 172.21.15.82:0/673894220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 0x7faa9c15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:53:59.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.526+0000 7faaa1840640 1 --2- 172.21.15.82:0/673894220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa9c0cef70 0x7faa9c0cf400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa94009d90 tx=0x7faa9402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd59e79d3d855b72 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:59.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.526+0000 7faa8ffff640 1 -- 172.21.15.82:0/673894220 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94007740 con 0x7faa9c0cef70 2024-06-02T22:53:59.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.526+0000 7faa8ffff640 1 -- 172.21.15.82:0/673894220 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa940078e0 con 0x7faa9c0cef70 2024-06-02T22:53:59.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.526+0000 7faa8ffff640 1 -- 172.21.15.82:0/673894220 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94007cb0 con 0x7faa9c0cef70 2024-06-02T22:53:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.527+0000 7faaa32a3640 1 -- 172.21.15.82:0/673894220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa9c0cef70 msgr2=0x7faa9c0cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.527+0000 7faaa32a3640 1 --2- 172.21.15.82:0/673894220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa9c0cef70 0x7faa9c0cf400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa94009d90 tx=0x7faa9402a660 comp rx=0 tx=0).stop 2024-06-02T22:53:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.527+0000 7faaa32a3640 1 -- 172.21.15.82:0/673894220 shutdown_connections 2024-06-02T22:53:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.527+0000 7faaa32a3640 1 --2- 172.21.15.82:0/673894220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa9c0cef70 0x7faa9c0cf400 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.527+0000 7faaa32a3640 1 --2- 172.21.15.82:0/673894220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 0x7faa9c15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.527+0000 7faaa32a3640 1 -- 172.21.15.82:0/673894220 >> 172.21.15.82:0/673894220 conn(0x7faa9c09d3f0 msgr2=0x7faa9c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.527+0000 7faaa32a3640 1 -- 172.21.15.82:0/673894220 shutdown_connections 2024-06-02T22:53:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.527+0000 7faaa32a3640 1 -- 172.21.15.82:0/673894220 wait complete. 2024-06-02T22:53:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.528+0000 7faaa32a3640 1 Processor -- start 2024-06-02T22:53:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.528+0000 7faaa32a3640 1 -- start start 2024-06-02T22:53:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa32a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa9c0cef70 0x7faa9c1592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa32a3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa9c0d1fc0 0x7faa9c15d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa32a3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 0x7faa9c09f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa32a3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c0d4f00 con 0x7faa9c0cef70 2024-06-02T22:53:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa32a3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c0d2400 con 0x7faa9c0d1fc0 2024-06-02T22:53:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa32a3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7faa9c0d1870 con 0x7faa9c0d2680 2024-06-02T22:53:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa103f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa9c0cef70 0x7faa9c1592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa103f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa9c0cef70 0x7faa9c1592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59176/0 (socket says 172.21.15.82:59176) 2024-06-02T22:53:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa103f640 1 -- 172.21.15.82:0/1444005336 learned_addr learned my addr 172.21.15.82:0/1444005336 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa083e640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa9c0d1fc0 0x7faa9c15d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa1840640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 0x7faa9c09f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa103f640 1 -- 172.21.15.82:0/1444005336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 msgr2=0x7faa9c09f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa103f640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 0x7faa9c09f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa103f640 1 -- 172.21.15.82:0/1444005336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa9c0d1fc0 msgr2=0x7faa9c15d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.529+0000 7faaa103f640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa9c0d1fc0 0x7faa9c15d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.530+0000 7faaa103f640 1 -- 172.21.15.82:0/1444005336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9c15dfa0 con 0x7faa9c0cef70 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.530+0000 7faaa083e640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa9c0d1fc0 0x7faa9c15d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.530+0000 7faaa103f640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa9c0cef70 0x7faa9c1592f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7faa9000e960 tx=0x7faa9000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.530+0000 7faa8dffb640 1 -- 172.21.15.82:0/1444005336 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90017070 con 0x7faa9c0cef70 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.530+0000 7faa8dffb640 1 -- 172.21.15.82:0/1444005336 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9000ca00 con 0x7faa9c0cef70 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.530+0000 7faaa32a3640 1 -- 172.21.15.82:0/1444005336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9c15e240 con 0x7faa9c0cef70 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.530+0000 7faa8dffb640 1 -- 172.21.15.82:0/1444005336 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9000cdd0 con 0x7faa9c0cef70 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.530+0000 7faaa32a3640 1 -- 172.21.15.82:0/1444005336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9c09e870 con 0x7faa9c0cef70 2024-06-02T22:53:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.531+0000 7faaa32a3640 1 -- 172.21.15.82:0/1444005336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9c15e9d0 con 0x7faa9c0cef70 2024-06-02T22:53:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.531+0000 7faa8dffb640 1 -- 172.21.15.82:0/1444005336 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa9001a070 con 0x7faa9c0cef70 2024-06-02T22:53:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.532+0000 7faa8dffb640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa8006be60 0x7faa8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.532+0000 7faa8dffb640 1 -- 172.21.15.82:0/1444005336 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7faa9008b1d0 con 0x7faa9c0cef70 2024-06-02T22:53:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.532+0000 7faaa083e640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa8006be60 0x7faa8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.532+0000 7faaa083e640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa8006be60 0x7faa8006e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faa9c159d10 tx=0x7faa98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:59.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.536+0000 7faa8dffb640 1 -- 172.21.15.82:0/1444005336 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faa9c15e9d0 con 0x7faa9c0cef70 2024-06-02T22:53:59.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.722+0000 7faaa32a3640 1 -- 172.21.15.82:0/1444005336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faa9c068430 con 0x7faa9c0cef70 2024-06-02T22:53:59.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.723+0000 7faa8dffb640 1 -- 172.21.15.82:0/1444005336 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7faa90059a80 con 0x7faa9c0cef70 2024-06-02T22:53:59.723 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:53:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 -- 172.21.15.82:0/1444005336 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa8006be60 msgr2=0x7faa8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa8006be60 0x7faa8006e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faa9c159d10 tx=0x7faa98009040 comp rx=0 tx=0).stop 2024-06-02T22:53:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 -- 172.21.15.82:0/1444005336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa9c0cef70 msgr2=0x7faa9c1592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa9c0cef70 0x7faa9c1592f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7faa9000e960 tx=0x7faa9000ee20 comp rx=0 tx=0).stop 2024-06-02T22:53:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 -- 172.21.15.82:0/1444005336 shutdown_connections 2024-06-02T22:53:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7faa8006be60 0x7faa8006e320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa9c0d2680 0x7faa9c09f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa9c0d1fc0 0x7faa9c15d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 --2- 172.21.15.82:0/1444005336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa9c0cef70 0x7faa9c1592f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 -- 172.21.15.82:0/1444005336 >> 172.21.15.82:0/1444005336 conn(0x7faa9c09d3f0 msgr2=0x7faa9c160640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:59.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 -- 172.21.15.82:0/1444005336 shutdown_connections 2024-06-02T22:53:59.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.725+0000 7faaa32a3640 1 -- 172.21.15.82:0/1444005336 wait complete. 2024-06-02T22:53:59.736 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:53:59.736 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:59.753 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:53:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.894+0000 7fd03a8b2640 1 Processor -- start 2024-06-02T22:53:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.894+0000 7fd03a8b2640 1 -- start start 2024-06-02T22:53:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.895+0000 7fd03a8b2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd0340cf360 0x7fd0340b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.895+0000 7fd03a8b2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0340b3420 con 0x7fd0341553c0 2024-06-02T22:53:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.895+0000 7fd03a8b2640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0340cc750 con 0x7fd0340cd230 2024-06-02T22:53:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.895+0000 7fd03a8b2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd0340cca30 con 0x7fd0340cf360 2024-06-02T22:53:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.895+0000 7fd038e4f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd0340cf360 0x7fd0340b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.895+0000 7fd033fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd0341553c0 0x7fd03415beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56000/0 (socket says 172.21.15.82:56000) 2024-06-02T22:53:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.895+0000 7fd033fff640 1 -- 172.21.15.82:0/2305443576 learned_addr learned my addr 172.21.15.82:0/2305443576 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:53:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.895+0000 7fd038e4f640 1 -- 172.21.15.82:0/2305443576 >> v1:172.21.15.184:6789/0 conn(0x7fd0340cd230 legacy=0x7fd0340cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:53:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.895+0000 7fd038e4f640 1 -- 172.21.15.82:0/2305443576 >> v1:172.21.15.82:6789/0 conn(0x7fd0341553c0 legacy=0x7fd03415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.895+0000 7fd032ffd640 1 -- 172.21.15.82:0/2305443576 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151684670 0 0) 0x7fd0340b3420 con 0x7fd0341553c0 2024-06-02T22:53:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.895+0000 7fd038e4f640 1 -- 172.21.15.82:0/2305443576 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0340ccd10 con 0x7fd0340cf360 2024-06-02T22:53:59.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.896+0000 7fd038e4f640 1 --2- 172.21.15.82:0/2305443576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0340cf360 0x7fd0340b2cf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd02c009d90 tx=0x7fd02c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b504af05b8ed709b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:59.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.896+0000 7fd032ffd640 1 -- 172.21.15.82:0/2305443576 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c007740 con 0x7fd0340cf360 2024-06-02T22:53:59.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.896+0000 7fd032ffd640 1 -- 172.21.15.82:0/2305443576 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02c0078e0 con 0x7fd0340cf360 2024-06-02T22:53:59.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.896+0000 7fd032ffd640 1 -- 172.21.15.82:0/2305443576 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c007cb0 con 0x7fd0340cf360 2024-06-02T22:53:59.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.897+0000 7fd03a8b2640 1 -- 172.21.15.82:0/2305443576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0340cf360 msgr2=0x7fd0340b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.897+0000 7fd03a8b2640 1 --2- 172.21.15.82:0/2305443576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0340cf360 0x7fd0340b2cf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd02c009d90 tx=0x7fd02c02a6a0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.897+0000 7fd03a8b2640 1 -- 172.21.15.82:0/2305443576 shutdown_connections 2024-06-02T22:53:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.897+0000 7fd03a8b2640 1 --2- 172.21.15.82:0/2305443576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0340cf360 0x7fd0340b2cf0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.897+0000 7fd03a8b2640 1 -- 172.21.15.82:0/2305443576 >> 172.21.15.82:0/2305443576 conn(0x7fd0340b19f0 msgr2=0x7fd0340b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.897+0000 7fd03a8b2640 1 -- 172.21.15.82:0/2305443576 shutdown_connections 2024-06-02T22:53:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.897+0000 7fd03a8b2640 1 -- 172.21.15.82:0/2305443576 wait complete. 2024-06-02T22:53:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.898+0000 7fd03a8b2640 1 Processor -- start 2024-06-02T22:53:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.898+0000 7fd03a8b2640 1 -- start start 2024-06-02T22:53:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd03a8b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0340cd230 0x7fd03415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd03a8b2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0340cf360 0x7fd03409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd03a8b2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0341553c0 0x7fd0341510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd03a8b2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd034155920 con 0x7fd0340cd230 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd03a8b2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd0341557a0 con 0x7fd0341553c0 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd03a8b2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd034071030 con 0x7fd0340cf360 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd033fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0340cd230 0x7fd03415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd033fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0340cd230 0x7fd03415cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59204/0 (socket says 172.21.15.82:59204) 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd033fff640 1 -- 172.21.15.82:0/3295826766 learned_addr learned my addr 172.21.15.82:0/3295826766 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd038e4f640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0341553c0 0x7fd0341510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd0337fe640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0340cf360 0x7fd03409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd033fff640 1 -- 172.21.15.82:0/3295826766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0340cf360 msgr2=0x7fd03409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd033fff640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0340cf360 0x7fd03409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd033fff640 1 -- 172.21.15.82:0/3295826766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0341553c0 msgr2=0x7fd0341510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd033fff640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0341553c0 0x7fd0341510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd033fff640 1 -- 172.21.15.82:0/3295826766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd034151630 con 0x7fd0340cd230 2024-06-02T22:53:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd038e4f640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0341553c0 0x7fd0341510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:53:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd033fff640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0340cd230 0x7fd03415cb80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd02400c430 tx=0x7fd02400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.899+0000 7fd030ff9640 1 -- 172.21.15.82:0/3295826766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0240074e0 con 0x7fd0340cd230 2024-06-02T22:53:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.900+0000 7fd030ff9640 1 -- 172.21.15.82:0/3295826766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0240047e0 con 0x7fd0340cd230 2024-06-02T22:53:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.900+0000 7fd03a8b2640 1 -- 172.21.15.82:0/3295826766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03415d240 con 0x7fd0340cd230 2024-06-02T22:53:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.900+0000 7fd030ff9640 1 -- 172.21.15.82:0/3295826766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024004bd0 con 0x7fd0340cd230 2024-06-02T22:53:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.900+0000 7fd03a8b2640 1 -- 172.21.15.82:0/3295826766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03415d800 con 0x7fd0340cd230 2024-06-02T22:53:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.901+0000 7fd03a8b2640 1 -- 172.21.15.82:0/3295826766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03406c700 con 0x7fd0340cd230 2024-06-02T22:53:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.901+0000 7fd030ff9640 1 -- 172.21.15.82:0/3295826766 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd024011070 con 0x7fd0340cd230 2024-06-02T22:53:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.901+0000 7fd030ff9640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd02006be30 0x7fd02006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.902+0000 7fd030ff9640 1 -- 172.21.15.82:0/3295826766 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd02408ac10 con 0x7fd0340cd230 2024-06-02T22:53:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.902+0000 7fd0337fe640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd02006be30 0x7fd02006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.902+0000 7fd0337fe640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd02006be30 0x7fd02006e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd034168550 tx=0x7fd028009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:59.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:53:59.906+0000 7fd030ff9640 1 -- 172.21.15.82:0/3295826766 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd03406c700 con 0x7fd0340cd230 2024-06-02T22:54:00.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.091+0000 7fd03a8b2640 1 -- 172.21.15.82:0/3295826766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd034068430 con 0x7fd0340cd230 2024-06-02T22:54:00.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.091+0000 7fd030ff9640 1 -- 172.21.15.82:0/3295826766 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7fd024059430 con 0x7fd0340cd230 2024-06-02T22:54:00.091 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:54:00.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.093+0000 7fd03a8b2640 1 -- 172.21.15.82:0/3295826766 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd02006be30 msgr2=0x7fd02006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:00.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.093+0000 7fd03a8b2640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd02006be30 0x7fd02006e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd034168550 tx=0x7fd028009040 comp rx=0 tx=0).stop 2024-06-02T22:54:00.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.093+0000 7fd03a8b2640 1 -- 172.21.15.82:0/3295826766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0340cd230 msgr2=0x7fd03415cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:00.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.093+0000 7fd03a8b2640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0340cd230 0x7fd03415cb80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd02400c430 tx=0x7fd02400c8f0 comp rx=0 tx=0).stop 2024-06-02T22:54:00.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.094+0000 7fd03a8b2640 1 -- 172.21.15.82:0/3295826766 shutdown_connections 2024-06-02T22:54:00.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.094+0000 7fd03a8b2640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd02006be30 0x7fd02006e2f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:00.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.094+0000 7fd03a8b2640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0341553c0 0x7fd0341510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:00.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.094+0000 7fd03a8b2640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0340cf360 0x7fd03409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:00.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.094+0000 7fd03a8b2640 1 --2- 172.21.15.82:0/3295826766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0340cd230 0x7fd03415cb80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:00.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.094+0000 7fd03a8b2640 1 -- 172.21.15.82:0/3295826766 >> 172.21.15.82:0/3295826766 conn(0x7fd0340b19f0 msgr2=0x7fd0340ad210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:00.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.094+0000 7fd03a8b2640 1 -- 172.21.15.82:0/3295826766 shutdown_connections 2024-06-02T22:54:00.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:00.094+0000 7fd03a8b2640 1 -- 172.21.15.82:0/3295826766 wait complete. 2024-06-02T22:54:00.104 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-06-02T22:54:00.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:00.105 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-02T22:54:00.128 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[55563]: fuse finished with error 0 and tester_r 0 2024-06-02T22:54:00.130 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:04.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:54:04.030 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:54:06.231 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:54:06.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:06.231 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T22:54:06.251 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T22:54:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.399+0000 7f144b072640 1 Processor -- start 2024-06-02T22:54:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.399+0000 7f144b072640 1 -- start start 2024-06-02T22:54:06.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f144b072640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cd230 0x7f14440b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f144b072640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f14440cec50 0x7f14440cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f144b072640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14440b3420 con 0x7f14441553c0 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f144b072640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f14440cc750 con 0x7f14440cec50 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f144b072640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f14440cca30 con 0x7f14440cd230 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f1448e0e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f14441553c0 0x7f144415beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41082/0 (socket says 172.21.15.82:41082) 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f1448e0e640 1 -- 172.21.15.82:0/1838915182 learned_addr learned my addr 172.21.15.82:0/1838915182 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3285071061 0 0) 0x7f14440b3420 con 0x7f14441553c0 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f144960f640 1 --2- 172.21.15.82:0/1838915182 >> v2:172.21.15.184:3300/0 conn(0x7f14440cec50 0x7f14440cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f1443fff640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cd230 0x7f14440b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1434005730 con 0x7f14441553c0 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2932315243 0 0) 0x7f1434005730 con 0x7f14441553c0 2024-06-02T22:54:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cd230 msgr2=0x7f14440b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f14437fe640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cd230 0x7f14440b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 >> v2:172.21.15.184:3300/0 conn(0x7f14440cec50 msgr2=0x7f14440cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f14437fe640 1 --2- 172.21.15.82:0/1838915182 >> v2:172.21.15.184:3300/0 conn(0x7f14440cec50 0x7f14440cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14440ccd10 con 0x7f14441553c0 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f1438001670 con 0x7f14441553c0 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.400+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 >> v1:172.21.15.82:6789/0 conn(0x7f14441553c0 legacy=0x7f144415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f14437fe640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1434005bc0 0x7f1434005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f14437fe640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cd230 0x7f1434006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f14437fe640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1434006f50 0x7f14340073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f14440cc750 con 0x7f1434005bc0 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f14440cca30 con 0x7f1434006f50 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f143400dbd0 con 0x7f14440cd230 2024-06-02T22:54:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f1448e0e640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1434005bc0 0x7f1434005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f1443fff640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cd230 0x7f1434006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f144960f640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1434006f50 0x7f14340073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f1448e0e640 1 -- 172.21.15.82:0/1838915182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cd230 msgr2=0x7f1434006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f1448e0e640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cd230 0x7f1434006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f1448e0e640 1 -- 172.21.15.82:0/1838915182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1434006f50 msgr2=0x7f14340073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f1448e0e640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1434006f50 0x7f14340073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.401+0000 7f1448e0e640 1 -- 172.21.15.82:0/1838915182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1434005730 con 0x7f1434005bc0 2024-06-02T22:54:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.402+0000 7f1448e0e640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1434005bc0 0x7f1434005fe0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f143800c240 tx=0x7f1434007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a612daff27868240 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.402+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143802e070 con 0x7f1434005bc0 2024-06-02T22:54:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.402+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1438005af0 con 0x7f1434005bc0 2024-06-02T22:54:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.402+0000 7f14437fe640 1 -- 172.21.15.82:0/1838915182 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438007d30 con 0x7f1434005bc0 2024-06-02T22:54:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.402+0000 7f144b072640 1 -- 172.21.15.82:0/1838915182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1434005bc0 msgr2=0x7f1434005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.402+0000 7f144b072640 1 --2- 172.21.15.82:0/1838915182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1434005bc0 0x7f1434005fe0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f143800c240 tx=0x7f1434007a40 comp rx=0 tx=0).stop 2024-06-02T22:54:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.402+0000 7f144960f640 1 -- 172.21.15.82:0/1838915182 reap_dead start 2024-06-02T22:54:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.402+0000 7f144b072640 1 -- 172.21.15.82:0/1838915182 shutdown_connections 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.402+0000 7f144b072640 1 -- 172.21.15.82:0/1838915182 >> 172.21.15.82:0/1838915182 conn(0x7f14440b19f0 msgr2=0x7f14440b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.402+0000 7f144b072640 1 -- 172.21.15.82:0/1838915182 shutdown_connections 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.402+0000 7f144b072640 1 -- 172.21.15.82:0/1838915182 wait complete. 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.404+0000 7f144b072640 1 Processor -- start 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.404+0000 7f144b072640 1 -- start start 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f144b072640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1434005bc0 0x7f144409aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f144b072640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1444145460 0x7f144415d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f144b072640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1444072080 0x7f1444072500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f144b072640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1444155920 con 0x7f1444145460 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f144b072640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f14441557a0 con 0x7f1434005bc0 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f144b072640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f14440b2cf0 con 0x7f1444072080 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f1443fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1444145460 0x7f144415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f1443fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1444145460 0x7f144415d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50814/0 (socket says 172.21.15.82:50814) 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f1443fff640 1 -- 172.21.15.82:0/60977681 learned_addr learned my addr 172.21.15.82:0/60977681 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f1448e0e640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1434005bc0 0x7f144409aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f144960f640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1444072080 0x7f1444072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f1443fff640 1 -- 172.21.15.82:0/60977681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1444072080 msgr2=0x7f1444072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f1443fff640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1444072080 0x7f1444072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f1443fff640 1 -- 172.21.15.82:0/60977681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1434005bc0 msgr2=0x7f144409aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f1443fff640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1434005bc0 0x7f144409aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f1443fff640 1 -- 172.21.15.82:0/60977681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14441f7080 con 0x7f1444145460 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f1443fff640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1444145460 0x7f144415d520 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f14300118e0 tx=0x7f1430011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f14417fa640 1 -- 172.21.15.82:0/60977681 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143000faf0 con 0x7f1444145460 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f14417fa640 1 -- 172.21.15.82:0/60977681 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f143000fc90 con 0x7f1444145460 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f144b072640 1 -- 172.21.15.82:0/60977681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14441f7360 con 0x7f1444145460 2024-06-02T22:54:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f14417fa640 1 -- 172.21.15.82:0/60977681 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430014440 con 0x7f1444145460 2024-06-02T22:54:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.405+0000 7f144b072640 1 -- 172.21.15.82:0/60977681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14441f7920 con 0x7f1444145460 2024-06-02T22:54:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.406+0000 7f144b072640 1 -- 172.21.15.82:0/60977681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1444068430 con 0x7f1444145460 2024-06-02T22:54:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.407+0000 7f14417fa640 1 -- 172.21.15.82:0/60977681 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1430012040 con 0x7f1444145460 2024-06-02T22:54:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.407+0000 7f14417fa640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f142806be30 0x7f142806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.408+0000 7f1448e0e640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f142806be30 0x7f142806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.408+0000 7f14417fa640 1 -- 172.21.15.82:0/60977681 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f143008b570 con 0x7f1444145460 2024-06-02T22:54:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.408+0000 7f1448e0e640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f142806be30 0x7f142806e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1438033000 tx=0x7f1438009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.412+0000 7f14417fa640 1 -- 172.21.15.82:0/60977681 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1430019030 con 0x7f1444145460 2024-06-02T22:54:06.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.622+0000 7f144b072640 1 -- 172.21.15.82:0/60977681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f14440b1520 con 0x7f1444145460 2024-06-02T22:54:06.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.623+0000 7f14417fa640 1 -- 172.21.15.82:0/60977681 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7f14300597d0 con 0x7f1444145460 2024-06-02T22:54:06.623 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.624+0000 7f144b072640 1 -- 172.21.15.82:0/60977681 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f142806be30 msgr2=0x7f142806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.624+0000 7f144b072640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f142806be30 0x7f142806e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1438033000 tx=0x7f1438009030 comp rx=0 tx=0).stop 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.624+0000 7f144b072640 1 -- 172.21.15.82:0/60977681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1444145460 msgr2=0x7f144415d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.624+0000 7f144b072640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1444145460 0x7f144415d520 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f14300118e0 tx=0x7f1430011da0 comp rx=0 tx=0).stop 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.625+0000 7f144b072640 1 -- 172.21.15.82:0/60977681 shutdown_connections 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.625+0000 7f144b072640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f142806be30 0x7f142806e2f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.625+0000 7f144b072640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1444072080 0x7f1444072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.625+0000 7f144b072640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1444145460 0x7f144415d520 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.625+0000 7f144b072640 1 --2- 172.21.15.82:0/60977681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1434005bc0 0x7f144409aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.625+0000 7f144b072640 1 -- 172.21.15.82:0/60977681 >> 172.21.15.82:0/60977681 conn(0x7f14440b19f0 msgr2=0x7f14440adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.625+0000 7f144b072640 1 -- 172.21.15.82:0/60977681 shutdown_connections 2024-06-02T22:54:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06.625+0000 7f144b072640 1 -- 172.21.15.82:0/60977681 wait complete. 2024-06-02T22:54:06.636 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T22:54:06.636 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:54:06.636 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-06-02T22:54:06.636 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T22:54:06.636 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T22:54:06.636 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T22:54:06.636 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:54:06.636 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:54:06.636 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:54:06.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:06.636 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-06-02T22:54:06.652 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:54:06.652 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:54:06.652 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:54:06.652 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:54:06.652 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-02T22:54:06.652 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:54:06.652 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:54:06.652 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:54:06.652 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42651sec preferred_lft 42651sec 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff 2024-06-02T22:54:06.653 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T22:54:06.654 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:54:06.654 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::6847:90ff:fe09:5afd/64 scope link 2024-06-02T22:54:06.654 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:54:06.654 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:54:06.654 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 7e:10:3a:74:07:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:54:06.654 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::7c10:3aff:fe74:7cf/64 scope link 2024-06-02T22:54:06.654 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:54:06.654 INFO:teuthology.orchestra.run.smithi082.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T22:54:06.654 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 12:3e:51:43:ac:f3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:54:06.654 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::103e:51ff:fe43:acf3/64 scope link 2024-06-02T22:54:06.654 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:54:06.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:06.655 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:54:06.716 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-06-02T22:54:06.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:06.718 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-06-02T22:54:06.774 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-06-02T22:54:06.775 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:54:06.775 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T22:54:06.775 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T22:54:06.775 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:54:06.775 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:54:06.775 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-02T22:54:06.775 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T22:54:06.775 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T22:54:06.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T22:54:06.776 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-02T22:54:06.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:54:06.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:54:06.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:06.901 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-02T22:54:06.916 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T22:54:06.916 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T22:54:06.917 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:54:06.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:06.917 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-06-02T22:54:06.981 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-02T22:54:06.981 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:54:06.981 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T22:54:07.037 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T22:54:07.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:54:07.038 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:54:07.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:54:07.157 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:54:07.213 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:54:07.213 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:54:07.213 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:54:07.214 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:54:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:54:07.216 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:54:07.216 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:54:07.216 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:54:07.216 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:54:07.216 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:54:07.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:07.217 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:54:07.272 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T22:54:07.272 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-02T22:54:07.314 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-06-02T22:54:07.338 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:54:07.394 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:54:07.395 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T22:54:07.396 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T22:54:07.397 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T22:54:07.397 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T22:54:07.397 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-06-02T22:54:07.397 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:54:07.397 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:54:07.397 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:54:07.397 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:54:07.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:07.397 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-06-02T22:54:07.398 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2024-06-02T22:54:07.395+0000 7fe599c62480 -1 init, newargv = 0x5629b5d63340 newargc=15 2024-06-02T22:54:07.398 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[56209]: starting ceph client 2024-06-02T22:54:07.399 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[56209]: starting fuse 2024-06-02T22:54:07.413 INFO:teuthology.orchestra.run.smithi082.stdout:40 2024-06-02T22:54:07.413 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T22:54:07.413 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:54:07.413 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-06-02T22:54:07.414 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:54:07.415 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-06-02T22:54:07.415 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:54:07.415 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:54:07.415 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:54:07.415 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-06-02T22:54:07.415 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-06-02T22:54:07.415 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-06-02T22:54:07.415 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:54:07.415 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:54:07.415 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2024-06-02T22:54:07.415 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-06-02T22:54:07.531 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.56209.asok 2024-06-02T22:54:07.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:54:07.542 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.56209.asok 2024-06-02T22:54:07.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:07.542 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.56209.asok status 2024-06-02T22:54:07.677 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:54:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-06-02T22:54:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:54:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:54:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2024-06-02T22:54:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-06-02T22:54:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-02T22:54:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "56209", 2024-06-02T22:54:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-06-02T22:54:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5652, 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 5652 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 4287890318 2024-06-02T22:54:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 4287890318 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.5652 192.168.0.1:0/4287890318", 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/4287890318", 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 23, 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 54, 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-06-02T22:54:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-06-02T22:54:07.680 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:54:07.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:07.686 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-06-02T22:54:07.686 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-02T22:54:07.702 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-06-02T22:54:07.702 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-02T22:54:07.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:07.702 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T22:54:07.767 DEBUG:teuthology.orchestra.run.smithi082:> stdin-killer -- python3 -c ' 2024-06-02T22:54:07.767 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-06-02T22:54:07.767 DEBUG:teuthology.orchestra.run.smithi082:> import errno 2024-06-02T22:54:07.767 DEBUG:teuthology.orchestra.run.smithi082:> 2024-06-02T22:54:07.767 DEBUG:teuthology.orchestra.run.smithi082:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-06-02T22:54:07.767 DEBUG:teuthology.orchestra.run.smithi082:> try: 2024-06-02T22:54:07.767 DEBUG:teuthology.orchestra.run.smithi082:> if True: 2024-06-02T22:54:07.767 DEBUG:teuthology.orchestra.run.smithi082:> ret = os.read(fd, 1024) 2024-06-02T22:54:07.767 DEBUG:teuthology.orchestra.run.smithi082:> else: 2024-06-02T22:54:07.767 DEBUG:teuthology.orchestra.run.smithi082:> os.write(fd, b'"'"'content'"'"') 2024-06-02T22:54:07.768 DEBUG:teuthology.orchestra.run.smithi082:> except OSError as e: 2024-06-02T22:54:07.768 DEBUG:teuthology.orchestra.run.smithi082:> if e.errno != errno.EPERM: 2024-06-02T22:54:07.768 DEBUG:teuthology.orchestra.run.smithi082:> raise 2024-06-02T22:54:07.768 DEBUG:teuthology.orchestra.run.smithi082:> else: 2024-06-02T22:54:07.768 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("client does not check permission of data pool") 2024-06-02T22:54:07.768 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-06-02T22:54:07.875 INFO:teuthology.orchestra.run.smithi082.stderr:Traceback (most recent call last): 2024-06-02T22:54:07.875 INFO:teuthology.orchestra.run.smithi082.stderr: File "", line 15, in 2024-06-02T22:54:07.875 INFO:teuthology.orchestra.run.smithi082.stderr:RuntimeError: client does not check permission of data pool 2024-06-02T22:54:07.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:07 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2024-06-02T22:54:07.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:54:07.883 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-06-02T22:54:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.030+0000 7f86ad110640 1 Processor -- start 2024-06-02T22:54:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.030+0000 7f86ad110640 1 -- start start 2024-06-02T22:54:08.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.031+0000 7f86ad110640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a8154d60 0x7f86a806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.031+0000 7f86ad110640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f86a80b3710 0x7f86a815bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.031+0000 7f86ad110640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86a806d950 con 0x7f86a806d320 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.031+0000 7f86ad110640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f86a806dc30 con 0x7f86a80b3710 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.031+0000 7f86ad110640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f86a806df10 con 0x7f86a8154d60 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.031+0000 7f86a6d9d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a8154d60 0x7f86a806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.031+0000 7f86a759e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f86a80b3710 0x7f86a815bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.031+0000 7f86a759e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f86a80b3710 0x7f86a815bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:48608/0 (socket says 172.21.15.82:48608) 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.031+0000 7f86a759e640 1 -- 172.21.15.82:0/2261376662 learned_addr learned my addr 172.21.15.82:0/2261376662 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.031+0000 7f86a6d9d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a8154d60 0x7f86a806cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:58442/0 (socket says 172.21.15.82:58442) 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.031+0000 7f869e59c640 1 --1- 172.21.15.82:0/2261376662 >> v1:172.21.15.184:6789/0 conn(0x7f86a806d320 0x7f86a80b3000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:33670/0 (socket says 172.21.15.82:33670) 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.032+0000 7f86a759e640 1 -- 172.21.15.82:0/2261376662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a8154d60 msgr2=0x7f86a806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.032+0000 7f86a759e640 1 --2- 172.21.15.82:0/2261376662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a8154d60 0x7f86a806cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.032+0000 7f86a759e640 1 -- 172.21.15.82:0/2261376662 >> v1:172.21.15.184:6789/0 conn(0x7f86a806d320 legacy=0x7f86a80b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.032+0000 7f86a659c640 1 -- 172.21.15.82:0/2261376662 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166776903 0 0) 0x7f86a806d950 con 0x7f86a806d320 2024-06-02T22:54:08.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.032+0000 7f86a759e640 1 -- 172.21.15.82:0/2261376662 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a806e1f0 con 0x7f86a80b3710 2024-06-02T22:54:08.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.032+0000 7f86a6d9d640 1 --2- 172.21.15.82:0/2261376662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a8154d60 0x7f86a806cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:54:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86a759e640 1 --2- 172.21.15.82:0/2261376662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a80b3710 0x7f86a815bd70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009e50 tx=0x7f86a002a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9df28c20c5d3d219 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86a659c640 1 -- 172.21.15.82:0/2261376662 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0036070 con 0x7f86a80b3710 2024-06-02T22:54:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86a659c640 1 -- 172.21.15.82:0/2261376662 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a0031600 con 0x7f86a80b3710 2024-06-02T22:54:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86a659c640 1 -- 172.21.15.82:0/2261376662 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a00319d0 con 0x7f86a80b3710 2024-06-02T22:54:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86ad110640 1 -- 172.21.15.82:0/2261376662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a80b3710 msgr2=0x7f86a815bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86ad110640 1 --2- 172.21.15.82:0/2261376662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a80b3710 0x7f86a815bd70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009e50 tx=0x7f86a002a7a0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86ad110640 1 -- 172.21.15.82:0/2261376662 shutdown_connections 2024-06-02T22:54:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86ad110640 1 --2- 172.21.15.82:0/2261376662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a80b3710 0x7f86a815bd70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86ad110640 1 --2- 172.21.15.82:0/2261376662 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a8154d60 0x7f86a806cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86ad110640 1 -- 172.21.15.82:0/2261376662 >> 172.21.15.82:0/2261376662 conn(0x7f86a806b7e0 msgr2=0x7f86a806bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:08.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86ad110640 1 -- 172.21.15.82:0/2261376662 shutdown_connections 2024-06-02T22:54:08.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.033+0000 7f86ad110640 1 -- 172.21.15.82:0/2261376662 wait complete. 2024-06-02T22:54:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.035+0000 7f86ad110640 1 Processor -- start 2024-06-02T22:54:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.035+0000 7f86ad110640 1 -- start start 2024-06-02T22:54:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86ad110640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a806d320 0x7f86a80cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86ad110640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a80b3710 0x7f86a8157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86ad110640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a8154d60 0x7f86a8157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86ad110640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86a80d0150 con 0x7f86a8154d60 2024-06-02T22:54:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86ad110640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f86a80cffd0 con 0x7f86a806d320 2024-06-02T22:54:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86ad110640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f86a80d02d0 con 0x7f86a80b3710 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86a759e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a8154d60 0x7f86a8157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86a759e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a8154d60 0x7f86a8157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50830/0 (socket says 172.21.15.82:50830) 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86a759e640 1 -- 172.21.15.82:0/1682828556 learned_addr learned my addr 172.21.15.82:0/1682828556 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86a6d9d640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a806d320 0x7f86a80cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f869e59c640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a80b3710 0x7f86a8157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86a759e640 1 -- 172.21.15.82:0/1682828556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a80b3710 msgr2=0x7f86a8157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86a759e640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a80b3710 0x7f86a8157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86a759e640 1 -- 172.21.15.82:0/1682828556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a806d320 msgr2=0x7f86a80cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86a759e640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a806d320 0x7f86a80cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86a759e640 1 -- 172.21.15.82:0/1682828556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a80cbc50 con 0x7f86a8154d60 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86a759e640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a8154d60 0x7f86a8157d60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009e50 tx=0x7f86a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f869ffff640 1 -- 172.21.15.82:0/1682828556 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0041070 con 0x7f86a8154d60 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f869ffff640 1 -- 172.21.15.82:0/1682828556 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a0003990 con 0x7f86a8154d60 2024-06-02T22:54:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f869ffff640 1 -- 172.21.15.82:0/1682828556 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0036040 con 0x7f86a8154d60 2024-06-02T22:54:08.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86ad110640 1 -- 172.21.15.82:0/1682828556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a809b660 con 0x7f86a8154d60 2024-06-02T22:54:08.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.036+0000 7f86ad110640 1 -- 172.21.15.82:0/1682828556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a809bc20 con 0x7f86a8154d60 2024-06-02T22:54:08.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.037+0000 7f86ad110640 1 -- 172.21.15.82:0/1682828556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a80683c0 con 0x7f86a8154d60 2024-06-02T22:54:08.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.038+0000 7f869ffff640 1 -- 172.21.15.82:0/1682828556 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86a0007820 con 0x7f86a8154d60 2024-06-02T22:54:08.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.038+0000 7f869ffff640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f868806be30 0x7f868806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.038+0000 7f869ffff640 1 -- 172.21.15.82:0/1682828556 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f86a00ab880 con 0x7f86a8154d60 2024-06-02T22:54:08.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.038+0000 7f86a6d9d640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f868806be30 0x7f868806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:08.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.039+0000 7f86a6d9d640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f868806be30 0x7f868806e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f86a81f26a0 tx=0x7f869800a2a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:08.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.043+0000 7f869ffff640 1 -- 172.21.15.82:0/1682828556 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f86a004b020 con 0x7f86a8154d60 2024-06-02T22:54:08.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.286+0000 7f86ad110640 1 -- 172.21.15.82:0/1682828556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) -- 0x7f86a8159ee0 con 0x7f86a8154d60 2024-06-02T22:54:08.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.288+0000 7f869ffff640 1 -- 172.21.15.82:0/1682828556 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) ==== 184+0+141 (secure 0 0 0) 0x7f86a80cbc50 con 0x7f86a8154d60 2024-06-02T22:54:08.288 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-06-02T22:54:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBa91xm23juIBAA4OeCLsfK5pvQhDToT7Wk7g== 2024-06-02T22:54:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2024-06-02T22:54:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2024-06-02T22:54:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw pool=cephfs_data" 2024-06-02T22:54:08.289 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2024-06-02T22:54:08.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.290+0000 7f86ad110640 1 -- 172.21.15.82:0/1682828556 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f868806be30 msgr2=0x7f868806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.290+0000 7f86ad110640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f868806be30 0x7f868806e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f86a81f26a0 tx=0x7f869800a2a0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.290+0000 7f86ad110640 1 -- 172.21.15.82:0/1682828556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a8154d60 msgr2=0x7f86a8157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.290+0000 7f86ad110640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a8154d60 0x7f86a8157d60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009e50 tx=0x7f86a0004a40 comp rx=0 tx=0).stop 2024-06-02T22:54:08.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.290+0000 7f86ad110640 1 -- 172.21.15.82:0/1682828556 shutdown_connections 2024-06-02T22:54:08.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.290+0000 7f86ad110640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f868806be30 0x7f868806e2f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.290+0000 7f86ad110640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a8154d60 0x7f86a8157d60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.290+0000 7f86ad110640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86a80b3710 0x7f86a8157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.290+0000 7f86ad110640 1 --2- 172.21.15.82:0/1682828556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a806d320 0x7f86a80cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.290+0000 7f86ad110640 1 -- 172.21.15.82:0/1682828556 >> 172.21.15.82:0/1682828556 conn(0x7f86a806b7e0 msgr2=0x7f86a815a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:08.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.291+0000 7f86ad110640 1 -- 172.21.15.82:0/1682828556 shutdown_connections 2024-06-02T22:54:08.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.291+0000 7f86ad110640 1 -- 172.21.15.82:0/1682828556 wait complete. 2024-06-02T22:54:08.301 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-02T22:54:08.301 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T22:54:08.362 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T22:54:08.413 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-02T22:54:08.413 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T22:54:08.413 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:54:08.414 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:54:08.429 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T22:54:08.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.570+0000 7f6cde5ee640 1 Processor -- start 2024-06-02T22:54:08.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.570+0000 7f6cde5ee640 1 -- start start 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.571+0000 7f6cde5ee640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6cd80cc6d0 0x7f6cd80ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.571+0000 7f6cde5ee640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6cd8072110 0x7f6cd80b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.571+0000 7f6cde5ee640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cd80ccff0 con 0x7f6cd8071c60 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.571+0000 7f6cde5ee640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd8072820 con 0x7f6cd80cc6d0 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.571+0000 7f6cde5ee640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd8072b00 con 0x7f6cd8072110 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.571+0000 7f6cd7fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6cd80cc6d0 0x7f6cd80ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.571+0000 7f6cd7fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6cd80cc6d0 0x7f6cd80ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50846/0 (socket says 172.21.15.82:50846) 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.571+0000 7f6cd7fff640 1 -- 172.21.15.82:0/2040881030 learned_addr learned my addr 172.21.15.82:0/2040881030 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.572+0000 7f6cd7fff640 1 -- 172.21.15.82:0/2040881030 >> v2:172.21.15.184:3300/0 conn(0x7f6cd8072110 msgr2=0x7f6cd80b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.572+0000 7f6cd7fff640 1 --2- 172.21.15.82:0/2040881030 >> v2:172.21.15.184:3300/0 conn(0x7f6cd8072110 0x7f6cd80b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.572+0000 7f6cd7fff640 1 -- 172.21.15.82:0/2040881030 >> v1:172.21.15.184:6789/0 conn(0x7f6cd8071c60 legacy=0x7f6cd80b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.572+0000 7f6cd7fff640 1 -- 172.21.15.82:0/2040881030 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd8072de0 con 0x7f6cd80cc6d0 2024-06-02T22:54:08.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.572+0000 7f6cd7fff640 1 --2- 172.21.15.82:0/2040881030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd80cc6d0 0x7f6cd80ccab0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80af8f0 tx=0x7f6cc802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de237126594d057 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.572+0000 7f6cd6ffd640 1 -- 172.21.15.82:0/2040881030 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8037070 con 0x7f6cd80cc6d0 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.573+0000 7f6cd6ffd640 1 -- 172.21.15.82:0/2040881030 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc8032440 con 0x7f6cd80cc6d0 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.573+0000 7f6cd6ffd640 1 -- 172.21.15.82:0/2040881030 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8032810 con 0x7f6cd80cc6d0 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.573+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2040881030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd80cc6d0 msgr2=0x7f6cd80ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.573+0000 7f6cde5ee640 1 --2- 172.21.15.82:0/2040881030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd80cc6d0 0x7f6cd80ccab0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80af8f0 tx=0x7f6cc802a230 comp rx=0 tx=0).stop 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.573+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2040881030 shutdown_connections 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.573+0000 7f6cde5ee640 1 --2- 172.21.15.82:0/2040881030 >> v2:172.21.15.184:3300/0 conn(0x7f6cd8072110 0x7f6cd80b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.573+0000 7f6cde5ee640 1 --2- 172.21.15.82:0/2040881030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd80cc6d0 0x7f6cd80ccab0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.573+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2040881030 >> 172.21.15.82:0/2040881030 conn(0x7f6cd80b19f0 msgr2=0x7f6cd80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.573+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2040881030 shutdown_connections 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.573+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2040881030 wait complete. 2024-06-02T22:54:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.574+0000 7f6cde5ee640 1 Processor -- start 2024-06-02T22:54:08.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.574+0000 7f6cde5ee640 1 -- start start 2024-06-02T22:54:08.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cde5ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd8071c60 0x7f6cd814f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cde5ee640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd8072110 0x7f6cd81f8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cde5ee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cd80cc6d0 0x7f6cd8154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cde5ee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd815c890 con 0x7f6cd8071c60 2024-06-02T22:54:08.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cde5ee640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8072540 con 0x7f6cd8072110 2024-06-02T22:54:08.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cde5ee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd8159f60 con 0x7f6cd80cc6d0 2024-06-02T22:54:08.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cd7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd8071c60 0x7f6cd814f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cd7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd8071c60 0x7f6cd814f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50856/0 (socket says 172.21.15.82:50856) 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cd7fff640 1 -- 172.21.15.82:0/2240682366 learned_addr learned my addr 172.21.15.82:0/2240682366 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cd7fff640 1 -- 172.21.15.82:0/2240682366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cd80cc6d0 msgr2=0x7f6cd8154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cd7fff640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cd80cc6d0 0x7f6cd8154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cd7fff640 1 -- 172.21.15.82:0/2240682366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd8072110 msgr2=0x7f6cd81f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cd7fff640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd8072110 0x7f6cd81f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.575+0000 7f6cd7fff640 1 -- 172.21.15.82:0/2240682366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd81f89d0 con 0x7f6cd8071c60 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.576+0000 7f6cd7fff640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd8071c60 0x7f6cd814f0d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8000c00 tx=0x7f6cc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.576+0000 7f6cd4ff9640 1 -- 172.21.15.82:0/2240682366 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8041070 con 0x7f6cd8071c60 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.576+0000 7f6cd4ff9640 1 -- 172.21.15.82:0/2240682366 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc803c870 con 0x7f6cd8071c60 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.576+0000 7f6cd4ff9640 1 -- 172.21.15.82:0/2240682366 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8037040 con 0x7f6cd8071c60 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.576+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2240682366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd8152280 con 0x7f6cd8071c60 2024-06-02T22:54:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.576+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2240682366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd8152840 con 0x7f6cd8071c60 2024-06-02T22:54:08.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.577+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2240682366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd8068430 con 0x7f6cd8071c60 2024-06-02T22:54:08.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.577+0000 7f6cd4ff9640 1 -- 172.21.15.82:0/2240682366 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cc8044070 con 0x7f6cd8071c60 2024-06-02T22:54:08.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.578+0000 7f6cd4ff9640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6cc406be30 0x7f6cc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:08.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.578+0000 7f6cd4ff9640 1 -- 172.21.15.82:0/2240682366 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f6cc80abc40 con 0x7f6cd8071c60 2024-06-02T22:54:08.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.578+0000 7f6cd77fe640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6cc406be30 0x7f6cc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:08.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.578+0000 7f6cd77fe640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6cc406be30 0x7f6cc406e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8155910 tx=0x7f6ccc006ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:08.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.582+0000 7f6cd4ff9640 1 -- 172.21.15.82:0/2240682366 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6cd81f89d0 con 0x7f6cd8071c60 2024-06-02T22:54:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.773+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2240682366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6cd815efc0 con 0x7f6cd8071c60 2024-06-02T22:54:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.773+0000 7f6cd4ff9640 1 -- 172.21.15.82:0/2240682366 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7f6cc807a610 con 0x7f6cd8071c60 2024-06-02T22:54:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-06-02T22:54:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2240682366 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6cc406be30 msgr2=0x7f6cc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6cc406be30 0x7f6cc406e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8155910 tx=0x7f6ccc006ba0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2240682366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd8071c60 msgr2=0x7f6cd814f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd8071c60 0x7f6cd814f0d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8000c00 tx=0x7f6cc80046c0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2240682366 shutdown_connections 2024-06-02T22:54:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6cc406be30 0x7f6cc406e2f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6cd80cc6d0 0x7f6cd8154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd8072110 0x7f6cd81f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 --2- 172.21.15.82:0/2240682366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd8071c60 0x7f6cd814f0d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2240682366 >> 172.21.15.82:0/2240682366 conn(0x7f6cd80b19f0 msgr2=0x7f6cd815ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2240682366 shutdown_connections 2024-06-02T22:54:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:08.775+0000 7f6cde5ee640 1 -- 172.21.15.82:0/2240682366 wait complete. 2024-06-02T22:54:08.786 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-06-02T22:54:08.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:08.786 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-02T22:54:08.809 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[56209]: fuse finished with error 0 and tester_r 0 2024-06-02T22:54:08.811 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:54:08.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:08.811 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T22:54:08.976 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T22:54:08.976 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:54:08.976 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:54:08.996 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14652 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T22:54:08.996 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:54:08.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:08.996 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-02T22:54:09.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:54:09.053 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-06-02T22:54:09.054 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T22:54:09.054 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:54:09.054 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:54:09.070 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17664 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T22:54:09.070 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:54:09.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:09.070 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-02T22:54:09.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:54:09.125 INFO:teuthology.orchestra.run.smithi082.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-06-02T22:54:09.125 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T22:54:09.125 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:54:09.125 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:54:09.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14652 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T22:54:09.144 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:54:09.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:09.144 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-02T22:54:09.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:54:09.202 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-06-02T22:54:09.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:54:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.302+0000 7f0352e95640 1 Processor -- start 2024-06-02T22:54:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.302+0000 7f0352e95640 1 -- start start 2024-06-02T22:54:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f0352e95640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f034c0b46d0 0x7f034c071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f0352e95640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c072820 con 0x7f034c0cc6d0 2024-06-02T22:54:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f0352e95640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c072b00 con 0x7f034c0721a0 2024-06-02T22:54:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f0352e95640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f034c0725d0 con 0x7f034c0b46d0 2024-06-02T22:54:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f0343fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f034c0b46d0 0x7f034c071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f0350c31640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f034c0cc6d0 0x7f034c0ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41084/0 (socket says 172.21.15.82:41084) 2024-06-02T22:54:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f0350c31640 1 -- 172.21.15.82:0/1396075876 learned_addr learned my addr 172.21.15.82:0/1396075876 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f0343fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f034c0b46d0 0x7f034c071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50864/0 (socket says 172.21.15.82:50864) 2024-06-02T22:54:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f0343fff640 1 -- 172.21.15.82:0/1396075876 >> v1:172.21.15.184:6789/0 conn(0x7f034c0721a0 legacy=0x7f034c165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f0343fff640 1 -- 172.21.15.82:0/1396075876 >> v1:172.21.15.82:6789/0 conn(0x7f034c0cc6d0 legacy=0x7f034c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f0343fff640 1 -- 172.21.15.82:0/1396075876 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c072de0 con 0x7f034c0b46d0 2024-06-02T22:54:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.303+0000 7f03437fe640 1 -- 172.21.15.82:0/1396075876 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1804640146 0 0) 0x7f034c072820 con 0x7f034c0cc6d0 2024-06-02T22:54:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.304+0000 7f0343fff640 1 --2- 172.21.15.82:0/1396075876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f034c0b46d0 0x7f034c071c60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f033c0097a0 tx=0x7f033c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba18ae3a6c6367f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.304+0000 7f03437fe640 1 -- 172.21.15.82:0/1396075876 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c037070 con 0x7f034c0b46d0 2024-06-02T22:54:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.304+0000 7f03437fe640 1 -- 172.21.15.82:0/1396075876 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c032440 con 0x7f034c0b46d0 2024-06-02T22:54:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.304+0000 7f03437fe640 1 -- 172.21.15.82:0/1396075876 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c032810 con 0x7f034c0b46d0 2024-06-02T22:54:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.305+0000 7f0352e95640 1 -- 172.21.15.82:0/1396075876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f034c0b46d0 msgr2=0x7f034c071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.305+0000 7f0352e95640 1 --2- 172.21.15.82:0/1396075876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f034c0b46d0 0x7f034c071c60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f033c0097a0 tx=0x7f033c02a1e0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.305+0000 7f0352e95640 1 -- 172.21.15.82:0/1396075876 shutdown_connections 2024-06-02T22:54:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.305+0000 7f0352e95640 1 --2- 172.21.15.82:0/1396075876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f034c0b46d0 0x7f034c071c60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.305+0000 7f0352e95640 1 -- 172.21.15.82:0/1396075876 >> 172.21.15.82:0/1396075876 conn(0x7f034c0b19f0 msgr2=0x7f034c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.305+0000 7f0352e95640 1 -- 172.21.15.82:0/1396075876 shutdown_connections 2024-06-02T22:54:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.305+0000 7f0352e95640 1 -- 172.21.15.82:0/1396075876 wait complete. 2024-06-02T22:54:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.306+0000 7f0352e95640 1 Processor -- start 2024-06-02T22:54:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.306+0000 7f0352e95640 1 -- start start 2024-06-02T22:54:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0352e95640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f034c0721a0 0x7f034c1541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0352e95640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f034c0b46d0 0x7f034c153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0352e95640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f034c0cc6d0 0x7f034c0ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0352e95640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f034c159f60 con 0x7f034c0721a0 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0352e95640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f034c15c890 con 0x7f034c0cc6d0 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0352e95640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f034c167350 con 0x7f034c0b46d0 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0350c31640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f034c0721a0 0x7f034c1541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0350c31640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f034c0721a0 0x7f034c1541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50878/0 (socket says 172.21.15.82:50878) 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0350c31640 1 -- 172.21.15.82:0/3253907483 learned_addr learned my addr 172.21.15.82:0/3253907483 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0343fff640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f034c0b46d0 0x7f034c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0351432640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f034c0cc6d0 0x7f034c0ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0350c31640 1 -- 172.21.15.82:0/3253907483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f034c0b46d0 msgr2=0x7f034c153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0350c31640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f034c0b46d0 0x7f034c153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0350c31640 1 -- 172.21.15.82:0/3253907483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f034c0cc6d0 msgr2=0x7f034c0ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0350c31640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f034c0cc6d0 0x7f034c0ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0350c31640 1 -- 172.21.15.82:0/3253907483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c1551d0 con 0x7f034c0721a0 2024-06-02T22:54:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0343fff640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f034c0b46d0 0x7f034c153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:54:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0350c31640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f034c0721a0 0x7f034c1541e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f034800c4d0 tx=0x7f034800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f03417fa640 1 -- 172.21.15.82:0/3253907483 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348018070 con 0x7f034c0721a0 2024-06-02T22:54:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f03417fa640 1 -- 172.21.15.82:0/3253907483 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0348007500 con 0x7f034c0721a0 2024-06-02T22:54:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f0352e95640 1 -- 172.21.15.82:0/3253907483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034c154ef0 con 0x7f034c0721a0 2024-06-02T22:54:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.307+0000 7f03417fa640 1 -- 172.21.15.82:0/3253907483 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348004a20 con 0x7f034c0721a0 2024-06-02T22:54:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.308+0000 7f0352e95640 1 -- 172.21.15.82:0/3253907483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f034c06df00 con 0x7f034c0721a0 2024-06-02T22:54:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.308+0000 7f0352e95640 1 -- 172.21.15.82:0/3253907483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f034c06da50 con 0x7f034c0721a0 2024-06-02T22:54:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.309+0000 7f03417fa640 1 -- 172.21.15.82:0/3253907483 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0348004bc0 con 0x7f034c0721a0 2024-06-02T22:54:09.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.309+0000 7f03417fa640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f033806be30 0x7f033806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.309+0000 7f03417fa640 1 -- 172.21.15.82:0/3253907483 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f034808a290 con 0x7f034c0721a0 2024-06-02T22:54:09.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.309+0000 7f0343fff640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f033806be30 0x7f033806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.310+0000 7f0343fff640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f033806be30 0x7f033806e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f033c034000 tx=0x7f033c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:09.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.314+0000 7f03417fa640 1 -- 172.21.15.82:0/3253907483 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0348058ac0 con 0x7f034c0721a0 2024-06-02T22:54:09.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.523+0000 7f0352e95640 1 -- 172.21.15.82:0/3253907483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f034c06d7c0 con 0x7f034c0721a0 2024-06-02T22:54:09.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.523+0000 7f03417fa640 1 -- 172.21.15.82:0/3253907483 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5187 (secure 0 0 0) 0x7f034c06d7c0 con 0x7f034c0721a0 2024-06-02T22:54:09.523 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:09.523 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2836777878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2836777878},{"type":"v1","addr":"172.21.15.184:6834","nonce":2836777878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1408890584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":1408890584},{"type":"v1","addr":"172.21.15.184:6835","nonce":1408890584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3064310162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3064310162},{"type":"v1","addr":"172.21.15.82:6835","nonce":3064310162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:53:38.862365+0000","modified":"2024-06-02T22:53:40.857453+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2390078487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2390078487},{"type":"v1","addr":"172.21.15.82:6837","nonce":2390078487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5403,"qdb_cluster":[5403]},"id":3}]} 2024-06-02T22:54:09.524 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2024-06-02T22:54:09.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.525+0000 7f0352e95640 1 -- 172.21.15.82:0/3253907483 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f033806be30 msgr2=0x7f033806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.525+0000 7f0352e95640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f033806be30 0x7f033806e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f033c034000 tx=0x7f033c02e000 comp rx=0 tx=0).stop 2024-06-02T22:54:09.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.525+0000 7f0352e95640 1 -- 172.21.15.82:0/3253907483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f034c0721a0 msgr2=0x7f034c1541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.525+0000 7f0352e95640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f034c0721a0 0x7f034c1541e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f034800c4d0 tx=0x7f034800c990 comp rx=0 tx=0).stop 2024-06-02T22:54:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.525+0000 7f0352e95640 1 -- 172.21.15.82:0/3253907483 shutdown_connections 2024-06-02T22:54:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.525+0000 7f0352e95640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f033806be30 0x7f033806e2f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.525+0000 7f0352e95640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f034c0cc6d0 0x7f034c0ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.525+0000 7f0352e95640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f034c0b46d0 0x7f034c153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.525+0000 7f0352e95640 1 --2- 172.21.15.82:0/3253907483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f034c0721a0 0x7f034c1541e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.525+0000 7f0352e95640 1 -- 172.21.15.82:0/3253907483 >> 172.21.15.82:0/3253907483 conn(0x7f034c0b19f0 msgr2=0x7f034c0afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.526+0000 7f0352e95640 1 -- 172.21.15.82:0/3253907483 shutdown_connections 2024-06-02T22:54:09.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.526+0000 7f0352e95640 1 -- 172.21.15.82:0/3253907483 wait complete. 2024-06-02T22:54:09.536 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:54:09.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.635+0000 7ffb1d0b3640 1 Processor -- start 2024-06-02T22:54:09.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.635+0000 7ffb1d0b3640 1 -- start start 2024-06-02T22:54:09.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.636+0000 7ffb1d0b3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1815f1a0 0x7ffb180d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.636+0000 7ffb1d0b3640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ffb180cef70 0x7ffb180cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.636+0000 7ffb1d0b3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1815f5e0 con 0x7ffb180d2680 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.636+0000 7ffb1d0b3640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7ffb180d13e0 con 0x7ffb180cef70 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.636+0000 7ffb1d0b3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ffb180d0ad0 con 0x7ffb1815f1a0 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.636+0000 7ffb16d9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ffb180d2680 0x7ffb180d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41094/0 (socket says 172.21.15.82:41094) 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.636+0000 7ffb16d9d640 1 -- 172.21.15.82:0/789942400 learned_addr learned my addr 172.21.15.82:0/789942400 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1759e640 1 --2- 172.21.15.82:0/789942400 >> v2:172.21.15.184:3300/0 conn(0x7ffb180cef70 0x7ffb180cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4000039852 0 0) 0x7ffb1815f5e0 con 0x7ffb180d2680 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb0e59c640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1815f1a0 0x7ffb180d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb04003520 con 0x7ffb180d2680 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 675338945 0 0) 0x7ffb04003520 con 0x7ffb180d2680 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1815f1a0 msgr2=0x7ffb180d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1815f1a0 0x7ffb180d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 >> v2:172.21.15.184:3300/0 conn(0x7ffb180cef70 msgr2=0x7ffb180cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 --2- 172.21.15.82:0/789942400 >> v2:172.21.15.184:3300/0 conn(0x7ffb180cef70 0x7ffb180cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1815f890 con 0x7ffb180d2680 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7ffb08001670 con 0x7ffb180d2680 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 >> v1:172.21.15.82:6789/0 conn(0x7ffb180d2680 legacy=0x7ffb180d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb040039b0 0x7ffb04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1815f1a0 0x7ffb04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb04004d40 0x7ffb040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180d13e0 con 0x7ffb040039b0 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180d0ad0 con 0x7ffb04004d40 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0400b9c0 con 0x7ffb1815f1a0 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb16d9d640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb040039b0 0x7ffb04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb0e59c640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1815f1a0 0x7ffb04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1759e640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb04004d40 0x7ffb040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb16d9d640 1 -- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1815f1a0 msgr2=0x7ffb04004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb16d9d640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1815f1a0 0x7ffb04004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb16d9d640 1 -- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb04004d40 msgr2=0x7ffb040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb16d9d640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb04004d40 0x7ffb040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb16d9d640 1 -- 172.21.15.82:0/789942400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb04003520 con 0x7ffb040039b0 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb0e59c640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb1815f1a0 0x7ffb04004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.637+0000 7ffb1759e640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb04004d40 0x7ffb040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.638+0000 7ffb16d9d640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb040039b0 0x7ffb04003dd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800c210 tx=0x7ffb04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c761773e82a8fc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.638+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08007d50 con 0x7ffb040039b0 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.638+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb08005af0 con 0x7ffb040039b0 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.638+0000 7ffb1659c640 1 -- 172.21.15.82:0/789942400 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08007070 con 0x7ffb040039b0 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.639+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/789942400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb040039b0 msgr2=0x7ffb04003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.639+0000 7ffb1d0b3640 1 --2- 172.21.15.82:0/789942400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb040039b0 0x7ffb04003dd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800c210 tx=0x7ffb04005830 comp rx=0 tx=0).stop 2024-06-02T22:54:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.639+0000 7ffb1759e640 1 -- 172.21.15.82:0/789942400 reap_dead start 2024-06-02T22:54:09.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.639+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/789942400 shutdown_connections 2024-06-02T22:54:09.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.639+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/789942400 >> 172.21.15.82:0/789942400 conn(0x7ffb1809d3f0 msgr2=0x7ffb180d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:09.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.639+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/789942400 shutdown_connections 2024-06-02T22:54:09.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.639+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/789942400 wait complete. 2024-06-02T22:54:09.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.640+0000 7ffb1d0b3640 1 Processor -- start 2024-06-02T22:54:09.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.640+0000 7ffb1d0b3640 1 -- start start 2024-06-02T22:54:09.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb1d0b3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb040039b0 0x7ffb18154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb1d0b3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb180ccc50 0x7ffb180ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb1d0b3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb180cd2c0 0x7ffb180cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb1d0b3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180d4f00 con 0x7ffb180ccc50 2024-06-02T22:54:09.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb1d0b3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180d1070 con 0x7ffb180cd2c0 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb1d0b3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ffb180d1870 con 0x7ffb040039b0 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb0e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb180ccc50 0x7ffb180ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb0e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb180ccc50 0x7ffb180ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50894/0 (socket says 172.21.15.82:50894) 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb0e59c640 1 -- 172.21.15.82:0/335667107 learned_addr learned my addr 172.21.15.82:0/335667107 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb1759e640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb180cd2c0 0x7ffb180cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb16d9d640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb040039b0 0x7ffb18154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb0e59c640 1 -- 172.21.15.82:0/335667107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb040039b0 msgr2=0x7ffb18154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb0e59c640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb040039b0 0x7ffb18154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb0e59c640 1 -- 172.21.15.82:0/335667107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb180cd2c0 msgr2=0x7ffb180cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb0e59c640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb180cd2c0 0x7ffb180cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb0e59c640 1 -- 172.21.15.82:0/335667107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb180cbc40 con 0x7ffb180ccc50 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.641+0000 7ffb0e59c640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb180ccc50 0x7ffb180ca3e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffb000116d0 tx=0x7ffb00011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.642+0000 7ffb0ffff640 1 -- 172.21.15.82:0/335667107 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000f9c0 con 0x7ffb180ccc50 2024-06-02T22:54:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.642+0000 7ffb0ffff640 1 -- 172.21.15.82:0/335667107 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0000fb60 con 0x7ffb180ccc50 2024-06-02T22:54:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.642+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/335667107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb180cc4a0 con 0x7ffb180ccc50 2024-06-02T22:54:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.642+0000 7ffb0ffff640 1 -- 172.21.15.82:0/335667107 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00015460 con 0x7ffb180ccc50 2024-06-02T22:54:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.642+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/335667107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb180cc1c0 con 0x7ffb180ccc50 2024-06-02T22:54:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.643+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/335667107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb18068430 con 0x7ffb180ccc50 2024-06-02T22:54:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.643+0000 7ffb0ffff640 1 -- 172.21.15.82:0/335667107 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb00015600 con 0x7ffb180ccc50 2024-06-02T22:54:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.644+0000 7ffb0ffff640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffaf806be60 0x7ffaf806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.644+0000 7ffb0ffff640 1 -- 172.21.15.82:0/335667107 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ffb0008b7e0 con 0x7ffb180ccc50 2024-06-02T22:54:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.644+0000 7ffb16d9d640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffaf806be60 0x7ffaf806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.644+0000 7ffb16d9d640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffaf806be60 0x7ffaf806e320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb08033000 tx=0x7ffb08009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:09.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.648+0000 7ffb0ffff640 1 -- 172.21.15.82:0/335667107 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffb00019030 con 0x7ffb180ccc50 2024-06-02T22:54:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.861+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/335667107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb1815e920 con 0x7ffb180ccc50 2024-06-02T22:54:09.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.861+0000 7ffb0ffff640 1 -- 172.21.15.82:0/335667107 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5187 (secure 0 0 0) 0x7ffb00059a40 con 0x7ffb180ccc50 2024-06-02T22:54:09.861 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:09.861 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2836777878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2836777878},{"type":"v1","addr":"172.21.15.184:6834","nonce":2836777878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1408890584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":1408890584},{"type":"v1","addr":"172.21.15.184:6835","nonce":1408890584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3064310162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3064310162},{"type":"v1","addr":"172.21.15.82:6835","nonce":3064310162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:53:38.862365+0000","modified":"2024-06-02T22:53:40.857453+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2390078487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2390078487},{"type":"v1","addr":"172.21.15.82:6837","nonce":2390078487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5403,"qdb_cluster":[5403]},"id":3}]} 2024-06-02T22:54:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2024-06-02T22:54:09.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.863+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/335667107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffaf806be60 msgr2=0x7ffaf806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.863+0000 7ffb1d0b3640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffaf806be60 0x7ffaf806e320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb08033000 tx=0x7ffb08009030 comp rx=0 tx=0).stop 2024-06-02T22:54:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.863+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/335667107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb180ccc50 msgr2=0x7ffb180ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.863+0000 7ffb1d0b3640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb180ccc50 0x7ffb180ca3e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffb000116d0 tx=0x7ffb00011b90 comp rx=0 tx=0).stop 2024-06-02T22:54:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.863+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/335667107 shutdown_connections 2024-06-02T22:54:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.863+0000 7ffb1d0b3640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffaf806be60 0x7ffaf806e320 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.863+0000 7ffb1d0b3640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb180cd2c0 0x7ffb180cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.864+0000 7ffb1d0b3640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb180ccc50 0x7ffb180ca3e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.864+0000 7ffb1d0b3640 1 --2- 172.21.15.82:0/335667107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb040039b0 0x7ffb18154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.864+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/335667107 >> 172.21.15.82:0/335667107 conn(0x7ffb1809d3f0 msgr2=0x7ffb180b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.864+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/335667107 shutdown_connections 2024-06-02T22:54:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.864+0000 7ffb1d0b3640 1 -- 172.21.15.82:0/335667107 wait complete. 2024-06-02T22:54:09.875 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:54:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.974+0000 7febae189640 1 Processor -- start 2024-06-02T22:54:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.974+0000 7febae189640 1 -- start start 2024-06-02T22:54:09.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.975+0000 7febae189640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feba815a870 0x7feba806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.975+0000 7febae189640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba806e390 con 0x7feba80aef70 2024-06-02T22:54:09.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.975+0000 7febae189640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba815ac50 con 0x7feba80af3d0 2024-06-02T22:54:09.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.975+0000 7febae189640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7feba806cdb0 con 0x7feba815a870 2024-06-02T22:54:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.975+0000 7feba77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feba815a870 0x7feba806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.975+0000 7feba6ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7feba80aef70 0x7feba80b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41110/0 (socket says 172.21.15.82:41110) 2024-06-02T22:54:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.975+0000 7feba77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feba815a870 0x7feba806de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50906/0 (socket says 172.21.15.82:50906) 2024-06-02T22:54:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.975+0000 7feba6ffd640 1 -- 172.21.15.82:0/4208882723 learned_addr learned my addr 172.21.15.82:0/4208882723 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.975+0000 7feba77fe640 1 -- 172.21.15.82:0/4208882723 >> v1:172.21.15.184:6789/0 conn(0x7feba80af3d0 legacy=0x7feba80cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.975+0000 7feba77fe640 1 -- 172.21.15.82:0/4208882723 >> v1:172.21.15.82:6789/0 conn(0x7feba80aef70 legacy=0x7feba80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.975+0000 7feba77fe640 1 -- 172.21.15.82:0/4208882723 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba806d090 con 0x7feba815a870 2024-06-02T22:54:09.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.976+0000 7feba77fe640 1 --2- 172.21.15.82:0/4208882723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba815a870 0x7feba806de50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7feb9800a940 tx=0x7feb9802b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5770af79f12373 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:09.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.976+0000 7feba67fc640 1 -- 172.21.15.82:0/4208882723 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9800b040 con 0x7feba815a870 2024-06-02T22:54:09.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.976+0000 7feba67fc640 1 -- 172.21.15.82:0/4208882723 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb98030710 con 0x7feba815a870 2024-06-02T22:54:09.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.976+0000 7feba67fc640 1 -- 172.21.15.82:0/4208882723 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98030ae0 con 0x7feba815a870 2024-06-02T22:54:09.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.977+0000 7febae189640 1 -- 172.21.15.82:0/4208882723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba815a870 msgr2=0x7feba806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.977+0000 7febae189640 1 --2- 172.21.15.82:0/4208882723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba815a870 0x7feba806de50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7feb9800a940 tx=0x7feb9802b550 comp rx=0 tx=0).stop 2024-06-02T22:54:09.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.977+0000 7febae189640 1 -- 172.21.15.82:0/4208882723 shutdown_connections 2024-06-02T22:54:09.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.977+0000 7febae189640 1 --2- 172.21.15.82:0/4208882723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba815a870 0x7feba806de50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.977+0000 7febae189640 1 -- 172.21.15.82:0/4208882723 >> 172.21.15.82:0/4208882723 conn(0x7feba80b19f0 msgr2=0x7feba80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:09.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.977+0000 7febae189640 1 -- 172.21.15.82:0/4208882723 shutdown_connections 2024-06-02T22:54:09.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.977+0000 7febae189640 1 -- 172.21.15.82:0/4208882723 wait complete. 2024-06-02T22:54:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.978+0000 7febae189640 1 Processor -- start 2024-06-02T22:54:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.978+0000 7febae189640 1 -- start start 2024-06-02T22:54:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7febae189640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba80aef70 0x7feba80aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7febae189640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feba80af3d0 0x7feba814c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7febae189640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feba815a870 0x7feba81efa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7febae189640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feba806d930 con 0x7feba80aef70 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7febae189640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7feba806d650 con 0x7feba815a870 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7febae189640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7feba80b2e40 con 0x7feba80af3d0 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7feba77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba80aef70 0x7feba80aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7feba77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba80aef70 0x7feba80aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50916/0 (socket says 172.21.15.82:50916) 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7feba77fe640 1 -- 172.21.15.82:0/4232910391 learned_addr learned my addr 172.21.15.82:0/4232910391 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7feba6ffd640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feba80af3d0 0x7feba814c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7feba7fff640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feba815a870 0x7feba81efa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7feba77fe640 1 -- 172.21.15.82:0/4232910391 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feba80af3d0 msgr2=0x7feba814c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7feba77fe640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feba80af3d0 0x7feba814c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7feba77fe640 1 -- 172.21.15.82:0/4232910391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feba815a870 msgr2=0x7feba81efa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7feba77fe640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feba815a870 0x7feba81efa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.979+0000 7feba77fe640 1 -- 172.21.15.82:0/4232910391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba815cf00 con 0x7feba80aef70 2024-06-02T22:54:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.980+0000 7feba77fe640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba80aef70 0x7feba80aea10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7feb98000c00 tx=0x7feb98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:09.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.980+0000 7feb8ffff640 1 -- 172.21.15.82:0/4232910391 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98040070 con 0x7feba80aef70 2024-06-02T22:54:09.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.980+0000 7feb8ffff640 1 -- 172.21.15.82:0/4232910391 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb98032d40 con 0x7feba80aef70 2024-06-02T22:54:09.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.980+0000 7febae189640 1 -- 172.21.15.82:0/4232910391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba815d1e0 con 0x7feba80aef70 2024-06-02T22:54:09.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.980+0000 7feb8ffff640 1 -- 172.21.15.82:0/4232910391 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9803b660 con 0x7feba80aef70 2024-06-02T22:54:09.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.980+0000 7febae189640 1 -- 172.21.15.82:0/4232910391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba80ad150 con 0x7feba80aef70 2024-06-02T22:54:09.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.981+0000 7febae189640 1 -- 172.21.15.82:0/4232910391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba8068430 con 0x7feba80aef70 2024-06-02T22:54:09.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.981+0000 7feb8ffff640 1 -- 172.21.15.82:0/4232910391 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb98043070 con 0x7feba80aef70 2024-06-02T22:54:09.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.982+0000 7feb8ffff640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feb9406be30 0x7feb9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:09.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.982+0000 7feb8ffff640 1 -- 172.21.15.82:0/4232910391 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7feb980aaf90 con 0x7feba80aef70 2024-06-02T22:54:09.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.982+0000 7feba6ffd640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feb9406be30 0x7feb9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:09.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.982+0000 7feba6ffd640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feb9406be30 0x7feb9406e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feba8159350 tx=0x7feb9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:09.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:09.986+0000 7feb8ffff640 1 -- 172.21.15.82:0/4232910391 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7feb98079840 con 0x7feba80aef70 2024-06-02T22:54:10.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.158+0000 7febae189640 1 -- 172.21.15.82:0/4232910391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feba80b2650 con 0x7feba80aef70 2024-06-02T22:54:10.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.159+0000 7feb8ffff640 1 -- 172.21.15.82:0/4232910391 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16938 (secure 0 0 0) 0x7feb98079140 con 0x7feba80aef70 2024-06-02T22:54:10.159 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:10.159 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":54,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:53:40.210399+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:53:37.205775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-06-02T22:53:37.825433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:54:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 -- 172.21.15.82:0/4232910391 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feb9406be30 msgr2=0x7feb9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feb9406be30 0x7feb9406e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feba8159350 tx=0x7feb9c009040 comp rx=0 tx=0).stop 2024-06-02T22:54:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 -- 172.21.15.82:0/4232910391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba80aef70 msgr2=0x7feba80aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba80aef70 0x7feba80aea10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7feb98000c00 tx=0x7feb98004730 comp rx=0 tx=0).stop 2024-06-02T22:54:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 -- 172.21.15.82:0/4232910391 shutdown_connections 2024-06-02T22:54:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7feb9406be30 0x7feb9406e2f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feba815a870 0x7feba81efa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feba80af3d0 0x7feba814c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 --2- 172.21.15.82:0/4232910391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba80aef70 0x7feba80aea10 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 -- 172.21.15.82:0/4232910391 >> 172.21.15.82:0/4232910391 conn(0x7feba80b19f0 msgr2=0x7feba80b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 -- 172.21.15.82:0/4232910391 shutdown_connections 2024-06-02T22:54:10.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.161+0000 7febae189640 1 -- 172.21.15.82:0/4232910391 wait complete. 2024-06-02T22:54:10.172 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T22:54:10.172 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:54:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.272+0000 7fcb3c8fc640 1 Processor -- start 2024-06-02T22:54:10.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.272+0000 7fcb3c8fc640 1 -- start start 2024-06-02T22:54:10.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb3c8fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb381553c0 0x7fcb380cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb3c8fc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb380cec50 0x7fcb380cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb3c8fc640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb380b31a0 con 0x7fcb380b2cf0 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb3c8fc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fcb380b3420 con 0x7fcb381553c0 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb3c8fc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fcb380cc750 con 0x7fcb380cec50 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb3659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb381553c0 0x7fcb380cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb2dd9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcb380b2cf0 0x7fcb3815beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41118/0 (socket says 172.21.15.82:41118) 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb3659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb381553c0 0x7fcb380cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50918/0 (socket says 172.21.15.82:50918) 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb2dd9b640 1 -- 172.21.15.82:0/2914345946 learned_addr learned my addr 172.21.15.82:0/2914345946 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb36d9d640 1 --2- 172.21.15.82:0/2914345946 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb380cec50 0x7fcb380cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb3659c640 1 -- 172.21.15.82:0/2914345946 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb380cec50 msgr2=0x7fcb380cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb3659c640 1 --2- 172.21.15.82:0/2914345946 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb380cec50 0x7fcb380cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb3659c640 1 -- 172.21.15.82:0/2914345946 >> v1:172.21.15.82:6789/0 conn(0x7fcb380b2cf0 legacy=0x7fcb3815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb3659c640 1 -- 172.21.15.82:0/2914345946 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb380cca30 con 0x7fcb381553c0 2024-06-02T22:54:10.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.273+0000 7fcb35d9b640 1 -- 172.21.15.82:0/2914345946 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079974404 0 0) 0x7fcb20001110 con 0x7fcb380b2cf0 2024-06-02T22:54:10.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb3659c640 1 --2- 172.21.15.82:0/2914345946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb381553c0 0x7fcb380cd230 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800ba40 tx=0x7fcb2802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bfdf3a96b233eb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:10.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb35d9b640 1 -- 172.21.15.82:0/2914345946 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28032750 con 0x7fcb381553c0 2024-06-02T22:54:10.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb35d9b640 1 -- 172.21.15.82:0/2914345946 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb28030050 con 0x7fcb381553c0 2024-06-02T22:54:10.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb35d9b640 1 -- 172.21.15.82:0/2914345946 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28032b10 con 0x7fcb381553c0 2024-06-02T22:54:10.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/2914345946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb381553c0 msgr2=0x7fcb380cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb3c8fc640 1 --2- 172.21.15.82:0/2914345946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb381553c0 0x7fcb380cd230 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800ba40 tx=0x7fcb2802c850 comp rx=0 tx=0).stop 2024-06-02T22:54:10.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/2914345946 shutdown_connections 2024-06-02T22:54:10.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb3c8fc640 1 --2- 172.21.15.82:0/2914345946 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb380cec50 0x7fcb380cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb3c8fc640 1 --2- 172.21.15.82:0/2914345946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb381553c0 0x7fcb380cd230 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/2914345946 >> 172.21.15.82:0/2914345946 conn(0x7fcb380b19f0 msgr2=0x7fcb380b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:10.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/2914345946 shutdown_connections 2024-06-02T22:54:10.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.274+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/2914345946 wait complete. 2024-06-02T22:54:10.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.276+0000 7fcb3c8fc640 1 Processor -- start 2024-06-02T22:54:10.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.276+0000 7fcb3c8fc640 1 -- start start 2024-06-02T22:54:10.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb3c8fc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb380b2cf0 0x7fcb3815caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb3c8fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb380cec50 0x7fcb3809c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb3c8fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb381553c0 0x7fcb3806de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb3c8fc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb381557a0 con 0x7fcb380cec50 2024-06-02T22:54:10.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb3c8fc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcb380b3700 con 0x7fcb381553c0 2024-06-02T22:54:10.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb3c8fc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fcb38155920 con 0x7fcb380b2cf0 2024-06-02T22:54:10.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb380cec50 0x7fcb3809c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb380cec50 0x7fcb3809c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50932/0 (socket says 172.21.15.82:50932) 2024-06-02T22:54:10.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2dd9b640 1 -- 172.21.15.82:0/1403026853 learned_addr learned my addr 172.21.15.82:0/1403026853 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb3659c640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb380b2cf0 0x7fcb3815caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb36d9d640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb381553c0 0x7fcb3806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2dd9b640 1 -- 172.21.15.82:0/1403026853 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb380b2cf0 msgr2=0x7fcb3815caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2dd9b640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb380b2cf0 0x7fcb3815caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2dd9b640 1 -- 172.21.15.82:0/1403026853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb381553c0 msgr2=0x7fcb3806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2dd9b640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb381553c0 0x7fcb3806de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2dd9b640 1 -- 172.21.15.82:0/1403026853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3815c030 con 0x7fcb380cec50 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2dd9b640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb380cec50 0x7fcb3809c120 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c430 tx=0x7fcb2000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2f7fe640 1 -- 172.21.15.82:0/1403026853 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb200074e0 con 0x7fcb380cec50 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2f7fe640 1 -- 172.21.15.82:0/1403026853 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb200047e0 con 0x7fcb380cec50 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/1403026853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb38144f10 con 0x7fcb380cec50 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb2f7fe640 1 -- 172.21.15.82:0/1403026853 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20004bd0 con 0x7fcb380cec50 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.277+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/1403026853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb3815c5d0 con 0x7fcb380cec50 2024-06-02T22:54:10.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.278+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/1403026853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb38068430 con 0x7fcb380cec50 2024-06-02T22:54:10.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.279+0000 7fcb2f7fe640 1 -- 172.21.15.82:0/1403026853 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb20011070 con 0x7fcb380cec50 2024-06-02T22:54:10.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.279+0000 7fcb2f7fe640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcb1806be30 0x7fcb1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.279+0000 7fcb2f7fe640 1 -- 172.21.15.82:0/1403026853 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fcb2008ac10 con 0x7fcb380cec50 2024-06-02T22:54:10.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.279+0000 7fcb3659c640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcb1806be30 0x7fcb1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.280+0000 7fcb3659c640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcb1806be30 0x7fcb1806e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcb28037000 tx=0x7fcb28032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:10.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.284+0000 7fcb2f7fe640 1 -- 172.21.15.82:0/1403026853 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcb380b31a0 con 0x7fcb380cec50 2024-06-02T22:54:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.491+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/1403026853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb380b3f40 con 0x7fcb380cec50 2024-06-02T22:54:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.492+0000 7fcb2f7fe640 1 -- 172.21.15.82:0/1403026853 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5187 (secure 0 0 0) 0x7fcb20059430 con 0x7fcb380cec50 2024-06-02T22:54:10.492 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:10.492 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2836777878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2836777878},{"type":"v1","addr":"172.21.15.184:6834","nonce":2836777878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1408890584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":1408890584},{"type":"v1","addr":"172.21.15.184:6835","nonce":1408890584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3064310162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3064310162},{"type":"v1","addr":"172.21.15.82:6835","nonce":3064310162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:53:38.862365+0000","modified":"2024-06-02T22:53:40.857453+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2390078487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2390078487},{"type":"v1","addr":"172.21.15.82:6837","nonce":2390078487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5403,"qdb_cluster":[5403]},"id":3}]} 2024-06-02T22:54:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2024-06-02T22:54:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/1403026853 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcb1806be30 msgr2=0x7fcb1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcb1806be30 0x7fcb1806e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcb28037000 tx=0x7fcb28032000 comp rx=0 tx=0).stop 2024-06-02T22:54:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/1403026853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb380cec50 msgr2=0x7fcb3809c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb380cec50 0x7fcb3809c120 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c430 tx=0x7fcb2000c8f0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/1403026853 shutdown_connections 2024-06-02T22:54:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fcb1806be30 0x7fcb1806e2f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb381553c0 0x7fcb3806de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb380cec50 0x7fcb3809c120 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 --2- 172.21.15.82:0/1403026853 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb380b2cf0 0x7fcb3815caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/1403026853 >> 172.21.15.82:0/1403026853 conn(0x7fcb380b19f0 msgr2=0x7fcb38071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/1403026853 shutdown_connections 2024-06-02T22:54:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.494+0000 7fcb3c8fc640 1 -- 172.21.15.82:0/1403026853 wait complete. 2024-06-02T22:54:10.505 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:54:10.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.605+0000 7efc99e83640 1 Processor -- start 2024-06-02T22:54:10.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.605+0000 7efc99e83640 1 -- start start 2024-06-02T22:54:10.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.605+0000 7efc99e83640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efc940d2680 0x7efc9415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.605+0000 7efc99e83640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc940cef70 0x7efc940cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.605+0000 7efc99e83640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc940d0ad0 con 0x7efc940d1fc0 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.605+0000 7efc99e83640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7efc940d13e0 con 0x7efc940cef70 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.605+0000 7efc99e83640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7efc9415f890 con 0x7efc940d2680 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.606+0000 7efc93fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc940cef70 0x7efc940cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.606+0000 7efc93fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc940cef70 0x7efc940cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50938/0 (socket says 172.21.15.82:50938) 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.606+0000 7efc93fff640 1 -- 172.21.15.82:0/1712775155 learned_addr learned my addr 172.21.15.82:0/1712775155 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.606+0000 7efc937fe640 1 --2- 172.21.15.82:0/1712775155 >> v2:172.21.15.184:3300/0 conn(0x7efc940d2680 0x7efc9415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.606+0000 7efc93fff640 1 -- 172.21.15.82:0/1712775155 >> v2:172.21.15.184:3300/0 conn(0x7efc940d2680 msgr2=0x7efc9415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.606+0000 7efc93fff640 1 --2- 172.21.15.82:0/1712775155 >> v2:172.21.15.184:3300/0 conn(0x7efc940d2680 0x7efc9415f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.606+0000 7efc93fff640 1 -- 172.21.15.82:0/1712775155 >> v1:172.21.15.184:6789/0 conn(0x7efc940d1fc0 legacy=0x7efc940d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.606+0000 7efc93fff640 1 -- 172.21.15.82:0/1712775155 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc940d0d90 con 0x7efc940cef70 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc93fff640 1 --2- 172.21.15.82:0/1712775155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc940cef70 0x7efc940cf3c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efc940d1560 tx=0x7efc8c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7497d397652b7022 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc927fc640 1 -- 172.21.15.82:0/1712775155 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c036070 con 0x7efc940cef70 2024-06-02T22:54:10.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc927fc640 1 -- 172.21.15.82:0/1712775155 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8c031600 con 0x7efc940cef70 2024-06-02T22:54:10.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc927fc640 1 -- 172.21.15.82:0/1712775155 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0319d0 con 0x7efc940cef70 2024-06-02T22:54:10.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc99e83640 1 -- 172.21.15.82:0/1712775155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc940cef70 msgr2=0x7efc940cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc99e83640 1 --2- 172.21.15.82:0/1712775155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc940cef70 0x7efc940cf3c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efc940d1560 tx=0x7efc8c02a6d0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc99e83640 1 -- 172.21.15.82:0/1712775155 shutdown_connections 2024-06-02T22:54:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc99e83640 1 --2- 172.21.15.82:0/1712775155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc940cef70 0x7efc940cf3c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc99e83640 1 --2- 172.21.15.82:0/1712775155 >> v2:172.21.15.184:3300/0 conn(0x7efc940d2680 0x7efc9415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc99e83640 1 -- 172.21.15.82:0/1712775155 >> 172.21.15.82:0/1712775155 conn(0x7efc9409d3f0 msgr2=0x7efc940d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc99e83640 1 -- 172.21.15.82:0/1712775155 shutdown_connections 2024-06-02T22:54:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.607+0000 7efc99e83640 1 -- 172.21.15.82:0/1712775155 wait complete. 2024-06-02T22:54:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.609+0000 7efc99e83640 1 Processor -- start 2024-06-02T22:54:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.609+0000 7efc99e83640 1 -- start start 2024-06-02T22:54:10.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.609+0000 7efc99e83640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc940cef70 0x7efc9409ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.609+0000 7efc99e83640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc940d1fc0 0x7efc9414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.609+0000 7efc99e83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc940d2680 0x7efc94160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.609+0000 7efc99e83640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc940d4f00 con 0x7efc940d2680 2024-06-02T22:54:10.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.609+0000 7efc99e83640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efc940d2400 con 0x7efc940d1fc0 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.609+0000 7efc99e83640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7efc940d1870 con 0x7efc940cef70 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc93fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc940d2680 0x7efc94160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc93fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc940d2680 0x7efc94160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50948/0 (socket says 172.21.15.82:50948) 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc93fff640 1 -- 172.21.15.82:0/3285144116 learned_addr learned my addr 172.21.15.82:0/3285144116 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc937fe640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc940cef70 0x7efc9409ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc92ffd640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc940d1fc0 0x7efc9414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc93fff640 1 -- 172.21.15.82:0/3285144116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc940cef70 msgr2=0x7efc9409ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc93fff640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc940cef70 0x7efc9409ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc93fff640 1 -- 172.21.15.82:0/3285144116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc940d1fc0 msgr2=0x7efc9414e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc93fff640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc940d1fc0 0x7efc9414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc93fff640 1 -- 172.21.15.82:0/3285144116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9409e0b0 con 0x7efc940d2680 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc93fff640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc940d2680 0x7efc94160350 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009f10 tx=0x7efc8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc7bfff640 1 -- 172.21.15.82:0/3285144116 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c036050 con 0x7efc940d2680 2024-06-02T22:54:10.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc7bfff640 1 -- 172.21.15.82:0/3285144116 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8c042070 con 0x7efc940d2680 2024-06-02T22:54:10.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc99e83640 1 -- 172.21.15.82:0/3285144116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9409e390 con 0x7efc940d2680 2024-06-02T22:54:10.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc7bfff640 1 -- 172.21.15.82:0/3285144116 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c009510 con 0x7efc940d2680 2024-06-02T22:54:10.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.610+0000 7efc99e83640 1 -- 172.21.15.82:0/3285144116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc9409e950 con 0x7efc940d2680 2024-06-02T22:54:10.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.611+0000 7efc99e83640 1 -- 172.21.15.82:0/3285144116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc94068430 con 0x7efc940d2680 2024-06-02T22:54:10.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.612+0000 7efc7bfff640 1 -- 172.21.15.82:0/3285144116 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc8c007c50 con 0x7efc940d2680 2024-06-02T22:54:10.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.612+0000 7efc7bfff640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efc8006be30 0x7efc8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.612+0000 7efc7bfff640 1 -- 172.21.15.82:0/3285144116 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7efc8c0ac0b0 con 0x7efc940d2680 2024-06-02T22:54:10.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.612+0000 7efc937fe640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efc8006be30 0x7efc8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.612+0000 7efc937fe640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efc8006be30 0x7efc8006e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efc84006fd0 tx=0x7efc84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:10.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.616+0000 7efc7bfff640 1 -- 172.21.15.82:0/3285144116 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efc8c07a8d0 con 0x7efc940d2680 2024-06-02T22:54:10.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.825+0000 7efc99e83640 1 -- 172.21.15.82:0/3285144116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc940d04e0 con 0x7efc940d2680 2024-06-02T22:54:10.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.825+0000 7efc7bfff640 1 -- 172.21.15.82:0/3285144116 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5187 (secure 0 0 0) 0x7efc8c07a1d0 con 0x7efc940d2680 2024-06-02T22:54:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:10.825 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2836777878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2836777878},{"type":"v1","addr":"172.21.15.184:6834","nonce":2836777878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1408890584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":1408890584},{"type":"v1","addr":"172.21.15.184:6835","nonce":1408890584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3064310162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3064310162},{"type":"v1","addr":"172.21.15.82:6835","nonce":3064310162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:53:38.862365+0000","modified":"2024-06-02T22:53:40.857453+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5403},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5403":{"gid":5403,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2390078487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2390078487},{"type":"v1","addr":"172.21.15.82:6837","nonce":2390078487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5403,"qdb_cluster":[5403]},"id":3}]} 2024-06-02T22:54:10.826 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2024-06-02T22:54:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.827+0000 7efc99e83640 1 -- 172.21.15.82:0/3285144116 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efc8006be30 msgr2=0x7efc8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.827+0000 7efc99e83640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efc8006be30 0x7efc8006e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efc84006fd0 tx=0x7efc84008040 comp rx=0 tx=0).stop 2024-06-02T22:54:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.827+0000 7efc99e83640 1 -- 172.21.15.82:0/3285144116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc940d2680 msgr2=0x7efc94160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.827+0000 7efc99e83640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc940d2680 0x7efc94160350 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009f10 tx=0x7efc8c004a40 comp rx=0 tx=0).stop 2024-06-02T22:54:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.827+0000 7efc99e83640 1 -- 172.21.15.82:0/3285144116 shutdown_connections 2024-06-02T22:54:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.827+0000 7efc99e83640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7efc8006be30 0x7efc8006e2f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.827+0000 7efc99e83640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc940d2680 0x7efc94160350 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.827+0000 7efc99e83640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc940d1fc0 0x7efc9414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.827+0000 7efc99e83640 1 --2- 172.21.15.82:0/3285144116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc940cef70 0x7efc9409ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.827+0000 7efc99e83640 1 -- 172.21.15.82:0/3285144116 >> 172.21.15.82:0/3285144116 conn(0x7efc9409d3f0 msgr2=0x7efc940c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.827+0000 7efc99e83640 1 -- 172.21.15.82:0/3285144116 shutdown_connections 2024-06-02T22:54:10.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.828+0000 7efc99e83640 1 -- 172.21.15.82:0/3285144116 wait complete. 2024-06-02T22:54:10.839 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:54:10.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.938+0000 7f7041577640 1 Processor -- start 2024-06-02T22:54:10.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.938+0000 7f7041577640 1 -- start start 2024-06-02T22:54:10.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f7041577640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f703c0d1fc0 0x7f703c0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f7041577640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f703c15f5e0 con 0x7f703c15f1a0 2024-06-02T22:54:10.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f7041577640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f703c0d0ad0 con 0x7f703c0d2680 2024-06-02T22:54:10.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f7041577640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f703c0d13e0 con 0x7f703c0d1fc0 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f7033fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f703c15f1a0 0x7f703c0cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41124/0 (socket says 172.21.15.82:41124) 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f7033fff640 1 -- 172.21.15.82:0/3510697510 learned_addr learned my addr 172.21.15.82:0/3510697510 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 661325746 0 0) 0x7f703c15f5e0 con 0x7f703c15f1a0 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f703b7fe640 1 --2- 172.21.15.82:0/3510697510 >> v2:172.21.15.184:3300/0 conn(0x7f703c0d1fc0 0x7f703c0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7028003520 con 0x7f703c15f1a0 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1056884220 0 0) 0x7f7028003520 con 0x7f703c15f1a0 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 >> v2:172.21.15.184:3300/0 conn(0x7f703c0d1fc0 msgr2=0x7f703c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f703a7fc640 1 --2- 172.21.15.82:0/3510697510 >> v2:172.21.15.184:3300/0 conn(0x7f703c0d1fc0 0x7f703c0cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 >> v1:172.21.15.184:6789/0 conn(0x7f703c0d2680 legacy=0x7f703c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.939+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703c15f890 con 0x7f703c15f1a0 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f7024001670 con 0x7f703c15f1a0 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 >> v1:172.21.15.82:6789/0 conn(0x7f703c15f1a0 legacy=0x7f703c0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703a7fc640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7028003a00 0x7f7028003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703a7fc640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7028004800 0x7f7028004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703a7fc640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70280051c0 0x7f702800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f703c0d13e0 con 0x7f70280051c0 2024-06-02T22:54:10.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f702800c0c0 con 0x7f7028003a00 2024-06-02T22:54:10.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f702800c2c0 con 0x7f7028004800 2024-06-02T22:54:10.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703b7fe640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70280051c0 0x7f702800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703affd640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7028003a00 0x7f7028003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f7033fff640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7028004800 0x7f7028004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703b7fe640 1 -- 172.21.15.82:0/3510697510 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7028004800 msgr2=0x7f7028004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:10.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703b7fe640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7028004800 0x7f7028004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703b7fe640 1 -- 172.21.15.82:0/3510697510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7028003a00 msgr2=0x7f7028003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703b7fe640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7028003a00 0x7f7028003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703b7fe640 1 -- 172.21.15.82:0/3510697510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7028003520 con 0x7f70280051c0 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.940+0000 7f703affd640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7028003a00 0x7f7028003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f703b7fe640 1 -- 172.21.15.82:0/3510697510 reap_dead start 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f703b7fe640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70280051c0 0x7f702800b9c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7034009fc0 tx=0x7f7028005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7062b6b90045f18 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034035020 con 0x7f70280051c0 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7034003bd0 con 0x7f70280051c0 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f703a7fc640 1 -- 172.21.15.82:0/3510697510 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7034009c10 con 0x7f70280051c0 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f7041577640 1 -- 172.21.15.82:0/3510697510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70280051c0 msgr2=0x7f702800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f7041577640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70280051c0 0x7f702800b9c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7034009fc0 tx=0x7f7028005830 comp rx=0 tx=0).stop 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f7041577640 1 -- 172.21.15.82:0/3510697510 shutdown_connections 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f7041577640 1 --2- 172.21.15.82:0/3510697510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70280051c0 0x7f702800b9c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f7041577640 1 -- 172.21.15.82:0/3510697510 >> 172.21.15.82:0/3510697510 conn(0x7f703c09d3f0 msgr2=0x7f703c0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:10.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f7041577640 1 -- 172.21.15.82:0/3510697510 shutdown_connections 2024-06-02T22:54:10.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.941+0000 7f7041577640 1 -- 172.21.15.82:0/3510697510 wait complete. 2024-06-02T22:54:10.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.942+0000 7f7041577640 1 Processor -- start 2024-06-02T22:54:10.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f7041577640 1 -- start start 2024-06-02T22:54:10.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f7041577640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70280051c0 0x7f703c0a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f7041577640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f703c15a5c0 0x7f703c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f7041577640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f703c09edb0 0x7f703c15de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f7041577640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f703c0d2410 con 0x7f703c15a5c0 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f7041577640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f703c0d1070 con 0x7f70280051c0 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f7041577640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f703c0d4f00 con 0x7f703c09edb0 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f7033fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f703c15a5c0 0x7f703c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f7033fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f703c15a5c0 0x7f703c09e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50960/0 (socket says 172.21.15.82:50960) 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f7033fff640 1 -- 172.21.15.82:0/3867559565 learned_addr learned my addr 172.21.15.82:0/3867559565 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f703affd640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70280051c0 0x7f703c0a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.943+0000 7f703b7fe640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f703c09edb0 0x7f703c15de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f7033fff640 1 -- 172.21.15.82:0/3867559565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f703c09edb0 msgr2=0x7f703c15de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f7033fff640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f703c09edb0 0x7f703c15de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f7033fff640 1 -- 172.21.15.82:0/3867559565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70280051c0 msgr2=0x7f703c0a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f7033fff640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70280051c0 0x7f703c0a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f7033fff640 1 -- 172.21.15.82:0/3867559565 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703c09f250 con 0x7f703c15a5c0 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f703b7fe640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f703c09edb0 0x7f703c15de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f703affd640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70280051c0 0x7f703c0a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f7033fff640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f703c15a5c0 0x7f703c09e870 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f702400e730 tx=0x7f702400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f70337fe640 1 -- 172.21.15.82:0/3867559565 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702400c660 con 0x7f703c15a5c0 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f70337fe640 1 -- 172.21.15.82:0/3867559565 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7024018070 con 0x7f703c15a5c0 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f7041577640 1 -- 172.21.15.82:0/3867559565 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703c09f530 con 0x7f703c15a5c0 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f70337fe640 1 -- 172.21.15.82:0/3867559565 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702400ca60 con 0x7f703c15a5c0 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.944+0000 7f7041577640 1 -- 172.21.15.82:0/3867559565 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f703c09faf0 con 0x7f703c15a5c0 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.945+0000 7f7041577640 1 -- 172.21.15.82:0/3867559565 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f703c068430 con 0x7f703c15a5c0 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.945+0000 7f70337fe640 1 -- 172.21.15.82:0/3867559565 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f702400cc00 con 0x7f703c15a5c0 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.946+0000 7f70337fe640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f701c06be60 0x7f701c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:10.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.946+0000 7f70337fe640 1 -- 172.21.15.82:0/3867559565 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f702408ad80 con 0x7f703c15a5c0 2024-06-02T22:54:10.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.946+0000 7f703affd640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f701c06be60 0x7f701c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:10.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.946+0000 7f703affd640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f701c06be60 0x7f701c06e320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f702c000c00 tx=0x7f702c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:10.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:10.950+0000 7f70337fe640 1 -- 172.21.15.82:0/3867559565 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f70240595a0 con 0x7f703c15a5c0 2024-06-02T22:54:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.123+0000 7f7041577640 1 -- 172.21.15.82:0/3867559565 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f703c0d04e0 con 0x7f703c15a5c0 2024-06-02T22:54:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.124+0000 7f70337fe640 1 -- 172.21.15.82:0/3867559565 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16938 (secure 0 0 0) 0x7f7024058ea0 con 0x7f703c15a5c0 2024-06-02T22:54:11.124 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:11.124 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":54,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:53:40.210399+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:53:37.205775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-06-02T22:53:37.825433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:54:11.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 -- 172.21.15.82:0/3867559565 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f701c06be60 msgr2=0x7f701c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f701c06be60 0x7f701c06e320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f702c000c00 tx=0x7f702c009040 comp rx=0 tx=0).stop 2024-06-02T22:54:11.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 -- 172.21.15.82:0/3867559565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f703c15a5c0 msgr2=0x7f703c09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f703c15a5c0 0x7f703c09e870 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f702400e730 tx=0x7f702400ebf0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 -- 172.21.15.82:0/3867559565 shutdown_connections 2024-06-02T22:54:11.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f701c06be60 0x7f701c06e320 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f703c09edb0 0x7f703c15de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f703c15a5c0 0x7f703c09e870 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 --2- 172.21.15.82:0/3867559565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70280051c0 0x7f703c0a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 -- 172.21.15.82:0/3867559565 >> 172.21.15.82:0/3867559565 conn(0x7f703c09d3f0 msgr2=0x7f703c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:11.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 -- 172.21.15.82:0/3867559565 shutdown_connections 2024-06-02T22:54:11.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.126+0000 7f7041577640 1 -- 172.21.15.82:0/3867559565 wait complete. 2024-06-02T22:54:11.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-02T22:54:11.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.240+0000 7f160039e640 1 Processor -- start 2024-06-02T22:54:11.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.240+0000 7f160039e640 1 -- start start 2024-06-02T22:54:11.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f160039e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15f815f1a0 0x7f15f80d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f160039e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15f80cef70 0x7f15f80cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f160039e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f815f5e0 con 0x7f15f80d2680 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f160039e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f15f80d13e0 con 0x7f15f80cef70 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f160039e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f15f80d0ad0 con 0x7f15f815f1a0 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f15fe93b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15f80cef70 0x7f15f80cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f15fe13a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f15f80d2680 0x7f15f80d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48388/0 (socket says 172.21.15.82:48388) 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f15fe13a640 1 -- 172.21.15.82:0/2667420471 learned_addr learned my addr 172.21.15.82:0/2667420471 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f15fe93b640 1 -- 172.21.15.82:0/2667420471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15f815f1a0 msgr2=0x7f15f80d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f15fe93b640 1 --2- 172.21.15.82:0/2667420471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15f815f1a0 0x7f15f80d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f15fe93b640 1 -- 172.21.15.82:0/2667420471 >> v1:172.21.15.82:6789/0 conn(0x7f15f80d2680 legacy=0x7f15f80d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f15fe93b640 1 -- 172.21.15.82:0/2667420471 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f815f890 con 0x7f15f80cef70 2024-06-02T22:54:11.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.241+0000 7f15fd138640 1 -- 172.21.15.82:0/2667420471 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2665643226 0 0) 0x7f15f815f5e0 con 0x7f15f80d2680 2024-06-02T22:54:11.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.242+0000 7f15fe93b640 1 --2- 172.21.15.82:0/2667420471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f80cef70 0x7f15f80cf400 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009d90 tx=0x7f15f002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefa9d655300371c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:11.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.242+0000 7f15fd138640 1 -- 172.21.15.82:0/2667420471 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0007740 con 0x7f15f80cef70 2024-06-02T22:54:11.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.242+0000 7f15fd138640 1 -- 172.21.15.82:0/2667420471 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f00078e0 con 0x7f15f80cef70 2024-06-02T22:54:11.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.242+0000 7f15fd138640 1 -- 172.21.15.82:0/2667420471 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f0007cb0 con 0x7f15f80cef70 2024-06-02T22:54:11.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.242+0000 7f160039e640 1 -- 172.21.15.82:0/2667420471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f80cef70 msgr2=0x7f15f80cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.242+0000 7f160039e640 1 --2- 172.21.15.82:0/2667420471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f80cef70 0x7f15f80cf400 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009d90 tx=0x7f15f002a660 comp rx=0 tx=0).stop 2024-06-02T22:54:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.243+0000 7f160039e640 1 -- 172.21.15.82:0/2667420471 shutdown_connections 2024-06-02T22:54:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.243+0000 7f160039e640 1 --2- 172.21.15.82:0/2667420471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f80cef70 0x7f15f80cf400 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.243+0000 7f160039e640 1 --2- 172.21.15.82:0/2667420471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15f815f1a0 0x7f15f80d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.243+0000 7f160039e640 1 -- 172.21.15.82:0/2667420471 >> 172.21.15.82:0/2667420471 conn(0x7f15f809d3f0 msgr2=0x7f15f80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.243+0000 7f160039e640 1 -- 172.21.15.82:0/2667420471 shutdown_connections 2024-06-02T22:54:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.243+0000 7f160039e640 1 -- 172.21.15.82:0/2667420471 wait complete. 2024-06-02T22:54:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.244+0000 7f160039e640 1 Processor -- start 2024-06-02T22:54:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.244+0000 7f160039e640 1 -- start start 2024-06-02T22:54:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.244+0000 7f160039e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f80cef70 0x7f15f81527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.244+0000 7f160039e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15f80d2680 0x7f15f80ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.244+0000 7f160039e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15f815f1a0 0x7f15f8159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f160039e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15f80d4f00 con 0x7f15f80cef70 2024-06-02T22:54:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f160039e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15f80d1070 con 0x7f15f815f1a0 2024-06-02T22:54:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f160039e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f15f80d1870 con 0x7f15f80d2680 2024-06-02T22:54:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15fe13a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f80cef70 0x7f15f81527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15fe13a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f80cef70 0x7f15f81527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33070/0 (socket says 172.21.15.82:33070) 2024-06-02T22:54:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15fe13a640 1 -- 172.21.15.82:0/708448701 learned_addr learned my addr 172.21.15.82:0/708448701 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15fe93b640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15f815f1a0 0x7f15f8159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15fd939640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15f80d2680 0x7f15f80ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15fe13a640 1 -- 172.21.15.82:0/708448701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15f80d2680 msgr2=0x7f15f80ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15fe13a640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15f80d2680 0x7f15f80ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15fe13a640 1 -- 172.21.15.82:0/708448701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15f815f1a0 msgr2=0x7f15f8159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15fe13a640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15f815f1a0 0x7f15f8159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15fe13a640 1 -- 172.21.15.82:0/708448701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f8152d30 con 0x7f15f80cef70 2024-06-02T22:54:11.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15fe13a640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f80cef70 0x7f15f81527f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f15f400c4d0 tx=0x7f15f400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:11.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15eeffd640 1 -- 172.21.15.82:0/708448701 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f4018070 con 0x7f15f80cef70 2024-06-02T22:54:11.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15eeffd640 1 -- 172.21.15.82:0/708448701 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f4007500 con 0x7f15f80cef70 2024-06-02T22:54:11.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f15eeffd640 1 -- 172.21.15.82:0/708448701 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f4004a20 con 0x7f15f80cef70 2024-06-02T22:54:11.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f160039e640 1 -- 172.21.15.82:0/708448701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f80cc690 con 0x7f15f80cef70 2024-06-02T22:54:11.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.245+0000 7f160039e640 1 -- 172.21.15.82:0/708448701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f80ccc50 con 0x7f15f80cef70 2024-06-02T22:54:11.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.246+0000 7f160039e640 1 -- 172.21.15.82:0/708448701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f8068430 con 0x7f15f80cef70 2024-06-02T22:54:11.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.247+0000 7f15eeffd640 1 -- 172.21.15.82:0/708448701 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15f4004bc0 con 0x7f15f80cef70 2024-06-02T22:54:11.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.247+0000 7f15eeffd640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f15dc06be30 0x7f15dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.247+0000 7f15fd939640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f15dc06be30 0x7f15dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:11.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.247+0000 7f15eeffd640 1 -- 172.21.15.82:0/708448701 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f15f408a250 con 0x7f15f80cef70 2024-06-02T22:54:11.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.248+0000 7f15fd939640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f15dc06be30 0x7f15dc06e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f15f8156460 tx=0x7f15e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:11.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.252+0000 7f15eeffd640 1 -- 172.21.15.82:0/708448701 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f15f4058b00 con 0x7f15f80cef70 2024-06-02T22:54:11.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.461+0000 7f160039e640 1 -- 172.21.15.82:0/708448701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f15f80d04e0 con 0x7f15f80cef70 2024-06-02T22:54:11.461 INFO:tasks.ceph.mon.a.smithi082.stderr:2024-06-02T22:54:11.462+0000 7fc5cceb2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T22:54:11.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.463+0000 7f15eeffd640 1 -- 172.21.15.82:0/708448701 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) ==== 161+0+0 (secure 0 0 0) 0x7f15f4058400 con 0x7f15f80cef70 2024-06-02T22:54:11.463 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-02T22:54:11.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.466+0000 7f160039e640 1 -- 172.21.15.82:0/708448701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f15dc06be30 msgr2=0x7f15dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.467+0000 7f160039e640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f15dc06be30 0x7f15dc06e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f15f8156460 tx=0x7f15e8008040 comp rx=0 tx=0).stop 2024-06-02T22:54:11.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.467+0000 7f160039e640 1 -- 172.21.15.82:0/708448701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f80cef70 msgr2=0x7f15f81527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.467+0000 7f160039e640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f80cef70 0x7f15f81527f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f15f400c4d0 tx=0x7f15f400c990 comp rx=0 tx=0).stop 2024-06-02T22:54:11.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.467+0000 7f160039e640 1 -- 172.21.15.82:0/708448701 shutdown_connections 2024-06-02T22:54:11.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.467+0000 7f160039e640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f15dc06be30 0x7f15dc06e2f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.467+0000 7f160039e640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15f815f1a0 0x7f15f8159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.467+0000 7f160039e640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15f80d2680 0x7f15f80ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.467+0000 7f160039e640 1 --2- 172.21.15.82:0/708448701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15f80cef70 0x7f15f81527f0 secure :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f15f400c4d0 tx=0x7f15f400c990 comp rx=0 tx=0).stop 2024-06-02T22:54:11.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.467+0000 7f160039e640 1 -- 172.21.15.82:0/708448701 >> 172.21.15.82:0/708448701 conn(0x7f15f809d3f0 msgr2=0x7f15f80d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:11.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.467+0000 7f160039e640 1 -- 172.21.15.82:0/708448701 shutdown_connections 2024-06-02T22:54:11.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.467+0000 7f160039e640 1 -- 172.21.15.82:0/708448701 wait complete. 2024-06-02T22:54:11.468 INFO:tasks.ceph.mds.a.smithi082.stderr: -2724> 2024-06-02T22:53:45.499+0000 7fad29f71640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T22:54:11.479 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-02T22:54:11.497 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2024-06-02T22:54:11.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.581+0000 7f5b7ee5d640 1 Processor -- start 2024-06-02T22:54:11.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.581+0000 7f5b7ee5d640 1 -- start start 2024-06-02T22:54:11.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7ee5d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5b78155320 0x7f5b780b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7ee5d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b780d0730 0x7f5b7806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7ee5d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b78155700 con 0x7f5b780b34e0 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7ee5d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5b7815b6b0 con 0x7f5b78155320 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7ee5d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5b7815b990 con 0x7f5b780d0730 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7cbf9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5b78155320 0x7f5b780b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7cbf9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5b78155320 0x7f5b780b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33086/0 (socket says 172.21.15.82:33086) 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b77fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5b780b34e0 0x7f5b780d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48406/0 (socket says 172.21.15.82:48406) 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7cbf9640 1 -- 172.21.15.82:0/2375415247 learned_addr learned my addr 172.21.15.82:0/2375415247 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7d3fa640 1 --2- 172.21.15.82:0/2375415247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b780d0730 0x7f5b7806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7cbf9640 1 -- 172.21.15.82:0/2375415247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b780d0730 msgr2=0x7f5b7806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7cbf9640 1 --2- 172.21.15.82:0/2375415247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b780d0730 0x7f5b7806e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7cbf9640 1 -- 172.21.15.82:0/2375415247 >> v1:172.21.15.82:6789/0 conn(0x7f5b780b34e0 legacy=0x7f5b780d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b7cbf9640 1 -- 172.21.15.82:0/2375415247 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7815bc70 con 0x7f5b78155320 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.582+0000 7f5b777fe640 1 -- 172.21.15.82:0/2375415247 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414803048 0 0) 0x7f5b78155700 con 0x7f5b780b34e0 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.583+0000 7f5b7cbf9640 1 --2- 172.21.15.82:0/2375415247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b78155320 0x7f5b780b2fa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009870 tx=0x7f5b6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64927ded08ca5cea server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.583+0000 7f5b777fe640 1 -- 172.21.15.82:0/2375415247 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68037070 con 0x7f5b78155320 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.583+0000 7f5b777fe640 1 -- 172.21.15.82:0/2375415247 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b68032440 con 0x7f5b78155320 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.583+0000 7f5b777fe640 1 -- 172.21.15.82:0/2375415247 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68032810 con 0x7f5b78155320 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.584+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/2375415247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b78155320 msgr2=0x7f5b780b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.584+0000 7f5b7ee5d640 1 --2- 172.21.15.82:0/2375415247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b78155320 0x7f5b780b2fa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009870 tx=0x7f5b6802a270 comp rx=0 tx=0).stop 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.584+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/2375415247 shutdown_connections 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.584+0000 7f5b7ee5d640 1 --2- 172.21.15.82:0/2375415247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b780d0730 0x7f5b7806e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.584+0000 7f5b7ee5d640 1 --2- 172.21.15.82:0/2375415247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b78155320 0x7f5b780b2fa0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.584+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/2375415247 >> 172.21.15.82:0/2375415247 conn(0x7f5b780b1d10 msgr2=0x7f5b780b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.584+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/2375415247 shutdown_connections 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.584+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/2375415247 wait complete. 2024-06-02T22:54:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.585+0000 7f5b7ee5d640 1 Processor -- start 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.585+0000 7f5b7ee5d640 1 -- start start 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7ee5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b780b34e0 0x7f5b781e59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7ee5d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b780d0730 0x7f5b78157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7ee5d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b78155320 0x7f5b781580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7ee5d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7815b470 con 0x7f5b780b34e0 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7ee5d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7815b2f0 con 0x7f5b78155320 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7ee5d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f5b7806e730 con 0x7f5b780d0730 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7cbf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b780b34e0 0x7f5b781e59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7cbf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b780b34e0 0x7f5b781e59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33102/0 (socket says 172.21.15.82:33102) 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7cbf9640 1 -- 172.21.15.82:0/1647532672 learned_addr learned my addr 172.21.15.82:0/1647532672 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b77fff640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b780d0730 0x7f5b78157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7d3fa640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b78155320 0x7f5b781580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7cbf9640 1 -- 172.21.15.82:0/1647532672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b780d0730 msgr2=0x7f5b78157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7cbf9640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b780d0730 0x7f5b78157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7cbf9640 1 -- 172.21.15.82:0/1647532672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b78155320 msgr2=0x7f5b781580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7cbf9640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b78155320 0x7f5b781580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7cbf9640 1 -- 172.21.15.82:0/1647532672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b780ce440 con 0x7f5b780b34e0 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.586+0000 7f5b7cbf9640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b780b34e0 0x7f5b781e59c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009870 tx=0x7f5b680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.587+0000 7f5b757fa640 1 -- 172.21.15.82:0/1647532672 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68041020 con 0x7f5b780b34e0 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.587+0000 7f5b757fa640 1 -- 172.21.15.82:0/1647532672 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b680306c0 con 0x7f5b780b34e0 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.587+0000 7f5b757fa640 1 -- 172.21.15.82:0/1647532672 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68037040 con 0x7f5b780b34e0 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.587+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/1647532672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b780ce720 con 0x7f5b780b34e0 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.587+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/1647532672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b780cece0 con 0x7f5b780b34e0 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.588+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/1647532672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b780683c0 con 0x7f5b780b34e0 2024-06-02T22:54:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.588+0000 7f5b757fa640 1 -- 172.21.15.82:0/1647532672 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b68044020 con 0x7f5b780b34e0 2024-06-02T22:54:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.588+0000 7f5b757fa640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b6406be30 0x7f5b6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.589+0000 7f5b757fa640 1 -- 172.21.15.82:0/1647532672 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f5b680ab860 con 0x7f5b780b34e0 2024-06-02T22:54:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.589+0000 7f5b77fff640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b6406be30 0x7f5b6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.589+0000 7f5b77fff640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b6406be30 0x7f5b6406e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b78158920 tx=0x7f5b6c007b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.593+0000 7f5b757fa640 1 -- 172.21.15.82:0/1647532672 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5b6804b030 con 0x7f5b780b34e0 2024-06-02T22:54:11.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:11.804+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/1647532672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5b780cf640 con 0x7f5b780b34e0 2024-06-02T22:54:12.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.464+0000 7f5b757fa640 1 -- 172.21.15.82:0/1647532672 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f5b6807a0c0 con 0x7f5b780b34e0 2024-06-02T22:54:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/1647532672 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b6406be30 msgr2=0x7f5b6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b6406be30 0x7f5b6406e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b78158920 tx=0x7f5b6c007b90 comp rx=0 tx=0).stop 2024-06-02T22:54:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/1647532672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b780b34e0 msgr2=0x7f5b781e59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b780b34e0 0x7f5b781e59c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009870 tx=0x7f5b680046c0 comp rx=0 tx=0).stop 2024-06-02T22:54:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/1647532672 shutdown_connections 2024-06-02T22:54:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f5b6406be30 0x7f5b6406e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b78155320 0x7f5b781580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b780d0730 0x7f5b78157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 --2- 172.21.15.82:0/1647532672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b780b34e0 0x7f5b781e59c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/1647532672 >> 172.21.15.82:0/1647532672 conn(0x7f5b780b1d10 msgr2=0x7f5b780b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/1647532672 shutdown_connections 2024-06-02T22:54:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.467+0000 7f5b7ee5d640 1 -- 172.21.15.82:0/1647532672 wait complete. 2024-06-02T22:54:12.479 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-02T22:54:12.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.625+0000 7f0074a72640 1 Processor -- start 2024-06-02T22:54:12.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.625+0000 7f0074a72640 1 -- start start 2024-06-02T22:54:12.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.626+0000 7f0074a72640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00700d0e00 0x7f00700d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:12.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.626+0000 7f0074a72640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00700d23c0 con 0x7f00700d1f30 2024-06-02T22:54:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.626+0000 7f0074a72640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007015ec90 con 0x7f007015e670 2024-06-02T22:54:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.626+0000 7f0074a72640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f007015fa50 con 0x7f00700d0e00 2024-06-02T22:54:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.626+0000 7f006dd9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00700d0e00 0x7f00700d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.626+0000 7f006ed9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f00700d1f30 0x7f00700cebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48410/0 (socket says 172.21.15.82:48410) 2024-06-02T22:54:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.626+0000 7f006ed9d640 1 -- 172.21.15.82:0/1576677302 learned_addr learned my addr 172.21.15.82:0/1576677302 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.627+0000 7f006dd9b640 1 -- 172.21.15.82:0/1576677302 >> v1:172.21.15.184:6789/0 conn(0x7f007015e670 legacy=0x7f00700d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.627+0000 7f006dd9b640 1 -- 172.21.15.82:0/1576677302 >> v1:172.21.15.82:6789/0 conn(0x7f00700d1f30 legacy=0x7f00700cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.627+0000 7f006dd9b640 1 -- 172.21.15.82:0/1576677302 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007015ef70 con 0x7f00700d0e00 2024-06-02T22:54:12.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.627+0000 7f006dd9b640 1 --2- 172.21.15.82:0/1576677302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00700d0e00 0x7f00700d49f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f00640097a0 tx=0x7f006402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ba666ad84ccc57 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:12.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.627+0000 7f006d59a640 1 -- 172.21.15.82:0/1576677302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064037070 con 0x7f00700d0e00 2024-06-02T22:54:12.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.627+0000 7f006d59a640 1 -- 172.21.15.82:0/1576677302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006402adf0 con 0x7f00700d0e00 2024-06-02T22:54:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.627+0000 7f006d59a640 1 -- 172.21.15.82:0/1576677302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064032660 con 0x7f00700d0e00 2024-06-02T22:54:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.628+0000 7f0074a72640 1 -- 172.21.15.82:0/1576677302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00700d0e00 msgr2=0x7f00700d49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.628+0000 7f0074a72640 1 --2- 172.21.15.82:0/1576677302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00700d0e00 0x7f00700d49f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f00640097a0 tx=0x7f006402a160 comp rx=0 tx=0).stop 2024-06-02T22:54:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.628+0000 7f0074a72640 1 -- 172.21.15.82:0/1576677302 shutdown_connections 2024-06-02T22:54:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.628+0000 7f0074a72640 1 --2- 172.21.15.82:0/1576677302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00700d0e00 0x7f00700d49f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.628+0000 7f0074a72640 1 -- 172.21.15.82:0/1576677302 >> 172.21.15.82:0/1576677302 conn(0x7f007009d400 msgr2=0x7f00700d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.628+0000 7f0074a72640 1 -- 172.21.15.82:0/1576677302 shutdown_connections 2024-06-02T22:54:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.628+0000 7f0074a72640 1 -- 172.21.15.82:0/1576677302 wait complete. 2024-06-02T22:54:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.629+0000 7f0074a72640 1 Processor -- start 2024-06-02T22:54:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.630+0000 7f0074a72640 1 -- start start 2024-06-02T22:54:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.630+0000 7f0074a72640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00700d0e00 0x7f0070153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.630+0000 7f0074a72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00700d1f30 0x7f00700c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.630+0000 7f0074a72640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007015e670 0x7f00700ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.630+0000 7f0074a72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f007015f530 con 0x7f00700d1f30 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.630+0000 7f0074a72640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f007015ea50 con 0x7f007015e670 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.630+0000 7f0074a72640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f00700cf2e0 con 0x7f00700d0e00 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.630+0000 7f006dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00700d1f30 0x7f00700c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.630+0000 7f006dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00700d1f30 0x7f00700c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33116/0 (socket says 172.21.15.82:33116) 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.630+0000 7f006dd9b640 1 -- 172.21.15.82:0/2618324778 learned_addr learned my addr 172.21.15.82:0/2618324778 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.631+0000 7f006dd9b640 1 -- 172.21.15.82:0/2618324778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00700d0e00 msgr2=0x7f0070153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.631+0000 7f006dd9b640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00700d0e00 0x7f0070153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.631+0000 7f006dd9b640 1 -- 172.21.15.82:0/2618324778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007015e670 msgr2=0x7f00700ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.631+0000 7f006dd9b640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007015e670 0x7f00700ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.631+0000 7f006dd9b640 1 -- 172.21.15.82:0/2618324778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00700caae0 con 0x7f00700d1f30 2024-06-02T22:54:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.631+0000 7f006dd9b640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00700d1f30 0x7f00700c9120 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0064035040 tx=0x7f00640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.631+0000 7f005effd640 1 -- 172.21.15.82:0/2618324778 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064037040 con 0x7f00700d1f30 2024-06-02T22:54:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.631+0000 7f005effd640 1 -- 172.21.15.82:0/2618324778 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0064004030 con 0x7f00700d1f30 2024-06-02T22:54:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.631+0000 7f0074a72640 1 -- 172.21.15.82:0/2618324778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00700c8080 con 0x7f00700d1f30 2024-06-02T22:54:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.631+0000 7f005effd640 1 -- 172.21.15.82:0/2618324778 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064004420 con 0x7f00700d1f30 2024-06-02T22:54:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.631+0000 7f0074a72640 1 -- 172.21.15.82:0/2618324778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00700c8640 con 0x7f00700d1f30 2024-06-02T22:54:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.632+0000 7f0074a72640 1 -- 172.21.15.82:0/2618324778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0070068540 con 0x7f00700d1f30 2024-06-02T22:54:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.632+0000 7f005effd640 1 -- 172.21.15.82:0/2618324778 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f006403a040 con 0x7f00700d1f30 2024-06-02T22:54:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.633+0000 7f005effd640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f005006be60 0x7f005006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.633+0000 7f006e59c640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f005006be60 0x7f005006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.633+0000 7f005effd640 1 -- 172.21.15.82:0/2618324778 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f00640ab980 con 0x7f00700d1f30 2024-06-02T22:54:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.633+0000 7f006e59c640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f005006be60 0x7f005006e320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f006000ab90 tx=0x7f0060009230 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:12.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.637+0000 7f005effd640 1 -- 172.21.15.82:0/2618324778 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0064042070 con 0x7f00700d1f30 2024-06-02T22:54:12.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:12.816+0000 7f0074a72640 1 -- 172.21.15.82:0/2618324778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0070068540 con 0x7f00700d1f30 2024-06-02T22:54:13.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.696+0000 7f005effd640 1 -- 172.21.15.82:0/2618324778 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) ==== 181+0+0 (secure 0 0 0) 0x7f006407a270 con 0x7f00700d1f30 2024-06-02T22:54:13.699 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2024-06-02T22:54:13.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.700+0000 7f0074a72640 1 -- 172.21.15.82:0/2618324778 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f005006be60 msgr2=0x7f005006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:13.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.700+0000 7f0074a72640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f005006be60 0x7f005006e320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f006000ab90 tx=0x7f0060009230 comp rx=0 tx=0).stop 2024-06-02T22:54:13.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.700+0000 7f0074a72640 1 -- 172.21.15.82:0/2618324778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00700d1f30 msgr2=0x7f00700c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:13.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.700+0000 7f0074a72640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00700d1f30 0x7f00700c9120 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0064035040 tx=0x7f00640046c0 comp rx=0 tx=0).stop 2024-06-02T22:54:13.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.700+0000 7f0074a72640 1 -- 172.21.15.82:0/2618324778 shutdown_connections 2024-06-02T22:54:13.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.700+0000 7f0074a72640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f005006be60 0x7f005006e320 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:13.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.700+0000 7f0074a72640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007015e670 0x7f00700ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:13.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.700+0000 7f0074a72640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00700d1f30 0x7f00700c9120 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:13.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.700+0000 7f0074a72640 1 --2- 172.21.15.82:0/2618324778 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00700d0e00 0x7f0070153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:13.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.700+0000 7f0074a72640 1 -- 172.21.15.82:0/2618324778 >> 172.21.15.82:0/2618324778 conn(0x7f007009d400 msgr2=0x7f007006c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:13.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.701+0000 7f0074a72640 1 -- 172.21.15.82:0/2618324778 shutdown_connections 2024-06-02T22:54:13.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.701+0000 7f0074a72640 1 -- 172.21.15.82:0/2618324778 wait complete. 2024-06-02T22:54:13.715 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-02T22:54:13.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.825+0000 7ff49743f640 1 Processor -- start 2024-06-02T22:54:13.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.825+0000 7ff49743f640 1 -- start start 2024-06-02T22:54:13.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.826+0000 7ff49743f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff49015e670 0x7ff4900d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.826+0000 7ff49743f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900d1f30 0x7ff4900d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.826+0000 7ff49743f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff49015ec90 con 0x7ff4900d0c30 2024-06-02T22:54:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.826+0000 7ff49743f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff49015fa50 con 0x7ff49015e670 2024-06-02T22:54:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.826+0000 7ff49743f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff4900d1090 con 0x7ff4900d1f30 2024-06-02T22:54:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.826+0000 7ff4951db640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff49015e670 0x7ff4900d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.826+0000 7ff4951db640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff49015e670 0x7ff4900d49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33122/0 (socket says 172.21.15.82:33122) 2024-06-02T22:54:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.826+0000 7ff4951db640 1 -- 172.21.15.82:0/1704721519 learned_addr learned my addr 172.21.15.82:0/1704721519 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.827+0000 7ff4951db640 1 -- 172.21.15.82:0/1704721519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900d1f30 msgr2=0x7ff4900d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.827+0000 7ff4951db640 1 --2- 172.21.15.82:0/1704721519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900d1f30 0x7ff4900d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.827+0000 7ff4951db640 1 -- 172.21.15.82:0/1704721519 >> v1:172.21.15.184:6789/0 conn(0x7ff4900d0c30 legacy=0x7ff490162010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.827+0000 7ff4951db640 1 -- 172.21.15.82:0/1704721519 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49015ef70 con 0x7ff49015e670 2024-06-02T22:54:13.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.827+0000 7ff4951db640 1 --2- 172.21.15.82:0/1704721519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff49015e670 0x7ff4900d49f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff480009870 tx=0x7ff48002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778255cbbd95f3cd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:13.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.828+0000 7ff48ffff640 1 -- 172.21.15.82:0/1704721519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff480037070 con 0x7ff49015e670 2024-06-02T22:54:13.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.828+0000 7ff48ffff640 1 -- 172.21.15.82:0/1704721519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff480032440 con 0x7ff49015e670 2024-06-02T22:54:13.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.828+0000 7ff48ffff640 1 -- 172.21.15.82:0/1704721519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff480032810 con 0x7ff49015e670 2024-06-02T22:54:13.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.828+0000 7ff49743f640 1 -- 172.21.15.82:0/1704721519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff49015e670 msgr2=0x7ff4900d49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:13.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.828+0000 7ff49743f640 1 --2- 172.21.15.82:0/1704721519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff49015e670 0x7ff4900d49f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff480009870 tx=0x7ff48002a2a0 comp rx=0 tx=0).stop 2024-06-02T22:54:13.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.828+0000 7ff49743f640 1 -- 172.21.15.82:0/1704721519 shutdown_connections 2024-06-02T22:54:13.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.828+0000 7ff49743f640 1 --2- 172.21.15.82:0/1704721519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900d1f30 0x7ff4900d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:13.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.828+0000 7ff49743f640 1 --2- 172.21.15.82:0/1704721519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff49015e670 0x7ff4900d49f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:13.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.828+0000 7ff49743f640 1 -- 172.21.15.82:0/1704721519 >> 172.21.15.82:0/1704721519 conn(0x7ff49009d400 msgr2=0x7ff4900d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:13.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.828+0000 7ff49743f640 1 -- 172.21.15.82:0/1704721519 shutdown_connections 2024-06-02T22:54:13.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.828+0000 7ff49743f640 1 -- 172.21.15.82:0/1704721519 wait complete. 2024-06-02T22:54:13.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.829+0000 7ff49743f640 1 Processor -- start 2024-06-02T22:54:13.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.829+0000 7ff49743f640 1 -- start start 2024-06-02T22:54:13.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.830+0000 7ff49743f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900d0c30 0x7ff4900cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:13.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.830+0000 7ff49743f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4900d1f30 0x7ff4901e8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:13.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.830+0000 7ff49743f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff49015e670 0x7ff4901e93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.830+0000 7ff49743f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff49015f530 con 0x7ff4900d1f30 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.830+0000 7ff49743f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff49015ea50 con 0x7ff49015e670 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.830+0000 7ff49743f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff4900d2370 con 0x7ff4900d0c30 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.830+0000 7ff4949da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4900d1f30 0x7ff4901e8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.830+0000 7ff4949da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4900d1f30 0x7ff4901e8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33134/0 (socket says 172.21.15.82:33134) 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.830+0000 7ff4949da640 1 -- 172.21.15.82:0/655289421 learned_addr learned my addr 172.21.15.82:0/655289421 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.830+0000 7ff4949da640 1 -- 172.21.15.82:0/655289421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900d0c30 msgr2=0x7ff4900cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.830+0000 7ff4949da640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900d0c30 0x7ff4900cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.831+0000 7ff4949da640 1 -- 172.21.15.82:0/655289421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff49015e670 msgr2=0x7ff4901e93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.831+0000 7ff4949da640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff49015e670 0x7ff4901e93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.831+0000 7ff4949da640 1 -- 172.21.15.82:0/655289421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49015bed0 con 0x7ff4900d1f30 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.831+0000 7ff4949da640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4900d1f30 0x7ff4901e8e60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff48400b4d0 tx=0x7ff48400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:13.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.831+0000 7ff48dffb640 1 -- 172.21.15.82:0/655289421 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484014070 con 0x7ff4900d1f30 2024-06-02T22:54:13.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.831+0000 7ff48dffb640 1 -- 172.21.15.82:0/655289421 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff484010870 con 0x7ff4900d1f30 2024-06-02T22:54:13.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.831+0000 7ff49743f640 1 -- 172.21.15.82:0/655289421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4901e9a40 con 0x7ff4900d1f30 2024-06-02T22:54:13.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.831+0000 7ff48dffb640 1 -- 172.21.15.82:0/655289421 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484010c60 con 0x7ff4900d1f30 2024-06-02T22:54:13.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.831+0000 7ff49743f640 1 -- 172.21.15.82:0/655289421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4901ea000 con 0x7ff4900d1f30 2024-06-02T22:54:13.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.832+0000 7ff49743f640 1 -- 172.21.15.82:0/655289421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff490068540 con 0x7ff4900d1f30 2024-06-02T22:54:13.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.832+0000 7ff48dffb640 1 -- 172.21.15.82:0/655289421 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff484017070 con 0x7ff4900d1f30 2024-06-02T22:54:13.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.833+0000 7ff48dffb640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff47c06be30 0x7ff47c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:13.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.833+0000 7ff4951db640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff47c06be30 0x7ff47c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:13.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.833+0000 7ff48dffb640 1 -- 172.21.15.82:0/655289421 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5749+0+0 (secure 0 0 0) 0x7ff48408abc0 con 0x7ff4900d1f30 2024-06-02T22:54:13.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.833+0000 7ff4951db640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff47c06be30 0x7ff47c06e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff480034000 tx=0x7ff48002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:13.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:13.837+0000 7ff48dffb640 1 -- 172.21.15.82:0/655289421 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff49015bed0 con 0x7ff4900d1f30 2024-06-02T22:54:14.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.013+0000 7ff49743f640 1 -- 172.21.15.82:0/655289421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff4900d47d0 con 0x7ff4900d1f30 2024-06-02T22:54:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.707+0000 7ff48dffb640 1 -- 172.21.15.82:0/655289421 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) ==== 169+0+0 (secure 0 0 0) 0x7ff4840595d0 con 0x7ff4900d1f30 2024-06-02T22:54:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2024-06-02T22:54:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.710+0000 7ff49743f640 1 -- 172.21.15.82:0/655289421 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff47c06be30 msgr2=0x7ff47c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.710+0000 7ff49743f640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff47c06be30 0x7ff47c06e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff480034000 tx=0x7ff48002c000 comp rx=0 tx=0).stop 2024-06-02T22:54:14.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.711+0000 7ff49743f640 1 -- 172.21.15.82:0/655289421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4900d1f30 msgr2=0x7ff4901e8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:14.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.711+0000 7ff49743f640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4900d1f30 0x7ff4901e8e60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff48400b4d0 tx=0x7ff48400b990 comp rx=0 tx=0).stop 2024-06-02T22:54:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.712+0000 7ff49743f640 1 -- 172.21.15.82:0/655289421 shutdown_connections 2024-06-02T22:54:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.712+0000 7ff49743f640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff47c06be30 0x7ff47c06e2f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.712+0000 7ff49743f640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff49015e670 0x7ff4901e93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.712+0000 7ff49743f640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4900d1f30 0x7ff4901e8e60 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.712+0000 7ff49743f640 1 --2- 172.21.15.82:0/655289421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900d0c30 0x7ff4900cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.712+0000 7ff49743f640 1 -- 172.21.15.82:0/655289421 >> 172.21.15.82:0/655289421 conn(0x7ff49009d400 msgr2=0x7ff49006d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.712+0000 7ff49743f640 1 -- 172.21.15.82:0/655289421 shutdown_connections 2024-06-02T22:54:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.712+0000 7ff49743f640 1 -- 172.21.15.82:0/655289421 wait complete. 2024-06-02T22:54:14.727 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-02T22:54:14.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.840+0000 7fbb6a3dc640 1 Processor -- start 2024-06-02T22:54:14.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.840+0000 7fbb6a3dc640 1 -- start start 2024-06-02T22:54:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.841+0000 7fbb6a3dc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb64155320 0x7fbb640b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.841+0000 7fbb6a3dc640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbb640b34e0 0x7fbb640d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.841+0000 7fbb6a3dc640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb64155700 con 0x7fbb640d0630 2024-06-02T22:54:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.841+0000 7fbb6a3dc640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fbb6415b6b0 con 0x7fbb640b34e0 2024-06-02T22:54:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.841+0000 7fbb6a3dc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbb6415b990 con 0x7fbb64155320 2024-06-02T22:54:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.841+0000 7fbb68979640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbb640d0630 0x7fbb6406e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48414/0 (socket says 172.21.15.82:48414) 2024-06-02T22:54:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.841+0000 7fbb68979640 1 -- 172.21.15.82:0/343894689 learned_addr learned my addr 172.21.15.82:0/343894689 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335325802 0 0) 0x7fbb64155700 con 0x7fbb640d0630 2024-06-02T22:54:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb637fe640 1 --2- 172.21.15.82:0/343894689 >> v2:172.21.15.184:3300/0 conn(0x7fbb640b34e0 0x7fbb640d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:14.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb4c003520 con 0x7fbb640d0630 2024-06-02T22:54:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb63fff640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb64155320 0x7fbb640b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 106292236 0 0) 0x7fbb4c003520 con 0x7fbb640d0630 2024-06-02T22:54:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb64155320 msgr2=0x7fbb640b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb64155320 0x7fbb640b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 >> v2:172.21.15.184:3300/0 conn(0x7fbb640b34e0 msgr2=0x7fbb640d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 --2- 172.21.15.82:0/343894689 >> v2:172.21.15.184:3300/0 conn(0x7fbb640b34e0 0x7fbb640d00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6415bc70 con 0x7fbb640d0630 2024-06-02T22:54:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7fbb5c0019f0 con 0x7fbb640d0630 2024-06-02T22:54:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 >> v1:172.21.15.82:6789/0 conn(0x7fbb640d0630 legacy=0x7fbb6406e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb64155320 0x7fbb4c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:14.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb4c003f30 0x7fbb4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:14.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb4c004d40 0x7fbb4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:14.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6415b6b0 con 0x7fbb4c003f30 2024-06-02T22:54:14.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6415b990 con 0x7fbb4c004d40 2024-06-02T22:54:14.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4c00b9c0 con 0x7fbb64155320 2024-06-02T22:54:14.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb637fe640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb4c003f30 0x7fbb4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:14.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb68979640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb4c004d40 0x7fbb4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:14.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb63fff640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb64155320 0x7fbb4c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb637fe640 1 -- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb64155320 msgr2=0x7fbb4c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb637fe640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb64155320 0x7fbb4c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb637fe640 1 -- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb4c004d40 msgr2=0x7fbb4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb637fe640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb4c004d40 0x7fbb4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb637fe640 1 -- 172.21.15.82:0/343894689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c003520 con 0x7fbb4c003f30 2024-06-02T22:54:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb63fff640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb64155320 0x7fbb4c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.842+0000 7fbb68979640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb4c004d40 0x7fbb4c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.843+0000 7fbb637fe640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb4c003f30 0x7fbb4c004800 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009ac0 tx=0x7fbb4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2270297f59d4bde server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.843+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58038070 con 0x7fbb4c003f30 2024-06-02T22:54:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.843+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb58033400 con 0x7fbb4c003f30 2024-06-02T22:54:14.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.843+0000 7fbb62ffd640 1 -- 172.21.15.82:0/343894689 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58009690 con 0x7fbb4c003f30 2024-06-02T22:54:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.844+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/343894689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb4c003f30 msgr2=0x7fbb4c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.844+0000 7fbb6a3dc640 1 --2- 172.21.15.82:0/343894689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb4c003f30 0x7fbb4c004800 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009ac0 tx=0x7fbb4c005830 comp rx=0 tx=0).stop 2024-06-02T22:54:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.844+0000 7fbb68979640 1 -- 172.21.15.82:0/343894689 reap_dead start 2024-06-02T22:54:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.844+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/343894689 shutdown_connections 2024-06-02T22:54:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.844+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/343894689 >> 172.21.15.82:0/343894689 conn(0x7fbb640b1d10 msgr2=0x7fbb640b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.844+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/343894689 shutdown_connections 2024-06-02T22:54:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.844+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/343894689 wait complete. 2024-06-02T22:54:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.845+0000 7fbb6a3dc640 1 Processor -- start 2024-06-02T22:54:14.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.845+0000 7fbb6a3dc640 1 -- start start 2024-06-02T22:54:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb6a3dc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb4c003f30 0x7fbb6415cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb6a3dc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb640b07e0 0x7fbb6409c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb6a3dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb64148250 0x7fbb64159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:14.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb6a3dc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6415b470 con 0x7fbb64148250 2024-06-02T22:54:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb6a3dc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6415b2f0 con 0x7fbb640b07e0 2024-06-02T22:54:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb6a3dc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fbb640b2fa0 con 0x7fbb4c003f30 2024-06-02T22:54:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb68979640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb64148250 0x7fbb64159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb68979640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb64148250 0x7fbb64159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33150/0 (socket says 172.21.15.82:33150) 2024-06-02T22:54:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb68979640 1 -- 172.21.15.82:0/1084434443 learned_addr learned my addr 172.21.15.82:0/1084434443 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb637fe640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb640b07e0 0x7fbb6409c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb63fff640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb4c003f30 0x7fbb6415cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb68979640 1 -- 172.21.15.82:0/1084434443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb4c003f30 msgr2=0x7fbb6415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb68979640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb4c003f30 0x7fbb6415cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:14.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb68979640 1 -- 172.21.15.82:0/1084434443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb640b07e0 msgr2=0x7fbb6409c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:14.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb68979640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb640b07e0 0x7fbb6409c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:14.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb68979640 1 -- 172.21.15.82:0/1084434443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb641486d0 con 0x7fbb64148250 2024-06-02T22:54:14.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb637fe640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb640b07e0 0x7fbb6409c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:14.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb68979640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb64148250 0x7fbb64159ed0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbb6415bb10 tx=0x7fbb5c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:14.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb60ff9640 1 -- 172.21.15.82:0/1084434443 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c00eda0 con 0x7fbb64148250 2024-06-02T22:54:14.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb60ff9640 1 -- 172.21.15.82:0/1084434443 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb5c018070 con 0x7fbb64148250 2024-06-02T22:54:14.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb60ff9640 1 -- 172.21.15.82:0/1084434443 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c013660 con 0x7fbb64148250 2024-06-02T22:54:14.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/1084434443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb64156d60 con 0x7fbb64148250 2024-06-02T22:54:14.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.846+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/1084434443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb64157320 con 0x7fbb64148250 2024-06-02T22:54:14.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.847+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/1084434443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb640683c0 con 0x7fbb64148250 2024-06-02T22:54:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.848+0000 7fbb60ff9640 1 -- 172.21.15.82:0/1084434443 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb5c013800 con 0x7fbb64148250 2024-06-02T22:54:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.848+0000 7fbb60ff9640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb5006be60 0x7fbb5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.849+0000 7fbb63fff640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb5006be60 0x7fbb5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.849+0000 7fbb60ff9640 1 -- 172.21.15.82:0/1084434443 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fbb5c08aff0 con 0x7fbb64148250 2024-06-02T22:54:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.849+0000 7fbb63fff640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb5006be60 0x7fbb5006e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbb6415f970 tx=0x7fbb54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:14.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:14.853+0000 7fbb60ff9640 1 -- 172.21.15.82:0/1084434443 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbb5c059b10 con 0x7fbb64148250 2024-06-02T22:54:15.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.026+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/1084434443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbb640b0bc0 con 0x7fbb64148250 2024-06-02T22:54:15.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.030+0000 7fbb60ff9640 1 -- 172.21.15.82:0/1084434443 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fbb5c059410 con 0x7fbb64148250 2024-06-02T22:54:15.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/1084434443 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb5006be60 msgr2=0x7fbb5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:15.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb5006be60 0x7fbb5006e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbb6415f970 tx=0x7fbb54008040 comp rx=0 tx=0).stop 2024-06-02T22:54:15.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/1084434443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb64148250 msgr2=0x7fbb64159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:15.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb64148250 0x7fbb64159ed0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbb6415bb10 tx=0x7fbb5c00e530 comp rx=0 tx=0).stop 2024-06-02T22:54:15.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/1084434443 shutdown_connections 2024-06-02T22:54:15.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fbb5006be60 0x7fbb5006e320 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb64148250 0x7fbb64159ed0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb640b07e0 0x7fbb6409c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 --2- 172.21.15.82:0/1084434443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb4c003f30 0x7fbb6415cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/1084434443 >> 172.21.15.82:0/1084434443 conn(0x7fbb640b1d10 msgr2=0x7fbb64072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:15.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/1084434443 shutdown_connections 2024-06-02T22:54:15.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.032+0000 7fbb6a3dc640 1 -- 172.21.15.82:0/1084434443 wait complete. 2024-06-02T22:54:15.043 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-06-02T22:54:15.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.142+0000 7fdd42116640 1 Processor -- start 2024-06-02T22:54:15.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.142+0000 7fdd42116640 1 -- start start 2024-06-02T22:54:15.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd42116640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd3c1553c0 0x7fdd3c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:15.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd42116640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdd3c0cec50 0x7fdd3c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd42116640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd3c0b31a0 con 0x7fdd3c0b2cf0 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd42116640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fdd3c0b3420 con 0x7fdd3c1553c0 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd42116640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fdd3c0cc750 con 0x7fdd3c0cec50 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd3b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd3c1553c0 0x7fdd3c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd3b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd3c1553c0 0x7fdd3c0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33156/0 (socket says 172.21.15.82:33156) 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd3b7fe640 1 -- 172.21.15.82:0/2009525671 learned_addr learned my addr 172.21.15.82:0/2009525671 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd3bfff640 1 --2- 172.21.15.82:0/2009525671 >> v2:172.21.15.184:3300/0 conn(0x7fdd3c0cec50 0x7fdd3c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd3b7fe640 1 -- 172.21.15.82:0/2009525671 >> v2:172.21.15.184:3300/0 conn(0x7fdd3c0cec50 msgr2=0x7fdd3c0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd3b7fe640 1 --2- 172.21.15.82:0/2009525671 >> v2:172.21.15.184:3300/0 conn(0x7fdd3c0cec50 0x7fdd3c0cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd3b7fe640 1 -- 172.21.15.82:0/2009525671 >> v1:172.21.15.184:6789/0 conn(0x7fdd3c0b2cf0 legacy=0x7fdd3c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd3b7fe640 1 -- 172.21.15.82:0/2009525671 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3c0cca30 con 0x7fdd3c1553c0 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.143+0000 7fdd3bfff640 1 --2- 172.21.15.82:0/2009525671 >> v2:172.21.15.184:3300/0 conn(0x7fdd3c0cec50 0x7fdd3c0cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:54:15.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.144+0000 7fdd3b7fe640 1 --2- 172.21.15.82:0/2009525671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c1553c0 0x7fdd3c0cd230 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00bb10 tx=0x7fdd2c02c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47d0816074a4e46 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:15.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.144+0000 7fdd3a7fc640 1 -- 172.21.15.82:0/2009525671 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c02f070 con 0x7fdd3c1553c0 2024-06-02T22:54:15.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.144+0000 7fdd3a7fc640 1 -- 172.21.15.82:0/2009525671 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd2c038070 con 0x7fdd3c1553c0 2024-06-02T22:54:15.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.144+0000 7fdd3a7fc640 1 -- 172.21.15.82:0/2009525671 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c032a00 con 0x7fdd3c1553c0 2024-06-02T22:54:15.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.145+0000 7fdd42116640 1 -- 172.21.15.82:0/2009525671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c1553c0 msgr2=0x7fdd3c0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:15.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.145+0000 7fdd42116640 1 --2- 172.21.15.82:0/2009525671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c1553c0 0x7fdd3c0cd230 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00bb10 tx=0x7fdd2c02c920 comp rx=0 tx=0).stop 2024-06-02T22:54:15.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.145+0000 7fdd42116640 1 -- 172.21.15.82:0/2009525671 shutdown_connections 2024-06-02T22:54:15.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.145+0000 7fdd42116640 1 --2- 172.21.15.82:0/2009525671 >> v2:172.21.15.184:3300/0 conn(0x7fdd3c0cec50 0x7fdd3c0cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.145+0000 7fdd42116640 1 --2- 172.21.15.82:0/2009525671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c1553c0 0x7fdd3c0cd230 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.145+0000 7fdd42116640 1 -- 172.21.15.82:0/2009525671 >> 172.21.15.82:0/2009525671 conn(0x7fdd3c0b19f0 msgr2=0x7fdd3c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:15.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.145+0000 7fdd42116640 1 -- 172.21.15.82:0/2009525671 shutdown_connections 2024-06-02T22:54:15.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.145+0000 7fdd42116640 1 -- 172.21.15.82:0/2009525671 wait complete. 2024-06-02T22:54:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.146+0000 7fdd42116640 1 Processor -- start 2024-06-02T22:54:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.146+0000 7fdd42116640 1 -- start start 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd42116640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd3c0b2cf0 0x7fdd3c15e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd42116640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd3c0cec50 0x7fdd3c159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd42116640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c1553c0 0x7fdd3c15a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd42116640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c1557a0 con 0x7fdd3c1553c0 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd42116640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c0b3700 con 0x7fdd3c0cec50 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd42116640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3c155920 con 0x7fdd3c0b2cf0 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c1553c0 0x7fdd3c15a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c1553c0 0x7fdd3c15a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33170/0 (socket says 172.21.15.82:33170) 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3bfff640 1 -- 172.21.15.82:0/2978701663 learned_addr learned my addr 172.21.15.82:0/2978701663 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3b7fe640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd3c0b2cf0 0x7fdd3c15e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3affd640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd3c0cec50 0x7fdd3c159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3bfff640 1 -- 172.21.15.82:0/2978701663 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd3c0b2cf0 msgr2=0x7fdd3c15e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:15.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3bfff640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd3c0b2cf0 0x7fdd3c15e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3bfff640 1 -- 172.21.15.82:0/2978701663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd3c0cec50 msgr2=0x7fdd3c159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3bfff640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd3c0cec50 0x7fdd3c159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3bfff640 1 -- 172.21.15.82:0/2978701663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3c1f4330 con 0x7fdd3c1553c0 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3affd640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd3c0cec50 0x7fdd3c159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3b7fe640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd3c0b2cf0 0x7fdd3c15e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd3bfff640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c1553c0 0x7fdd3c15a480 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400cef0 tx=0x7fdd3400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd23fff640 1 -- 172.21.15.82:0/2978701663 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3401a070 con 0x7fdd3c1553c0 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd23fff640 1 -- 172.21.15.82:0/2978701663 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3400d860 con 0x7fdd3c1553c0 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.147+0000 7fdd23fff640 1 -- 172.21.15.82:0/2978701663 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400dc50 con 0x7fdd3c1553c0 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.148+0000 7fdd42116640 1 -- 172.21.15.82:0/2978701663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3c1f4610 con 0x7fdd3c1553c0 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.148+0000 7fdd42116640 1 -- 172.21.15.82:0/2978701663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd3c1f4bd0 con 0x7fdd3c1553c0 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.148+0000 7fdd42116640 1 -- 172.21.15.82:0/2978701663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3c0b4fe0 con 0x7fdd3c1553c0 2024-06-02T22:54:15.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.149+0000 7fdd23fff640 1 -- 172.21.15.82:0/2978701663 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd3401d070 con 0x7fdd3c1553c0 2024-06-02T22:54:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.149+0000 7fdd23fff640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdd2806be30 0x7fdd2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.149+0000 7fdd23fff640 1 -- 172.21.15.82:0/2978701663 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fdd3408b5d0 con 0x7fdd3c1553c0 2024-06-02T22:54:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.149+0000 7fdd3b7fe640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdd2806be30 0x7fdd2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.150+0000 7fdd3b7fe640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdd2806be30 0x7fdd2806e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c037000 tx=0x7fdd2c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.154+0000 7fdd23fff640 1 -- 172.21.15.82:0/2978701663 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdd3c0b4fe0 con 0x7fdd3c1553c0 2024-06-02T22:54:15.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.398+0000 7fdd42116640 1 -- 172.21.15.82:0/2978701663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) -- 0x7fdd3c0717b0 con 0x7fdd3c1553c0 2024-06-02T22:54:15.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.708+0000 7fdd23fff640 1 -- 172.21.15.82:0/2978701663 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v136) ==== 134+0+0 (secure 0 0 0) 0x7fdd3405a1b0 con 0x7fdd3c1553c0 2024-06-02T22:54:15.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 -- 172.21.15.82:0/2978701663 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdd2806be30 msgr2=0x7fdd2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:15.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdd2806be30 0x7fdd2806e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c037000 tx=0x7fdd2c032000 comp rx=0 tx=0).stop 2024-06-02T22:54:15.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 -- 172.21.15.82:0/2978701663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c1553c0 msgr2=0x7fdd3c15a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c1553c0 0x7fdd3c15a480 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400cef0 tx=0x7fdd3400a710 comp rx=0 tx=0).stop 2024-06-02T22:54:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 -- 172.21.15.82:0/2978701663 shutdown_connections 2024-06-02T22:54:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fdd2806be30 0x7fdd2806e2f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c1553c0 0x7fdd3c15a480 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd3c0cec50 0x7fdd3c159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 --2- 172.21.15.82:0/2978701663 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd3c0b2cf0 0x7fdd3c15e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 -- 172.21.15.82:0/2978701663 >> 172.21.15.82:0/2978701663 conn(0x7fdd3c0b19f0 msgr2=0x7fdd3c071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 -- 172.21.15.82:0/2978701663 shutdown_connections 2024-06-02T22:54:15.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:15.710+0000 7fdd42116640 1 -- 172.21.15.82:0/2978701663 wait complete. 2024-06-02T22:54:15.723 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2024-06-02T22:54:15.723 INFO:tasks.cephfs_test_runner: 2024-06-02T22:54:15.723 INFO:tasks.cephfs_test_runner:====================================================================== 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/mount.py", line 766, in run_python 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner: p.wait() 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner: 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-06-02T22:54:15.724 INFO:tasks.cephfs_test_runner:Ran 2 tests in 96.763s 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner: 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner: 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner:====================================================================== 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/mount.py", line 766, in run_python 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner: p.wait() 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-06-02T22:54:15.725 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-06-02T22:54:15.726 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-06-02T22:54:15.726 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2024-06-02T22:54:15.726 INFO:tasks.cephfs_test_runner: 2024-06-02T22:54:15.726 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-06-02T22:54:15.950 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7f41f15c1d6a4e8aaa535ac93f8acdf0 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-06-02T22:54:15.952 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-06-02T22:54:15.963 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-06-02T22:54:16.028 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-06-02T22:54:16.028 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:54:16.029 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:54:16.052 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17664 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T22:54:16.052 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-02T22:54:16.052 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:54:16.109 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056317,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17664 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497608k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T22:54:16.109 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:54:16.109 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:54:16.129 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14652 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T22:54:16.129 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-02T22:54:16.129 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:54:16.187 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056335,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14652 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497640k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T22:54:16.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:16.187 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2024-06-02T22:54:16.245 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-06-02T22:54:16.246 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-06-02T22:54:16.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:16.246 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T22:54:16.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:16.315 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T22:54:16.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:16.384 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2024-06-02T22:54:16.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:16.472 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-02T22:54:16.488 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T22:54:16.488 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T22:54:16.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:16.489 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T22:54:16.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:16.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T22:54:16.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:54:16.621 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-06-02T22:54:16.725 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-06-02T22:54:16.733 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T22:54:16.733 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:54:16.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.834+0000 7fd019cd2640 1 Processor -- start 2024-06-02T22:54:16.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.834+0000 7fd019cd2640 1 -- start start 2024-06-02T22:54:16.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.835+0000 7fd019cd2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 0x7fd0140ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:16.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.835+0000 7fd019cd2640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd014071c60 0x7fd0140720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:16.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.835+0000 7fd019cd2640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0140ccff0 con 0x7fd0140b36c0 2024-06-02T22:54:16.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.835+0000 7fd019cd2640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fd014072820 con 0x7fd014071c60 2024-06-02T22:54:16.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.835+0000 7fd019cd2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd014072b00 con 0x7fd0140cc6d0 2024-06-02T22:54:16.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.835+0000 7fd012ffd640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd014071c60 0x7fd0140720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:16.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.835+0000 7fd0137fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 0x7fd0140ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:16.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.835+0000 7fd0137fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 0x7fd0140ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.82:45356/0 (socket says 172.21.15.82:45356) 2024-06-02T22:54:16.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.835+0000 7fd0137fe640 1 -- 172.21.15.82:0/3901109041 learned_addr learned my addr 172.21.15.82:0/3901109041 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:16.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.836+0000 7fd012ffd640 1 -- 172.21.15.82:0/3901109041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 msgr2=0x7fd0140ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:16.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.836+0000 7fd012ffd640 1 --2- 172.21.15.82:0/3901109041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 0x7fd0140ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:16.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.836+0000 7fd012ffd640 1 -- 172.21.15.82:0/3901109041 >> v1:172.21.15.184:6789/0 conn(0x7fd0140b36c0 legacy=0x7fd0140b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:16.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.836+0000 7fd0127fc640 1 -- 172.21.15.82:0/3901109041 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178172646 0 0) 0x7fd0140ccff0 con 0x7fd0140b36c0 2024-06-02T22:54:16.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.836+0000 7fd012ffd640 1 -- 172.21.15.82:0/3901109041 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd014072de0 con 0x7fd014071c60 2024-06-02T22:54:16.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.836+0000 7fd0137fe640 1 --2- 172.21.15.82:0/3901109041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 0x7fd0140ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:54:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.836+0000 7fd012ffd640 1 --2- 172.21.15.82:0/3901109041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd014071c60 0x7fd0140720e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd008009d90 tx=0x7fd00802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a3d3461e7b438e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.837+0000 7fd0127fc640 1 -- 172.21.15.82:0/3901109041 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008007740 con 0x7fd014071c60 2024-06-02T22:54:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.837+0000 7fd0127fc640 1 -- 172.21.15.82:0/3901109041 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0080078e0 con 0x7fd014071c60 2024-06-02T22:54:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.837+0000 7fd0127fc640 1 -- 172.21.15.82:0/3901109041 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008007cb0 con 0x7fd014071c60 2024-06-02T22:54:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.837+0000 7fd019cd2640 1 -- 172.21.15.82:0/3901109041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd014071c60 msgr2=0x7fd0140720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.837+0000 7fd019cd2640 1 --2- 172.21.15.82:0/3901109041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd014071c60 0x7fd0140720e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd008009d90 tx=0x7fd00802a660 comp rx=0 tx=0).stop 2024-06-02T22:54:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.837+0000 7fd019cd2640 1 -- 172.21.15.82:0/3901109041 shutdown_connections 2024-06-02T22:54:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.837+0000 7fd019cd2640 1 --2- 172.21.15.82:0/3901109041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd014071c60 0x7fd0140720e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.837+0000 7fd019cd2640 1 --2- 172.21.15.82:0/3901109041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 0x7fd0140ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.837+0000 7fd019cd2640 1 -- 172.21.15.82:0/3901109041 >> 172.21.15.82:0/3901109041 conn(0x7fd0140b19f0 msgr2=0x7fd0140b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.837+0000 7fd019cd2640 1 -- 172.21.15.82:0/3901109041 shutdown_connections 2024-06-02T22:54:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.837+0000 7fd019cd2640 1 -- 172.21.15.82:0/3901109041 wait complete. 2024-06-02T22:54:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.838+0000 7fd019cd2640 1 Processor -- start 2024-06-02T22:54:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.839+0000 7fd019cd2640 1 -- start start 2024-06-02T22:54:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.839+0000 7fd019cd2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd014071c60 0x7fd01406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.839+0000 7fd019cd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0140b36c0 0x7fd01415ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.839+0000 7fd019cd2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 0x7fd01415f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.839+0000 7fd019cd2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd014159f60 con 0x7fd0140b36c0 2024-06-02T22:54:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.839+0000 7fd019cd2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd01415c890 con 0x7fd014071c60 2024-06-02T22:54:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.839+0000 7fd019cd2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fd0140b4240 con 0x7fd0140cc6d0 2024-06-02T22:54:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.839+0000 7fd012ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0140b36c0 0x7fd01415ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.839+0000 7fd012ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0140b36c0 0x7fd01415ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33186/0 (socket says 172.21.15.82:33186) 2024-06-02T22:54:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.839+0000 7fd012ffd640 1 -- 172.21.15.82:0/3288019829 learned_addr learned my addr 172.21.15.82:0/3288019829 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:16.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.839+0000 7fd0137fe640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd014071c60 0x7fd01406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:16.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fd013fff640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 0x7fd01415f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:16.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fd012ffd640 1 -- 172.21.15.82:0/3288019829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 msgr2=0x7fd01415f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:16.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fd012ffd640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 0x7fd01415f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:16.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fd012ffd640 1 -- 172.21.15.82:0/3288019829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd014071c60 msgr2=0x7fd01406d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:16.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fd012ffd640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd014071c60 0x7fd01406d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:16.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fd012ffd640 1 -- 172.21.15.82:0/3288019829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01406e210 con 0x7fd0140b36c0 2024-06-02T22:54:16.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fd012ffd640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0140b36c0 0x7fd01415ebf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd008009d90 tx=0x7fd008004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:16.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fcffbfff640 1 -- 172.21.15.82:0/3288019829 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008040070 con 0x7fd0140b36c0 2024-06-02T22:54:16.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fcffbfff640 1 -- 172.21.15.82:0/3288019829 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd008031c40 con 0x7fd0140b36c0 2024-06-02T22:54:16.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fd019cd2640 1 -- 172.21.15.82:0/3288019829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01406e4f0 con 0x7fd0140b36c0 2024-06-02T22:54:16.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fcffbfff640 1 -- 172.21.15.82:0/3288019829 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008009450 con 0x7fd0140b36c0 2024-06-02T22:54:16.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.840+0000 7fd019cd2640 1 -- 172.21.15.82:0/3288019829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0140c96a0 con 0x7fd0140b36c0 2024-06-02T22:54:16.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.841+0000 7fd019cd2640 1 -- 172.21.15.82:0/3288019829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd014068430 con 0x7fd0140b36c0 2024-06-02T22:54:16.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.841+0000 7fcffbfff640 1 -- 172.21.15.82:0/3288019829 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd008039040 con 0x7fd0140b36c0 2024-06-02T22:54:16.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.842+0000 7fcffbfff640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd00006be30 0x7fd00006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:16.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.842+0000 7fd0137fe640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd00006be30 0x7fd00006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:16.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.842+0000 7fcffbfff640 1 -- 172.21.15.82:0/3288019829 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fd0080abf10 con 0x7fd0140b36c0 2024-06-02T22:54:16.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.842+0000 7fd0137fe640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd00006be30 0x7fd00006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd004006ca0 tx=0x7fd004009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:16.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:16.846+0000 7fcffbfff640 1 -- 172.21.15.82:0/3288019829 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd00807a340 con 0x7fd0140b36c0 2024-06-02T22:54:17.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.016+0000 7fd019cd2640 1 -- 172.21.15.82:0/3288019829 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd014153d00 con 0x7fd00006be30 2024-06-02T22:54:17.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.017+0000 7fcffbfff640 1 -- 172.21.15.82:0/3288019829 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13427 (secure 0 0 0) 0x7fd014153d00 con 0x7fd00006be30 2024-06-02T22:54:17.017 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:17.018 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:54:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 -- 172.21.15.82:0/3288019829 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd00006be30 msgr2=0x7fd00006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd00006be30 0x7fd00006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd004006ca0 tx=0x7fd004009240 comp rx=0 tx=0).stop 2024-06-02T22:54:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 -- 172.21.15.82:0/3288019829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0140b36c0 msgr2=0x7fd01415ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0140b36c0 0x7fd01415ebf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd008009d90 tx=0x7fd008004a40 comp rx=0 tx=0).stop 2024-06-02T22:54:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 -- 172.21.15.82:0/3288019829 shutdown_connections 2024-06-02T22:54:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fd00006be30 0x7fd00006e2f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0140cc6d0 0x7fd01415f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0140b36c0 0x7fd01415ebf0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 --2- 172.21.15.82:0/3288019829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd014071c60 0x7fd01406d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 -- 172.21.15.82:0/3288019829 >> 172.21.15.82:0/3288019829 conn(0x7fd0140b19f0 msgr2=0x7fd014074880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:17.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 -- 172.21.15.82:0/3288019829 shutdown_connections 2024-06-02T22:54:17.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.019+0000 7fd019cd2640 1 -- 172.21.15.82:0/3288019829 wait complete. 2024-06-02T22:54:17.030 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-06-02T22:54:15.851331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222476,"kb_used_data":6316,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752244,"statfs":{"total":773094113280,"available":772866297856,"internally_reserved":0,"allocated":6467584,"data_stored":3555611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12148,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001139"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":236,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-02T22:54:11.467198+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:54:11.467198+0000","last_peered":"2024-06-02T22:54:11.467198+0000","last_clean":"2024-06-02T22:54:11.467198+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:54:11.467198+0000","last_undegraded":"2024-06-02T22:54:11.467198+0000","last_fullsized":"2024-06-02T22:54:11.467198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1261568,"data_stored":888778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":647168,"data_stored":291777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":292429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":671744,"data_stored":308072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":291833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":291833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":291867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1269760,"data_stored":899022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:54:17.031 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:54:17.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.131+0000 7f6aa1b16640 1 Processor -- start 2024-06-02T22:54:17.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.131+0000 7f6aa1b16640 1 -- start start 2024-06-02T22:54:17.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.132+0000 7f6aa1b16640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a9c0af3b0 0x7f6a9c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.132+0000 7f6aa1b16640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a9c15ac50 con 0x7f6a9c0aef70 2024-06-02T22:54:17.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.132+0000 7f6aa1b16640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a9c06cdb0 con 0x7f6a9c15a870 2024-06-02T22:54:17.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.132+0000 7f6aa1b16640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9c06d090 con 0x7f6a9c0af3b0 2024-06-02T22:54:17.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.132+0000 7f6a9affd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6a9c0aef70 0x7f6a9c0b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48416/0 (socket says 172.21.15.82:48416) 2024-06-02T22:54:17.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.132+0000 7f6a9affd640 1 -- 172.21.15.82:0/2015712285 learned_addr learned my addr 172.21.15.82:0/2015712285 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:17.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202724953 0 0) 0x7f6a9c15ac50 con 0x7f6a9c0aef70 2024-06-02T22:54:17.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a84003520 con 0x7f6a9c0aef70 2024-06-02T22:54:17.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9bfff640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a9c0af3b0 0x7f6a9c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3373702860 0 0) 0x7f6a84003520 con 0x7f6a9c0aef70 2024-06-02T22:54:17.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a9c0af3b0 msgr2=0x7f6a9c0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:17.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a9c0af3b0 0x7f6a9c0cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 >> v1:172.21.15.184:6789/0 conn(0x7f6a9c15a870 legacy=0x7f6a9c06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c06d370 con 0x7f6a9c0aef70 2024-06-02T22:54:17.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f6a90001670 con 0x7f6a9c0aef70 2024-06-02T22:54:17.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 >> v1:172.21.15.82:6789/0 conn(0x7f6a9c0aef70 legacy=0x7f6a9c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a9c0af3b0 0x7f6a840039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a84003f20 0x7f6a84004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a84004d40 0x7f6a840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c06d090 con 0x7f6a84004d40 2024-06-02T22:54:17.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8400cc90 con 0x7f6a84003f20 2024-06-02T22:54:17.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6a8400ce90 con 0x7f6a9c0af3b0 2024-06-02T22:54:17.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9bfff640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a84004d40 0x7f6a840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9affd640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a84003f20 0x7f6a84004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9b7fe640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a9c0af3b0 0x7f6a840039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9bfff640 1 -- 172.21.15.82:0/2015712285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a9c0af3b0 msgr2=0x7f6a840039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:17.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9bfff640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a9c0af3b0 0x7f6a840039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9bfff640 1 -- 172.21.15.82:0/2015712285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a84003f20 msgr2=0x7f6a84004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:17.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9bfff640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a84003f20 0x7f6a84004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.133+0000 7f6a9bfff640 1 -- 172.21.15.82:0/2015712285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a84003520 con 0x7f6a84004d40 2024-06-02T22:54:17.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.134+0000 7f6a9bfff640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a84004d40 0x7f6a840051c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009fc0 tx=0x7f6a84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c0896727f9cdd2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.134+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a94009c10 con 0x7f6a84004d40 2024-06-02T22:54:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.134+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a94036070 con 0x7f6a84004d40 2024-06-02T22:54:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.134+0000 7f6a9a7fc640 1 -- 172.21.15.82:0/2015712285 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a94031880 con 0x7f6a84004d40 2024-06-02T22:54:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.135+0000 7f6aa1b16640 1 -- 172.21.15.82:0/2015712285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a84004d40 msgr2=0x7f6a840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.135+0000 7f6aa1b16640 1 --2- 172.21.15.82:0/2015712285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a84004d40 0x7f6a840051c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009fc0 tx=0x7f6a84005830 comp rx=0 tx=0).stop 2024-06-02T22:54:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.135+0000 7f6a9bfff640 1 -- 172.21.15.82:0/2015712285 reap_dead start 2024-06-02T22:54:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.135+0000 7f6aa1b16640 1 -- 172.21.15.82:0/2015712285 shutdown_connections 2024-06-02T22:54:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.135+0000 7f6aa1b16640 1 -- 172.21.15.82:0/2015712285 >> 172.21.15.82:0/2015712285 conn(0x7f6a9c0b19f0 msgr2=0x7f6a9c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:17.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.135+0000 7f6aa1b16640 1 -- 172.21.15.82:0/2015712285 shutdown_connections 2024-06-02T22:54:17.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.135+0000 7f6aa1b16640 1 -- 172.21.15.82:0/2015712285 wait complete. 2024-06-02T22:54:17.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.136+0000 7f6aa1b16640 1 Processor -- start 2024-06-02T22:54:17.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.136+0000 7f6aa1b16640 1 -- start start 2024-06-02T22:54:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6aa1b16640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a84004d40 0x7f6a9c14e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6aa1b16640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9c0cba30 0x7f6a9c150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6aa1b16640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a9c1555a0 0x7f6a9c156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6aa1b16640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c0b2e40 con 0x7f6a9c0cba30 2024-06-02T22:54:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6aa1b16640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c06d930 con 0x7f6a9c1555a0 2024-06-02T22:54:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6aa1b16640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9c0b2fc0 con 0x7f6a84004d40 2024-06-02T22:54:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6a9affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9c0cba30 0x7f6a9c150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6a9affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9c0cba30 0x7f6a9c150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33192/0 (socket says 172.21.15.82:33192) 2024-06-02T22:54:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6a9affd640 1 -- 172.21.15.82:0/581268824 learned_addr learned my addr 172.21.15.82:0/581268824 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6a9affd640 1 -- 172.21.15.82:0/581268824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a84004d40 msgr2=0x7f6a9c14e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6a9affd640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a84004d40 0x7f6a9c14e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6a9affd640 1 -- 172.21.15.82:0/581268824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a9c1555a0 msgr2=0x7f6a9c156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6a9affd640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a9c1555a0 0x7f6a9c156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6a9affd640 1 -- 172.21.15.82:0/581268824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c14eb50 con 0x7f6a9c0cba30 2024-06-02T22:54:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.137+0000 7f6a9affd640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9c0cba30 0x7f6a9c150470 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007340 tx=0x7f6a90007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.138+0000 7f6a83fff640 1 -- 172.21.15.82:0/581268824 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9000f840 con 0x7f6a9c0cba30 2024-06-02T22:54:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.138+0000 7f6a83fff640 1 -- 172.21.15.82:0/581268824 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a90018070 con 0x7f6a9c0cba30 2024-06-02T22:54:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.138+0000 7f6aa1b16640 1 -- 172.21.15.82:0/581268824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9c155f10 con 0x7f6a9c0cba30 2024-06-02T22:54:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.138+0000 7f6a83fff640 1 -- 172.21.15.82:0/581268824 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9000fc40 con 0x7f6a9c0cba30 2024-06-02T22:54:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.138+0000 7f6aa1b16640 1 -- 172.21.15.82:0/581268824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9c1564d0 con 0x7f6a9c0cba30 2024-06-02T22:54:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.139+0000 7f6aa1b16640 1 -- 172.21.15.82:0/581268824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9c068430 con 0x7f6a9c0cba30 2024-06-02T22:54:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.139+0000 7f6a83fff640 1 -- 172.21.15.82:0/581268824 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a9001d460 con 0x7f6a9c0cba30 2024-06-02T22:54:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.140+0000 7f6a83fff640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a8806be60 0x7f6a8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.140+0000 7f6a9b7fe640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a8806be60 0x7f6a8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.140+0000 7f6a83fff640 1 -- 172.21.15.82:0/581268824 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f6a9008ad00 con 0x7f6a9c0cba30 2024-06-02T22:54:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.140+0000 7f6a9b7fe640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a8806be60 0x7f6a8806e320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c001900 tx=0x7f6a8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.144+0000 7f6a83fff640 1 -- 172.21.15.82:0/581268824 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6a90059820 con 0x7f6a9c0cba30 2024-06-02T22:54:17.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.315+0000 7f6aa1b16640 1 -- 172.21.15.82:0/581268824 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a9c0cc120 con 0x7f6a8806be60 2024-06-02T22:54:17.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.316+0000 7f6a83fff640 1 -- 172.21.15.82:0/581268824 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13427 (secure 0 0 0) 0x7f6a9c0cc120 con 0x7f6a8806be60 2024-06-02T22:54:17.316 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:17.316 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:54:17.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 -- 172.21.15.82:0/581268824 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a8806be60 msgr2=0x7f6a8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a8806be60 0x7f6a8806e320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c001900 tx=0x7f6a8c009040 comp rx=0 tx=0).stop 2024-06-02T22:54:17.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 -- 172.21.15.82:0/581268824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9c0cba30 msgr2=0x7f6a9c150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9c0cba30 0x7f6a9c150470 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007340 tx=0x7f6a90007800 comp rx=0 tx=0).stop 2024-06-02T22:54:17.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 -- 172.21.15.82:0/581268824 shutdown_connections 2024-06-02T22:54:17.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f6a8806be60 0x7f6a8806e320 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a9c1555a0 0x7f6a9c156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9c0cba30 0x7f6a9c150470 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 --2- 172.21.15.82:0/581268824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a84004d40 0x7f6a9c14e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 -- 172.21.15.82:0/581268824 >> 172.21.15.82:0/581268824 conn(0x7f6a9c0b19f0 msgr2=0x7f6a9c0cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:17.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 -- 172.21.15.82:0/581268824 shutdown_connections 2024-06-02T22:54:17.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.318+0000 7f6aa1b16640 1 -- 172.21.15.82:0/581268824 wait complete. 2024-06-02T22:54:17.329 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-06-02T22:54:15.851331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222476,"kb_used_data":6316,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752244,"statfs":{"total":773094113280,"available":772866297856,"internally_reserved":0,"allocated":6467584,"data_stored":3555611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12148,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001139"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":236,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-02T22:54:11.467198+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:54:11.467198+0000","last_peered":"2024-06-02T22:54:11.467198+0000","last_clean":"2024-06-02T22:54:11.467198+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:54:11.467198+0000","last_undegraded":"2024-06-02T22:54:11.467198+0000","last_fullsized":"2024-06-02T22:54:11.467198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1261568,"data_stored":888778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":647168,"data_stored":291777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":292429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":671744,"data_stored":308072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":291833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":291833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":291867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1269760,"data_stored":899022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:54:17.329 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T22:54:17.330 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:54:17.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.429+0000 7f88005b0640 1 Processor -- start 2024-06-02T22:54:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.429+0000 7f88005b0640 1 -- start start 2024-06-02T22:54:17.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.430+0000 7f88005b0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f815f1a0 0x7f87f80d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.430+0000 7f88005b0640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f815f5e0 con 0x7f87f80d2680 2024-06-02T22:54:17.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.430+0000 7f88005b0640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f80d0ad0 con 0x7f87f80cef70 2024-06-02T22:54:17.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.430+0000 7f88005b0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f87f80d13e0 con 0x7f87f815f1a0 2024-06-02T22:54:17.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.430+0000 7f87fe34c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f87f80d2680 0x7f87f80d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48422/0 (socket says 172.21.15.82:48422) 2024-06-02T22:54:17.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.430+0000 7f87fe34c640 1 -- 172.21.15.82:0/2249280236 learned_addr learned my addr 172.21.15.82:0/2249280236 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:17.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fdb4b640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f815f1a0 0x7f87f80d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950252451 0 0) 0x7f87f815f5e0 con 0x7f87f80d2680 2024-06-02T22:54:17.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87e0003520 con 0x7f87f80d2680 2024-06-02T22:54:17.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310924283 0 0) 0x7f87f80d0ad0 con 0x7f87f80cef70 2024-06-02T22:54:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87f815f5e0 con 0x7f87f80cef70 2024-06-02T22:54:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1647703423 0 0) 0x7f87e0003520 con 0x7f87f80d2680 2024-06-02T22:54:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f815f1a0 msgr2=0x7f87f80d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f815f1a0 0x7f87f80d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 >> v1:172.21.15.184:6789/0 conn(0x7f87f80cef70 legacy=0x7f87f80cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f815f890 con 0x7f87f80d2680 2024-06-02T22:54:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f87e8001670 con 0x7f87f80d2680 2024-06-02T22:54:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 >> v1:172.21.15.82:6789/0 conn(0x7f87f80d2680 legacy=0x7f87f80d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e0003b70 0x7f87e0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f815f1a0 0x7f87e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 0x7f87e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f87f80d13e0 con 0x7f87e0004d40 2024-06-02T22:54:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f87e000ba70 con 0x7f87e0003b70 2024-06-02T22:54:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f87e000bc70 con 0x7f87f815f1a0 2024-06-02T22:54:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87feb4d640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 0x7f87e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fe34c640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e0003b70 0x7f87e0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fdb4b640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f815f1a0 0x7f87e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87feb4d640 1 -- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f815f1a0 msgr2=0x7f87e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87feb4d640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f815f1a0 0x7f87e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87feb4d640 1 -- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e0003b70 msgr2=0x7f87e0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87feb4d640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e0003b70 0x7f87e0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87feb4d640 1 -- 172.21.15.82:0/2249280236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e0003520 con 0x7f87e0004d40 2024-06-02T22:54:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.431+0000 7f87fdb4b640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f815f1a0 0x7f87e0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.432+0000 7f87feb4d640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 0x7f87e00051c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f87f0001fd0 tx=0x7f87e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b53f3825c1abf2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.432+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0001bf0 con 0x7f87e0004d40 2024-06-02T22:54:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.432+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f0003b70 con 0x7f87e0004d40 2024-06-02T22:54:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.432+0000 7f87fd34a640 1 -- 172.21.15.82:0/2249280236 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f00050d0 con 0x7f87e0004d40 2024-06-02T22:54:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.433+0000 7f88005b0640 1 -- 172.21.15.82:0/2249280236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 msgr2=0x7f87e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.433+0000 7f88005b0640 1 --2- 172.21.15.82:0/2249280236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 0x7f87e00051c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f87f0001fd0 tx=0x7f87e0005830 comp rx=0 tx=0).stop 2024-06-02T22:54:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.433+0000 7f87feb4d640 1 -- 172.21.15.82:0/2249280236 reap_dead start 2024-06-02T22:54:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.433+0000 7f88005b0640 1 -- 172.21.15.82:0/2249280236 shutdown_connections 2024-06-02T22:54:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.433+0000 7f88005b0640 1 -- 172.21.15.82:0/2249280236 >> 172.21.15.82:0/2249280236 conn(0x7f87f809d3f0 msgr2=0x7f87f80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.433+0000 7f88005b0640 1 -- 172.21.15.82:0/2249280236 shutdown_connections 2024-06-02T22:54:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.433+0000 7f88005b0640 1 -- 172.21.15.82:0/2249280236 wait complete. 2024-06-02T22:54:17.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.434+0000 7f88005b0640 1 Processor -- start 2024-06-02T22:54:17.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.434+0000 7f88005b0640 1 -- start start 2024-06-02T22:54:17.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f88005b0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 0x7f87f809f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f88005b0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f80b0d50 0x7f87f80b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f88005b0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87f80b11d0 0x7f87f80b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f88005b0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f87f80d4f00 con 0x7f87e0004d40 2024-06-02T22:54:17.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f88005b0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f87f80d1070 con 0x7f87f80b11d0 2024-06-02T22:54:17.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f88005b0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f87f80d1870 con 0x7f87f80b0d50 2024-06-02T22:54:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87fe34c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 0x7f87f809f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87fe34c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 0x7f87f809f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33208/0 (socket says 172.21.15.82:33208) 2024-06-02T22:54:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87fe34c640 1 -- 172.21.15.82:0/301642267 learned_addr learned my addr 172.21.15.82:0/301642267 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87fe34c640 1 -- 172.21.15.82:0/301642267 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f80b0d50 msgr2=0x7f87f80b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87fe34c640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f80b0d50 0x7f87f80b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87feb4d640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87f80b11d0 0x7f87f80b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87fe34c640 1 -- 172.21.15.82:0/301642267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87f80b11d0 msgr2=0x7f87f80b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87fe34c640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87f80b11d0 0x7f87f80b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87fe34c640 1 -- 172.21.15.82:0/301642267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f80b4ea0 con 0x7f87e0004d40 2024-06-02T22:54:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87fe34c640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 0x7f87f809f6f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f87e8004ec0 tx=0x7f87e8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87f6ffd640 1 -- 172.21.15.82:0/301642267 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e800f7b0 con 0x7f87e0004d40 2024-06-02T22:54:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87f6ffd640 1 -- 172.21.15.82:0/301642267 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e8018070 con 0x7f87e0004d40 2024-06-02T22:54:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f88005b0640 1 -- 172.21.15.82:0/301642267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f80b48e0 con 0x7f87e0004d40 2024-06-02T22:54:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f87f6ffd640 1 -- 172.21.15.82:0/301642267 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e800fb90 con 0x7f87e0004d40 2024-06-02T22:54:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.435+0000 7f88005b0640 1 -- 172.21.15.82:0/301642267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f80a0430 con 0x7f87e0004d40 2024-06-02T22:54:17.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.436+0000 7f88005b0640 1 -- 172.21.15.82:0/301642267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f8068430 con 0x7f87e0004d40 2024-06-02T22:54:17.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.437+0000 7f87f6ffd640 1 -- 172.21.15.82:0/301642267 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87e800fd30 con 0x7f87e0004d40 2024-06-02T22:54:17.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.437+0000 7f87f6ffd640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f87e406be30 0x7f87e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.437+0000 7f87f6ffd640 1 -- 172.21.15.82:0/301642267 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f87e808ad00 con 0x7f87e0004d40 2024-06-02T22:54:17.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.438+0000 7f87fdb4b640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f87e406be30 0x7f87e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.438+0000 7f87fdb4b640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f87e406be30 0x7f87e406e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f87f815e520 tx=0x7f87ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:17.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.442+0000 7f87f6ffd640 1 -- 172.21.15.82:0/301642267 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f87e8059820 con 0x7f87e0004d40 2024-06-02T22:54:17.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.612+0000 7f88005b0640 1 -- 172.21.15.82:0/301642267 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87f80d0ad0 con 0x7f87e406be30 2024-06-02T22:54:17.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.613+0000 7f87f6ffd640 1 -- 172.21.15.82:0/301642267 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13427 (secure 0 0 0) 0x7f87f80d0ad0 con 0x7f87e406be30 2024-06-02T22:54:17.613 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:17.613 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:54:17.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.614+0000 7f88005b0640 1 -- 172.21.15.82:0/301642267 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f87e406be30 msgr2=0x7f87e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.614+0000 7f88005b0640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f87e406be30 0x7f87e406e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f87f815e520 tx=0x7f87ec008040 comp rx=0 tx=0).stop 2024-06-02T22:54:17.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.614+0000 7f88005b0640 1 -- 172.21.15.82:0/301642267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 msgr2=0x7f87f809f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.614+0000 7f88005b0640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 0x7f87f809f6f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f87e8004ec0 tx=0x7f87e8007430 comp rx=0 tx=0).stop 2024-06-02T22:54:17.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.614+0000 7f88005b0640 1 -- 172.21.15.82:0/301642267 shutdown_connections 2024-06-02T22:54:17.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.614+0000 7f88005b0640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f87e406be30 0x7f87e406e2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.614+0000 7f88005b0640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87f80b11d0 0x7f87f80b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.614+0000 7f88005b0640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87f80b0d50 0x7f87f80b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.614+0000 7f88005b0640 1 --2- 172.21.15.82:0/301642267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87e0004d40 0x7f87f809f6f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.614+0000 7f88005b0640 1 -- 172.21.15.82:0/301642267 >> 172.21.15.82:0/301642267 conn(0x7f87f809d3f0 msgr2=0x7f87f80cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:17.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.615+0000 7f88005b0640 1 -- 172.21.15.82:0/301642267 shutdown_connections 2024-06-02T22:54:17.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.615+0000 7f88005b0640 1 -- 172.21.15.82:0/301642267 wait complete. 2024-06-02T22:54:17.625 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-06-02T22:54:15.851331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222476,"kb_used_data":6316,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752244,"statfs":{"total":773094113280,"available":772866297856,"internally_reserved":0,"allocated":6467584,"data_stored":3555611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12148,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001139"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":236,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-02T22:54:11.467198+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:54:11.467198+0000","last_peered":"2024-06-02T22:54:11.467198+0000","last_clean":"2024-06-02T22:54:11.467198+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:54:11.467198+0000","last_undegraded":"2024-06-02T22:54:11.467198+0000","last_fullsized":"2024-06-02T22:54:11.467198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1261568,"data_stored":888778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":647168,"data_stored":291777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":292429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":671744,"data_stored":308072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":291833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":291833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":291867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1269760,"data_stored":899022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:54:17.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:54:17.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.724+0000 7fba24c38640 1 Processor -- start 2024-06-02T22:54:17.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.724+0000 7fba24c38640 1 -- start start 2024-06-02T22:54:17.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.725+0000 7fba24c38640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba2015c240 0x7fba200cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.725+0000 7fba24c38640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba2006deb0 con 0x7fba2006d9b0 2024-06-02T22:54:17.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.725+0000 7fba24c38640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba2006e190 con 0x7fba2015d8b0 2024-06-02T22:54:17.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.725+0000 7fba24c38640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fba2015d630 con 0x7fba2015c240 2024-06-02T22:54:17.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.725+0000 7fba1e59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba2015c240 0x7fba200cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.725+0000 7fba1dd9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fba2006d9b0 0x7fba2006ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48426/0 (socket says 172.21.15.82:48426) 2024-06-02T22:54:17.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.725+0000 7fba1e59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba2015c240 0x7fba200cfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33222/0 (socket says 172.21.15.82:33222) 2024-06-02T22:54:17.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.725+0000 7fba1e59c640 1 -- 172.21.15.82:0/3995605942 learned_addr learned my addr 172.21.15.82:0/3995605942 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:17.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.726+0000 7fba1e59c640 1 -- 172.21.15.82:0/3995605942 >> v1:172.21.15.184:6789/0 conn(0x7fba2015d8b0 legacy=0x7fba2006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:17.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.726+0000 7fba1e59c640 1 -- 172.21.15.82:0/3995605942 >> v1:172.21.15.82:6789/0 conn(0x7fba2006d9b0 legacy=0x7fba2006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.726+0000 7fba1e59c640 1 -- 172.21.15.82:0/3995605942 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2006e470 con 0x7fba2015c240 2024-06-02T22:54:17.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.726+0000 7fba1d59a640 1 -- 172.21.15.82:0/3995605942 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959851595 0 0) 0x7fba2006deb0 con 0x7fba2006d9b0 2024-06-02T22:54:17.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.726+0000 7fba1e59c640 1 --2- 172.21.15.82:0/3995605942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2015c240 0x7fba200cfef0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fba10009e50 tx=0x7fba1002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dd5c9bc4615198 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:17.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.726+0000 7fba1d59a640 1 -- 172.21.15.82:0/3995605942 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10036070 con 0x7fba2015c240 2024-06-02T22:54:17.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.726+0000 7fba1d59a640 1 -- 172.21.15.82:0/3995605942 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba10031600 con 0x7fba2015c240 2024-06-02T22:54:17.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.726+0000 7fba1d59a640 1 -- 172.21.15.82:0/3995605942 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba100319d0 con 0x7fba2015c240 2024-06-02T22:54:17.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.727+0000 7fba24c38640 1 -- 172.21.15.82:0/3995605942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2015c240 msgr2=0x7fba200cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.727+0000 7fba24c38640 1 --2- 172.21.15.82:0/3995605942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2015c240 0x7fba200cfef0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fba10009e50 tx=0x7fba1002a760 comp rx=0 tx=0).stop 2024-06-02T22:54:17.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.727+0000 7fba24c38640 1 -- 172.21.15.82:0/3995605942 shutdown_connections 2024-06-02T22:54:17.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.727+0000 7fba24c38640 1 --2- 172.21.15.82:0/3995605942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2015c240 0x7fba200cfef0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.727+0000 7fba24c38640 1 -- 172.21.15.82:0/3995605942 >> 172.21.15.82:0/3995605942 conn(0x7fba20071950 msgr2=0x7fba20071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:17.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.727+0000 7fba24c38640 1 -- 172.21.15.82:0/3995605942 shutdown_connections 2024-06-02T22:54:17.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.727+0000 7fba24c38640 1 -- 172.21.15.82:0/3995605942 wait complete. 2024-06-02T22:54:17.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.728+0000 7fba24c38640 1 Processor -- start 2024-06-02T22:54:17.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.728+0000 7fba24c38640 1 -- start start 2024-06-02T22:54:17.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba24c38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2006d9b0 0x7fba201568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba24c38640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba2015c240 0x7fba20158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba24c38640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba2015d8b0 0x7fba201425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba24c38640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba200aff60 con 0x7fba2006d9b0 2024-06-02T22:54:17.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba24c38640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fba2006ea30 con 0x7fba2015d8b0 2024-06-02T22:54:17.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba24c38640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fba2006f660 con 0x7fba2015c240 2024-06-02T22:54:17.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba1e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2006d9b0 0x7fba201568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba1e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2006d9b0 0x7fba201568d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33224/0 (socket says 172.21.15.82:33224) 2024-06-02T22:54:17.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba1e59c640 1 -- 172.21.15.82:0/2462901667 learned_addr learned my addr 172.21.15.82:0/2462901667 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:17.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba1e59c640 1 -- 172.21.15.82:0/2462901667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba2015c240 msgr2=0x7fba20158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba1e59c640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba2015c240 0x7fba20158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba1e59c640 1 -- 172.21.15.82:0/2462901667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba2015d8b0 msgr2=0x7fba201425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.729+0000 7fba1e59c640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba2015d8b0 0x7fba201425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.730+0000 7fba1e59c640 1 -- 172.21.15.82:0/2462901667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba20159160 con 0x7fba2006d9b0 2024-06-02T22:54:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.730+0000 7fba1e59c640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2006d9b0 0x7fba201568d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fba10009e50 tx=0x7fba10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.730+0000 7fba16ffd640 1 -- 172.21.15.82:0/2462901667 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10041020 con 0x7fba2006d9b0 2024-06-02T22:54:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.730+0000 7fba16ffd640 1 -- 172.21.15.82:0/2462901667 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba10007820 con 0x7fba2006d9b0 2024-06-02T22:54:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.730+0000 7fba24c38640 1 -- 172.21.15.82:0/2462901667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba20155830 con 0x7fba2006d9b0 2024-06-02T22:54:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.730+0000 7fba16ffd640 1 -- 172.21.15.82:0/2462901667 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10036040 con 0x7fba2006d9b0 2024-06-02T22:54:17.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.730+0000 7fba24c38640 1 -- 172.21.15.82:0/2462901667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba20155df0 con 0x7fba2006d9b0 2024-06-02T22:54:17.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.731+0000 7fba24c38640 1 -- 172.21.15.82:0/2462901667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba20068430 con 0x7fba2006d9b0 2024-06-02T22:54:17.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.731+0000 7fba16ffd640 1 -- 172.21.15.82:0/2462901667 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba10044020 con 0x7fba2006d9b0 2024-06-02T22:54:17.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.732+0000 7fba16ffd640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba0006be30 0x7fba0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:17.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.732+0000 7fba16ffd640 1 -- 172.21.15.82:0/2462901667 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fba100abaf0 con 0x7fba2006d9b0 2024-06-02T22:54:17.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.732+0000 7fba1dd9b640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba0006be30 0x7fba0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:17.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.732+0000 7fba1dd9b640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba0006be30 0x7fba0006e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fba08007fd0 tx=0x7fba08007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:17.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.736+0000 7fba16ffd640 1 -- 172.21.15.82:0/2462901667 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fba1004b030 con 0x7fba2006d9b0 2024-06-02T22:54:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.909+0000 7fba24c38640 1 -- 172.21.15.82:0/2462901667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba20142b00 con 0x7fba2006d9b0 2024-06-02T22:54:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.910+0000 7fba16ffd640 1 -- 172.21.15.82:0/2462901667 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+13293 (secure 0 0 0) 0x7fba1007a610 con 0x7fba2006d9b0 2024-06-02T22:54:17.911 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:17.911 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":57,"fsid":"6f85057c-cf41-4021-ae61-b6064b1147d0","created":"2024-06-02T22:51:39.691426+0000","modified":"2024-06-02T22:54:14.703877+0000","last_up_change":"2024-06-02T22:51:50.858712+0000","last_in_change":"2024-06-02T22:51:41.836731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:51:51.853867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d2b6a99b-23c8-4269-95f5-6363b40a6721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6819","nonce":377793909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6822","nonce":377793909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6829","nonce":377793909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":377793909},{"type":"v1","addr":"172.21.15.82:6826","nonce":377793909}]},"public_addr":"172.21.15.82:6819/377793909","cluster_addr":"172.21.15.82:6822/377793909","heartbeat_back_addr":"172.21.15.82:6829/377793909","heartbeat_front_addr":"172.21.15.82:6826/377793909","state":["exists","up"]},{"osd":1,"uuid":"d3f7e607-2b7f-4ec6-9af3-75b45c024c79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6809","nonce":4009704976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6811","nonce":4009704976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6815","nonce":4009704976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":4009704976},{"type":"v1","addr":"172.21.15.82:6813","nonce":4009704976}]},"public_addr":"172.21.15.82:6809/4009704976","cluster_addr":"172.21.15.82:6811/4009704976","heartbeat_back_addr":"172.21.15.82:6815/4009704976","heartbeat_front_addr":"172.21.15.82:6813/4009704976","state":["exists","up"]},{"osd":2,"uuid":"0f64f417-9df1-442e-af5c-37655eb0806b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6801","nonce":2442500293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6803","nonce":2442500293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6807","nonce":2442500293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2442500293},{"type":"v1","addr":"172.21.15.82:6805","nonce":2442500293}]},"public_addr":"172.21.15.82:6801/2442500293","cluster_addr":"172.21.15.82:6803/2442500293","heartbeat_back_addr":"172.21.15.82:6807/2442500293","heartbeat_front_addr":"172.21.15.82:6805/2442500293","state":["exists","up"]},{"osd":3,"uuid":"c8aa8753-58af-495d-9092-4c5f541a45fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6818","nonce":1784876455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6823","nonce":1784876455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6831","nonce":1784876455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":1784876455},{"type":"v1","addr":"172.21.15.82:6827","nonce":1784876455}]},"public_addr":"172.21.15.82:6818/1784876455","cluster_addr":"172.21.15.82:6823/1784876455","heartbeat_back_addr":"172.21.15.82:6831/1784876455","heartbeat_front_addr":"172.21.15.82:6827/1784876455","state":["exists","up"]},{"osd":4,"uuid":"f420e520-a8a0-4125-b8dc-89a5b553428e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6817","nonce":3577676185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6819","nonce":3577676185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6823","nonce":3577676185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3577676185},{"type":"v1","addr":"172.21.15.184:6821","nonce":3577676185}]},"public_addr":"172.21.15.184:6817/3577676185","cluster_addr":"172.21.15.184:6819/3577676185","heartbeat_back_addr":"172.21.15.184:6823/3577676185","heartbeat_front_addr":"172.21.15.184:6821/3577676185","state":["exists","up"]},{"osd":5,"uuid":"179c12c4-422f-4775-b8c3-283724413292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6801","nonce":1215748399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6803","nonce":1215748399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6807","nonce":1215748399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1215748399},{"type":"v1","addr":"172.21.15.184:6805","nonce":1215748399}]},"public_addr":"172.21.15.184:6801/1215748399","cluster_addr":"172.21.15.184:6803/1215748399","heartbeat_back_addr":"172.21.15.184:6807/1215748399","heartbeat_front_addr":"172.21.15.184:6805/1215748399","state":["exists","up"]},{"osd":6,"uuid":"72ffaff6-3303-4682-887d-3d4f3a3e193d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6809","nonce":4289735887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6811","nonce":4289735887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6815","nonce":4289735887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":4289735887},{"type":"v1","addr":"172.21.15.184:6813","nonce":4289735887}]},"public_addr":"172.21.15.184:6809/4289735887","cluster_addr":"172.21.15.184:6811/4289735887","heartbeat_back_addr":"172.21.15.184:6815/4289735887","heartbeat_front_addr":"172.21.15.184:6813/4289735887","state":["exists","up"]},{"osd":7,"uuid":"9c30ffd8-4b1f-43a9-be04-1e54036f46bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6825","nonce":3753375553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6827","nonce":3753375553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6831","nonce":3753375553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3753375553},{"type":"v1","addr":"172.21.15.184:6829","nonce":3753375553}]},"public_addr":"172.21.15.184:6825/3753375553","cluster_addr":"172.21.15.184:6827/3753375553","heartbeat_back_addr":"172.21.15.184:6831/3753375553","heartbeat_front_addr":"172.21.15.184:6829/3753375553","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.953578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.038590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.001203+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.034837+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.080035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:46.960827+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:51:47.064875+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6837/2390078487":"2024-06-03T22:54:11.462744+0000","172.21.15.82:6836/2390078487":"2024-06-03T22:54:11.462744+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:54:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 -- 172.21.15.82:0/2462901667 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba0006be30 msgr2=0x7fba0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba0006be30 0x7fba0006e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fba08007fd0 tx=0x7fba08007920 comp rx=0 tx=0).stop 2024-06-02T22:54:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 -- 172.21.15.82:0/2462901667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2006d9b0 msgr2=0x7fba201568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2006d9b0 0x7fba201568d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fba10009e50 tx=0x7fba10004a40 comp rx=0 tx=0).stop 2024-06-02T22:54:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 -- 172.21.15.82:0/2462901667 shutdown_connections 2024-06-02T22:54:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fba0006be30 0x7fba0006e2f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba2015d8b0 0x7fba201425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba2015c240 0x7fba20158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 --2- 172.21.15.82:0/2462901667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2006d9b0 0x7fba201568d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 -- 172.21.15.82:0/2462901667 >> 172.21.15.82:0/2462901667 conn(0x7fba20071950 msgr2=0x7fba2006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:17.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 -- 172.21.15.82:0/2462901667 shutdown_connections 2024-06-02T22:54:17.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:17.912+0000 7fba24c38640 1 -- 172.21.15.82:0/2462901667 wait complete. 2024-06-02T22:54:18.925 INFO:tasks.ceph:Scrubbing osd.0 2024-06-02T22:54:18.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-06-02T22:54:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.043+0000 7f69a19f4640 1 Processor -- start 2024-06-02T22:54:19.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.043+0000 7f69a19f4640 1 -- start start 2024-06-02T22:54:19.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.043+0000 7f69a19f4640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f699c0cec60 0x7f699c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.043+0000 7f69a19f4640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f699c0acd40 con 0x7f699c155590 2024-06-02T22:54:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.043+0000 7f69a19f4640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f699c15bfe0 con 0x7f699c0ad800 2024-06-02T22:54:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.043+0000 7f69a19f4640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f699c15c2c0 con 0x7f699c0cec60 2024-06-02T22:54:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f699affd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f699c155590 0x7f699c15b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48436/0 (socket says 172.21.15.82:48436) 2024-06-02T22:54:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f699affd640 1 -- 172.21.15.82:0/712641401 learned_addr learned my addr 172.21.15.82:0/712641401 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f699a7fc640 1 --2- 172.21.15.82:0/712641401 >> v2:172.21.15.184:3300/0 conn(0x7f699c0cec60 0x7f699c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414363906 0 0) 0x7f699c0acd40 con 0x7f699c155590 2024-06-02T22:54:19.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6984005730 con 0x7f699c155590 2024-06-02T22:54:19.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 580050953 0 0) 0x7f6984005730 con 0x7f699c155590 2024-06-02T22:54:19.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 >> v2:172.21.15.184:3300/0 conn(0x7f699c0cec60 msgr2=0x7f699c0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 --2- 172.21.15.82:0/712641401 >> v2:172.21.15.184:3300/0 conn(0x7f699c0cec60 0x7f699c0cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 >> v1:172.21.15.184:6789/0 conn(0x7f699c0ad800 legacy=0x7f699c0adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c0ad000 con 0x7f699c155590 2024-06-02T22:54:19.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f6990001670 con 0x7f699c155590 2024-06-02T22:54:19.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 >> v1:172.21.15.82:6789/0 conn(0x7f699c155590 legacy=0x7f699c15b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6984005bc0 0x7f6984005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6984006a10 0x7f6984006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69840073d0 0x7f698400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f699c15c2c0 con 0x7f69840073d0 2024-06-02T22:54:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f698400e320 con 0x7f6984005bc0 2024-06-02T22:54:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f698400e520 con 0x7f6984006a10 2024-06-02T22:54:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f699a7fc640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6984006a10 0x7f6984006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.044+0000 7f699b7fe640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69840073d0 0x7f698400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.045+0000 7f699affd640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6984005bc0 0x7f6984005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.045+0000 7f699a7fc640 1 -- 172.21.15.82:0/712641401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6984005bc0 msgr2=0x7f6984005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.045+0000 7f699a7fc640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6984005bc0 0x7f6984005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.045+0000 7f699a7fc640 1 -- 172.21.15.82:0/712641401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69840073d0 msgr2=0x7f698400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.045+0000 7f699a7fc640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69840073d0 0x7f698400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.045+0000 7f699a7fc640 1 -- 172.21.15.82:0/712641401 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6984005730 con 0x7f6984006a10 2024-06-02T22:54:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.045+0000 7f699b7fe640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69840073d0 0x7f698400dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:54:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.045+0000 7f699b7fe640 1 -- 172.21.15.82:0/712641401 reap_dead start 2024-06-02T22:54:19.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.046+0000 7f699a7fc640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6984006a10 0x7f6984006e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f698c00ba30 tx=0x7f6984007a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3080a429d9667ad server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.046+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c030070 con 0x7f6984006a10 2024-06-02T22:54:19.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.046+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f698c02ade0 con 0x7f6984006a10 2024-06-02T22:54:19.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.046+0000 7f6999ffb640 1 -- 172.21.15.82:0/712641401 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c00b600 con 0x7f6984006a10 2024-06-02T22:54:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.046+0000 7f69a19f4640 1 -- 172.21.15.82:0/712641401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6984006a10 msgr2=0x7f6984006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.046+0000 7f69a19f4640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6984006a10 0x7f6984006e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f698c00ba30 tx=0x7f6984007a40 comp rx=0 tx=0).stop 2024-06-02T22:54:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.046+0000 7f69a19f4640 1 -- 172.21.15.82:0/712641401 shutdown_connections 2024-06-02T22:54:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.046+0000 7f69a19f4640 1 --2- 172.21.15.82:0/712641401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6984006a10 0x7f6984006e90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.046+0000 7f69a19f4640 1 -- 172.21.15.82:0/712641401 >> 172.21.15.82:0/712641401 conn(0x7f699c0b1980 msgr2=0x7f699c0b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.046+0000 7f69a19f4640 1 -- 172.21.15.82:0/712641401 shutdown_connections 2024-06-02T22:54:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.046+0000 7f69a19f4640 1 -- 172.21.15.82:0/712641401 wait complete. 2024-06-02T22:54:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.048+0000 7f69a19f4640 1 Processor -- start 2024-06-02T22:54:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.048+0000 7f69a19f4640 1 -- start start 2024-06-02T22:54:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f69a19f4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6984006a10 0x7f699c15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f69a19f4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f699c15e610 0x7f699c1f0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f69a19f4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699c151100 0x7f699c151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f69a19f4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f699c0cf0e0 con 0x7f699c151100 2024-06-02T22:54:19.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f69a19f4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f699c0b26d0 con 0x7f6984006a10 2024-06-02T22:54:19.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f69a19f4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f699c0cf260 con 0x7f699c15e610 2024-06-02T22:54:19.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699c151100 0x7f699c151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699a7fc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f699c15e610 0x7f699c1f0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699c151100 0x7f699c151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33238/0 (socket says 172.21.15.82:33238) 2024-06-02T22:54:19.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699affd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6984006a10 0x7f699c15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699b7fe640 1 -- 172.21.15.82:0/215749810 learned_addr learned my addr 172.21.15.82:0/215749810 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:19.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699b7fe640 1 -- 172.21.15.82:0/215749810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f699c15e610 msgr2=0x7f699c1f0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699b7fe640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f699c15e610 0x7f699c1f0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699b7fe640 1 -- 172.21.15.82:0/215749810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6984006a10 msgr2=0x7f699c15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699b7fe640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6984006a10 0x7f699c15a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699b7fe640 1 -- 172.21.15.82:0/215749810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c09b4c0 con 0x7f699c151100 2024-06-02T22:54:19.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699affd640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6984006a10 0x7f699c15a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:54:19.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f699b7fe640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699c151100 0x7f699c151560 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f699c0b50d0 tx=0x7f699400feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f6983fff640 1 -- 172.21.15.82:0/215749810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994001a70 con 0x7f699c151100 2024-06-02T22:54:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f6983fff640 1 -- 172.21.15.82:0/215749810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6994018070 con 0x7f699c151100 2024-06-02T22:54:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f6983fff640 1 -- 172.21.15.82:0/215749810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994003d80 con 0x7f699c151100 2024-06-02T22:54:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.049+0000 7f69a19f4640 1 -- 172.21.15.82:0/215749810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699c09b730 con 0x7f699c151100 2024-06-02T22:54:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.050+0000 7f69a19f4640 1 -- 172.21.15.82:0/215749810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699c15ea90 con 0x7f699c151100 2024-06-02T22:54:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.051+0000 7f69a19f4640 1 -- 172.21.15.82:0/215749810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f699c09bdf0 con 0x7f699c151100 2024-06-02T22:54:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.051+0000 7f6983fff640 1 -- 172.21.15.82:0/215749810 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69940050d0 con 0x7f699c151100 2024-06-02T22:54:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.051+0000 7f6983fff640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f698806be30 0x7f698806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.051+0000 7f6983fff640 1 -- 172.21.15.82:0/215749810 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f699408a970 con 0x7f699c151100 2024-06-02T22:54:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.051+0000 7f699affd640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f698806be30 0x7f698806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.052+0000 7f6983fff640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] conn(0x7f69880722d0 0x7f6988074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.052+0000 7f6983fff640 1 -- 172.21.15.82:0/215749810 --> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6994019ec0 con 0x7f69880722d0 2024-06-02T22:54:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.052+0000 7f6983fff640 1 -- 172.21.15.82:0/215749810 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f699408f2c0 con 0x7f699c151100 2024-06-02T22:54:19.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.052+0000 7f699a7fc640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] conn(0x7f69880722d0 0x7f6988074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.052+0000 7f699affd640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f698806be30 0x7f698806e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f699c1f38e0 tx=0x7f6990007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.052+0000 7f699a7fc640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] conn(0x7f69880722d0 0x7f6988074710 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.053+0000 7f6983fff640 1 -- 172.21.15.82:0/215749810 <== osd.0 v2:172.21.15.82:6817/377793909 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6994019ec0 con 0x7f69880722d0 2024-06-02T22:54:19.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.066+0000 7f69a19f4640 1 -- 172.21.15.82:0/215749810 --> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f699c068540 con 0x7f69880722d0 2024-06-02T22:54:19.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.066+0000 7f6983fff640 1 -- 172.21.15.82:0/215749810 <== osd.0 v2:172.21.15.82:6817/377793909 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f699c068540 con 0x7f69880722d0 2024-06-02T22:54:19.067 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:54:19.068 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T22:54:19.068 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:54:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.067+0000 7f69a19f4640 1 -- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] conn(0x7f69880722d0 msgr2=0x7f6988074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.067+0000 7f69a19f4640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:6817/377793909,v1:172.21.15.82:6819/377793909] conn(0x7f69880722d0 0x7f6988074710 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.067+0000 7f69a19f4640 1 -- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f698806be30 msgr2=0x7f698806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.067+0000 7f69a19f4640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f698806be30 0x7f698806e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f699c1f38e0 tx=0x7f6990007040 comp rx=0 tx=0).stop 2024-06-02T22:54:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.067+0000 7f69a19f4640 1 -- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699c151100 msgr2=0x7f699c151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.067+0000 7f69a19f4640 1 --2- 172.21.15.82:0/215749810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f699c151100 0x7f699c151560 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f699c0b50d0 tx=0x7f699400feb0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.067+0000 7f699b7fe640 1 -- 172.21.15.82:0/215749810 reap_dead start 2024-06-02T22:54:19.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.067+0000 7f69a19f4640 1 -- 172.21.15.82:0/215749810 shutdown_connections 2024-06-02T22:54:19.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.067+0000 7f69a19f4640 1 -- 172.21.15.82:0/215749810 >> 172.21.15.82:0/215749810 conn(0x7f699c0b1980 msgr2=0x7f699c0b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:19.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.067+0000 7f69a19f4640 1 -- 172.21.15.82:0/215749810 shutdown_connections 2024-06-02T22:54:19.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.067+0000 7f69a19f4640 1 -- 172.21.15.82:0/215749810 wait complete. 2024-06-02T22:54:19.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-06-02T22:54:19.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.180+0000 7ff9cafee640 1 Processor -- start 2024-06-02T22:54:19.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.180+0000 7ff9cafee640 1 -- start start 2024-06-02T22:54:19.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9cafee640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9c40d2680 0x7ff9c415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9cafee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9c40cef70 0x7ff9c40cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9cafee640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c40d0ad0 con 0x7ff9c40d1fc0 2024-06-02T22:54:19.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9cafee640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c40d13e0 con 0x7ff9c40d2680 2024-06-02T22:54:19.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9cafee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c415f890 con 0x7ff9c40cef70 2024-06-02T22:54:19.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9c8d8a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9c40d2680 0x7ff9c415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9c8d8a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9c40d2680 0x7ff9c415f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33252/0 (socket says 172.21.15.82:33252) 2024-06-02T22:54:19.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9c8d8a640 1 -- 172.21.15.82:0/1474053818 learned_addr learned my addr 172.21.15.82:0/1474053818 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:19.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9c8d8a640 1 -- 172.21.15.82:0/1474053818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9c40cef70 msgr2=0x7ff9c40cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9c8d8a640 1 --2- 172.21.15.82:0/1474053818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9c40cef70 0x7ff9c40cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9c8d8a640 1 -- 172.21.15.82:0/1474053818 >> v1:172.21.15.184:6789/0 conn(0x7ff9c40d1fc0 legacy=0x7ff9c40d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.181+0000 7ff9c8d8a640 1 -- 172.21.15.82:0/1474053818 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c40d0d90 con 0x7ff9c40d2680 2024-06-02T22:54:19.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.182+0000 7ff9c8d8a640 1 --2- 172.21.15.82:0/1474053818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c40d2680 0x7ff9c415f1a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009870 tx=0x7ff9b802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c4c243c44b59da server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.182+0000 7ff9c37fe640 1 -- 172.21.15.82:0/1474053818 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8037070 con 0x7ff9c40d2680 2024-06-02T22:54:19.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.182+0000 7ff9c37fe640 1 -- 172.21.15.82:0/1474053818 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b8032440 con 0x7ff9c40d2680 2024-06-02T22:54:19.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.182+0000 7ff9c37fe640 1 -- 172.21.15.82:0/1474053818 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8032810 con 0x7ff9c40d2680 2024-06-02T22:54:19.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.183+0000 7ff9cafee640 1 -- 172.21.15.82:0/1474053818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c40d2680 msgr2=0x7ff9c415f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.183+0000 7ff9cafee640 1 --2- 172.21.15.82:0/1474053818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c40d2680 0x7ff9c415f1a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009870 tx=0x7ff9b802a210 comp rx=0 tx=0).stop 2024-06-02T22:54:19.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.183+0000 7ff9cafee640 1 -- 172.21.15.82:0/1474053818 shutdown_connections 2024-06-02T22:54:19.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.183+0000 7ff9cafee640 1 --2- 172.21.15.82:0/1474053818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9c40cef70 0x7ff9c40cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.183+0000 7ff9cafee640 1 --2- 172.21.15.82:0/1474053818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c40d2680 0x7ff9c415f1a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.183+0000 7ff9cafee640 1 -- 172.21.15.82:0/1474053818 >> 172.21.15.82:0/1474053818 conn(0x7ff9c409d3f0 msgr2=0x7ff9c40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:19.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.183+0000 7ff9cafee640 1 -- 172.21.15.82:0/1474053818 shutdown_connections 2024-06-02T22:54:19.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.183+0000 7ff9cafee640 1 -- 172.21.15.82:0/1474053818 wait complete. 2024-06-02T22:54:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.184+0000 7ff9cafee640 1 Processor -- start 2024-06-02T22:54:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.184+0000 7ff9cafee640 1 -- start start 2024-06-02T22:54:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9cafee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c40cef70 0x7ff9c40a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9cafee640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c40d1fc0 0x7ff9c40cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9cafee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9c40d2680 0x7ff9c40cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9cafee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c40d4f00 con 0x7ff9c40cef70 2024-06-02T22:54:19.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9cafee640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c40d2400 con 0x7ff9c40d1fc0 2024-06-02T22:54:19.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9cafee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c40d1870 con 0x7ff9c40d2680 2024-06-02T22:54:19.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9c8d8a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c40cef70 0x7ff9c40a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9c8d8a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c40cef70 0x7ff9c40a1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33256/0 (socket says 172.21.15.82:33256) 2024-06-02T22:54:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9c8d8a640 1 -- 172.21.15.82:0/3230318693 learned_addr learned my addr 172.21.15.82:0/3230318693 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9c3fff640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c40d1fc0 0x7ff9c40cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9c958b640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9c40d2680 0x7ff9c40cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9c8d8a640 1 -- 172.21.15.82:0/3230318693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9c40d2680 msgr2=0x7ff9c40cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9c8d8a640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9c40d2680 0x7ff9c40cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9c8d8a640 1 -- 172.21.15.82:0/3230318693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c40d1fc0 msgr2=0x7ff9c40cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9c8d8a640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c40d1fc0 0x7ff9c40cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9c8d8a640 1 -- 172.21.15.82:0/3230318693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c415c540 con 0x7ff9c40cef70 2024-06-02T22:54:19.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.185+0000 7ff9c8d8a640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c40cef70 0x7ff9c40a1430 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009870 tx=0x7ff9b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.186+0000 7ff9c17fa640 1 -- 172.21.15.82:0/3230318693 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8041070 con 0x7ff9c40cef70 2024-06-02T22:54:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.186+0000 7ff9c17fa640 1 -- 172.21.15.82:0/3230318693 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b803c870 con 0x7ff9c40cef70 2024-06-02T22:54:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.186+0000 7ff9c17fa640 1 -- 172.21.15.82:0/3230318693 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8037040 con 0x7ff9c40cef70 2024-06-02T22:54:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.186+0000 7ff9cafee640 1 -- 172.21.15.82:0/3230318693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c40ce130 con 0x7ff9c40cef70 2024-06-02T22:54:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.186+0000 7ff9cafee640 1 -- 172.21.15.82:0/3230318693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c415cac0 con 0x7ff9c40cef70 2024-06-02T22:54:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.187+0000 7ff9cafee640 1 -- 172.21.15.82:0/3230318693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c4068430 con 0x7ff9c40cef70 2024-06-02T22:54:19.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.187+0000 7ff9c17fa640 1 -- 172.21.15.82:0/3230318693 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9b8044070 con 0x7ff9c40cef70 2024-06-02T22:54:19.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.188+0000 7ff9c17fa640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff9a806be30 0x7ff9a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.188+0000 7ff9c17fa640 1 -- 172.21.15.82:0/3230318693 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7ff9b80ab780 con 0x7ff9c40cef70 2024-06-02T22:54:19.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.188+0000 7ff9c3fff640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff9a806be30 0x7ff9a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.188+0000 7ff9c3fff640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff9a806be30 0x7ff9a806e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff9c41f5ac0 tx=0x7ff9b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.196+0000 7ff9c17fa640 1 -- 172.21.15.82:0/3230318693 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff9b8079c50 con 0x7ff9c40cef70 2024-06-02T22:54:19.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.380+0000 7ff9cafee640 1 -- 172.21.15.82:0/3230318693 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff9c415cc90 con 0x7ff9a806be30 2024-06-02T22:54:19.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.380+0000 7ff9c17fa640 1 -- 172.21.15.82:0/3230318693 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff9c415cc90 con 0x7ff9a806be30 2024-06-02T22:54:19.382 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 0 to deep-scrub 2024-06-02T22:54:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 -- 172.21.15.82:0/3230318693 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff9a806be30 msgr2=0x7ff9a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff9a806be30 0x7ff9a806e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff9c41f5ac0 tx=0x7ff9b0009040 comp rx=0 tx=0).stop 2024-06-02T22:54:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 -- 172.21.15.82:0/3230318693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c40cef70 msgr2=0x7ff9c40a1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c40cef70 0x7ff9c40a1430 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009870 tx=0x7ff9b80046c0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 -- 172.21.15.82:0/3230318693 shutdown_connections 2024-06-02T22:54:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ff9a806be30 0x7ff9a806e2f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9c40d2680 0x7ff9c40cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c40d1fc0 0x7ff9c40cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 --2- 172.21.15.82:0/3230318693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c40cef70 0x7ff9c40a1430 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 -- 172.21.15.82:0/3230318693 >> 172.21.15.82:0/3230318693 conn(0x7ff9c409d3f0 msgr2=0x7ff9c415a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 -- 172.21.15.82:0/3230318693 shutdown_connections 2024-06-02T22:54:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.383+0000 7ff9cafee640 1 -- 172.21.15.82:0/3230318693 wait complete. 2024-06-02T22:54:19.394 INFO:tasks.ceph:Scrubbing osd.1 2024-06-02T22:54:19.395 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-06-02T22:54:19.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.499+0000 7f3046109640 1 Processor -- start 2024-06-02T22:54:19.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.499+0000 7f3046109640 1 -- start start 2024-06-02T22:54:19.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.500+0000 7f3046109640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30400af420 0x7f3040071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.500+0000 7f3046109640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30400cd170 0x7f3040071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.500+0000 7f3046109640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3040073270 con 0x7f304015a810 2024-06-02T22:54:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.500+0000 7f3046109640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f30400ce560 con 0x7f30400af420 2024-06-02T22:54:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.500+0000 7f3046109640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f304015abf0 con 0x7f30400cd170 2024-06-02T22:54:19.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.500+0000 7f3037fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30400af420 0x7f3040071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.500+0000 7f3037fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30400af420 0x7f3040071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33264/0 (socket says 172.21.15.82:33264) 2024-06-02T22:54:19.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.500+0000 7f3037fff640 1 -- 172.21.15.82:0/1015837604 learned_addr learned my addr 172.21.15.82:0/1015837604 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:19.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.500+0000 7f303ffff640 1 --2- 172.21.15.82:0/1015837604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30400cd170 0x7f3040071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.500+0000 7f3037fff640 1 -- 172.21.15.82:0/1015837604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30400cd170 msgr2=0x7f3040071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.500+0000 7f3037fff640 1 --2- 172.21.15.82:0/1015837604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30400cd170 0x7f3040071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.501+0000 7f3037fff640 1 -- 172.21.15.82:0/1015837604 >> v1:172.21.15.184:6789/0 conn(0x7f304015a810 legacy=0x7f30400b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.501+0000 7f3037fff640 1 -- 172.21.15.82:0/1015837604 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30400ce7b0 con 0x7f30400af420 2024-06-02T22:54:19.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.501+0000 7f3037fff640 1 --2- 172.21.15.82:0/1015837604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30400af420 0x7f3040071010 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3028009870 tx=0x7f302802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c82ca4bab5aeb1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.501+0000 7f303effd640 1 -- 172.21.15.82:0/1015837604 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028037070 con 0x7f30400af420 2024-06-02T22:54:19.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.501+0000 7f303effd640 1 -- 172.21.15.82:0/1015837604 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3028032440 con 0x7f30400af420 2024-06-02T22:54:19.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.501+0000 7f303effd640 1 -- 172.21.15.82:0/1015837604 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028032810 con 0x7f30400af420 2024-06-02T22:54:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.502+0000 7f3046109640 1 -- 172.21.15.82:0/1015837604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30400af420 msgr2=0x7f3040071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.502+0000 7f3046109640 1 --2- 172.21.15.82:0/1015837604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30400af420 0x7f3040071010 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3028009870 tx=0x7f302802a270 comp rx=0 tx=0).stop 2024-06-02T22:54:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.502+0000 7f3046109640 1 -- 172.21.15.82:0/1015837604 shutdown_connections 2024-06-02T22:54:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.502+0000 7f3046109640 1 --2- 172.21.15.82:0/1015837604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30400cd170 0x7f3040071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.502+0000 7f3046109640 1 --2- 172.21.15.82:0/1015837604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30400af420 0x7f3040071010 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.502+0000 7f3046109640 1 -- 172.21.15.82:0/1015837604 >> 172.21.15.82:0/1015837604 conn(0x7f30400b1980 msgr2=0x7f30400b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.502+0000 7f3046109640 1 -- 172.21.15.82:0/1015837604 shutdown_connections 2024-06-02T22:54:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.502+0000 7f3046109640 1 -- 172.21.15.82:0/1015837604 wait complete. 2024-06-02T22:54:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.503+0000 7f3046109640 1 Processor -- start 2024-06-02T22:54:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.503+0000 7f3046109640 1 -- start start 2024-06-02T22:54:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3046109640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30400af420 0x7f3040155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3046109640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30400cd170 0x7f30400b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3046109640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f304015a810 0x7f30400b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3046109640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f30400cf050 con 0x7f30400cd170 2024-06-02T22:54:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3046109640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f30400ced70 con 0x7f30400af420 2024-06-02T22:54:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3046109640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f30400b4ac0 con 0x7f304015a810 2024-06-02T22:54:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3037fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30400cd170 0x7f30400b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3037fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30400cd170 0x7f30400b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33280/0 (socket says 172.21.15.82:33280) 2024-06-02T22:54:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3037fff640 1 -- 172.21.15.82:0/3199269749 learned_addr learned my addr 172.21.15.82:0/3199269749 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f303ffff640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f304015a810 0x7f30400b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f303f7fe640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30400af420 0x7f3040155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3037fff640 1 -- 172.21.15.82:0/3199269749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f304015a810 msgr2=0x7f30400b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3037fff640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f304015a810 0x7f30400b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3037fff640 1 -- 172.21.15.82:0/3199269749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30400af420 msgr2=0x7f3040155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3037fff640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30400af420 0x7f3040155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.504+0000 7f3037fff640 1 -- 172.21.15.82:0/3199269749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30401f4ee0 con 0x7f30400cd170 2024-06-02T22:54:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.505+0000 7f3037fff640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30400cd170 0x7f30400b0870 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3028000c00 tx=0x7f30280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.505+0000 7f303cff9640 1 -- 172.21.15.82:0/3199269749 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028041020 con 0x7f30400cd170 2024-06-02T22:54:19.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.505+0000 7f303cff9640 1 -- 172.21.15.82:0/3199269749 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30280306c0 con 0x7f30400cd170 2024-06-02T22:54:19.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.505+0000 7f3046109640 1 -- 172.21.15.82:0/3199269749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f304009cb40 con 0x7f30400cd170 2024-06-02T22:54:19.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.505+0000 7f303cff9640 1 -- 172.21.15.82:0/3199269749 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028037040 con 0x7f30400cd170 2024-06-02T22:54:19.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.505+0000 7f3046109640 1 -- 172.21.15.82:0/3199269749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f304009d100 con 0x7f30400cd170 2024-06-02T22:54:19.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.506+0000 7f3046109640 1 -- 172.21.15.82:0/3199269749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3040068540 con 0x7f30400cd170 2024-06-02T22:54:19.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.507+0000 7f303cff9640 1 -- 172.21.15.82:0/3199269749 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3028044020 con 0x7f30400cd170 2024-06-02T22:54:19.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.507+0000 7f303cff9640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f302006be60 0x7f302006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.507+0000 7f303cff9640 1 -- 172.21.15.82:0/3199269749 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f30280ab300 con 0x7f30400cd170 2024-06-02T22:54:19.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.507+0000 7f303f7fe640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f302006be60 0x7f302006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.507+0000 7f303cff9640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] conn(0x7f3020072300 0x7f3020074740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.507+0000 7f303cff9640 1 -- 172.21.15.82:0/3199269749 --> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3028032440 con 0x7f3020072300 2024-06-02T22:54:19.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.507+0000 7f303cff9640 1 -- 172.21.15.82:0/3199269749 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f30280b2050 con 0x7f30400cd170 2024-06-02T22:54:19.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.508+0000 7f303ffff640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] conn(0x7f3020072300 0x7f3020074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.508+0000 7f303f7fe640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f302006be60 0x7f302006e320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f30300016e0 tx=0x7f3030009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.508+0000 7f303ffff640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] conn(0x7f3020072300 0x7f3020074740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.508+0000 7f303cff9640 1 -- 172.21.15.82:0/3199269749 <== osd.1 v2:172.21.15.82:6808/4009704976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3028032440 con 0x7f3020072300 2024-06-02T22:54:19.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.521+0000 7f3046109640 1 -- 172.21.15.82:0/3199269749 --> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f30400b25e0 con 0x7f3020072300 2024-06-02T22:54:19.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f303cff9640 1 -- 172.21.15.82:0/3199269749 <== osd.1 v2:172.21.15.82:6808/4009704976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f30400b25e0 con 0x7f3020072300 2024-06-02T22:54:19.528 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:54:19.528 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T22:54:19.528 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:54:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f3046109640 1 -- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] conn(0x7f3020072300 msgr2=0x7f3020074740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f3046109640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:6808/4009704976,v1:172.21.15.82:6809/4009704976] conn(0x7f3020072300 0x7f3020074740 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f3046109640 1 -- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f302006be60 msgr2=0x7f302006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f3046109640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f302006be60 0x7f302006e320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f30300016e0 tx=0x7f3030009040 comp rx=0 tx=0).stop 2024-06-02T22:54:19.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f3046109640 1 -- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30400cd170 msgr2=0x7f30400b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f3046109640 1 --2- 172.21.15.82:0/3199269749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30400cd170 0x7f30400b0870 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3028000c00 tx=0x7f30280046c0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f303ffff640 1 -- 172.21.15.82:0/3199269749 reap_dead start 2024-06-02T22:54:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f3046109640 1 -- 172.21.15.82:0/3199269749 shutdown_connections 2024-06-02T22:54:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f3046109640 1 -- 172.21.15.82:0/3199269749 >> 172.21.15.82:0/3199269749 conn(0x7f30400b1980 msgr2=0x7f304006cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f3046109640 1 -- 172.21.15.82:0/3199269749 shutdown_connections 2024-06-02T22:54:19.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.522+0000 7f3046109640 1 -- 172.21.15.82:0/3199269749 wait complete. 2024-06-02T22:54:19.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-06-02T22:54:19.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.635+0000 7f46759a9640 1 Processor -- start 2024-06-02T22:54:19.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.635+0000 7f46759a9640 1 -- start start 2024-06-02T22:54:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.635+0000 7f46759a9640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f46700cc6d0 0x7f46700ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.635+0000 7f46759a9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4670072110 0x7f46700b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.635+0000 7f46759a9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4670072580 con 0x7f4670071c60 2024-06-02T22:54:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.635+0000 7f46759a9640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f46700ccff0 con 0x7f46700cc6d0 2024-06-02T22:54:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.635+0000 7f46759a9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4670072820 con 0x7f4670072110 2024-06-02T22:54:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.636+0000 7f466e7fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4670071c60 0x7f46700b36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48444/0 (socket says 172.21.15.82:48444) 2024-06-02T22:54:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.636+0000 7f466e7fc640 1 -- 172.21.15.82:0/1124964596 learned_addr learned my addr 172.21.15.82:0/1124964596 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.636+0000 7f466effd640 1 --2- 172.21.15.82:0/1124964596 >> v2:172.21.15.184:3300/0 conn(0x7f46700cc6d0 0x7f46700ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.636+0000 7f466f7fe640 1 --2- 172.21.15.82:0/1124964596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4670072110 0x7f46700b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.636+0000 7f466dffb640 1 -- 172.21.15.82:0/1124964596 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2512168281 0 0) 0x7f4670072580 con 0x7f4670071c60 2024-06-02T22:54:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.636+0000 7f466dffb640 1 -- 172.21.15.82:0/1124964596 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f465c003520 con 0x7f4670071c60 2024-06-02T22:54:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.636+0000 7f466effd640 1 -- 172.21.15.82:0/1124964596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4670072110 msgr2=0x7f46700b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.636+0000 7f466effd640 1 --2- 172.21.15.82:0/1124964596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4670072110 0x7f46700b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.636+0000 7f466effd640 1 -- 172.21.15.82:0/1124964596 >> v1:172.21.15.82:6789/0 conn(0x7f4670071c60 legacy=0x7f46700b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.636+0000 7f466effd640 1 -- 172.21.15.82:0/1124964596 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4670072b00 con 0x7f46700cc6d0 2024-06-02T22:54:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.637+0000 7f466effd640 1 --2- 172.21.15.82:0/1124964596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46700cc6d0 0x7f46700ccab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f46600097a0 tx=0x7f466002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d352e1a27f94ff6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.637+0000 7f466dffb640 1 -- 172.21.15.82:0/1124964596 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660037070 con 0x7f46700cc6d0 2024-06-02T22:54:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.637+0000 7f466dffb640 1 -- 172.21.15.82:0/1124964596 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4660032440 con 0x7f46700cc6d0 2024-06-02T22:54:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.637+0000 7f466dffb640 1 -- 172.21.15.82:0/1124964596 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660032810 con 0x7f46700cc6d0 2024-06-02T22:54:19.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.638+0000 7f46759a9640 1 -- 172.21.15.82:0/1124964596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46700cc6d0 msgr2=0x7f46700ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.638+0000 7f46759a9640 1 --2- 172.21.15.82:0/1124964596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46700cc6d0 0x7f46700ccab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f46600097a0 tx=0x7f466002a180 comp rx=0 tx=0).stop 2024-06-02T22:54:19.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.638+0000 7f46759a9640 1 -- 172.21.15.82:0/1124964596 shutdown_connections 2024-06-02T22:54:19.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.638+0000 7f46759a9640 1 --2- 172.21.15.82:0/1124964596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4670072110 0x7f46700b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.638+0000 7f46759a9640 1 --2- 172.21.15.82:0/1124964596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46700cc6d0 0x7f46700ccab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.638+0000 7f46759a9640 1 -- 172.21.15.82:0/1124964596 >> 172.21.15.82:0/1124964596 conn(0x7f46700b19f0 msgr2=0x7f46700b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:19.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.638+0000 7f46759a9640 1 -- 172.21.15.82:0/1124964596 shutdown_connections 2024-06-02T22:54:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.638+0000 7f46759a9640 1 -- 172.21.15.82:0/1124964596 wait complete. 2024-06-02T22:54:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.639+0000 7f46759a9640 1 Processor -- start 2024-06-02T22:54:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.639+0000 7f46759a9640 1 -- start start 2024-06-02T22:54:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.640+0000 7f46759a9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4670071c60 0x7f46701476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.640+0000 7f46759a9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4670072110 0x7f467009b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.640+0000 7f46759a9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46700cc6d0 0x7f467009c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.640+0000 7f46759a9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f467015c890 con 0x7f4670072110 2024-06-02T22:54:19.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.640+0000 7f46759a9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f46700b31a0 con 0x7f46700cc6d0 2024-06-02T22:54:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.640+0000 7f46759a9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f4670159f60 con 0x7f4670071c60 2024-06-02T22:54:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.640+0000 7f466e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4670072110 0x7f467009b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.640+0000 7f466e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4670072110 0x7f467009b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33296/0 (socket says 172.21.15.82:33296) 2024-06-02T22:54:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.640+0000 7f466e7fc640 1 -- 172.21.15.82:0/3140763912 learned_addr learned my addr 172.21.15.82:0/3140763912 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.640+0000 7f466f7fe640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46700cc6d0 0x7f467009c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.640+0000 7f466effd640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4670071c60 0x7f46701476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.641+0000 7f466e7fc640 1 -- 172.21.15.82:0/3140763912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4670071c60 msgr2=0x7f46701476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.641+0000 7f466e7fc640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4670071c60 0x7f46701476d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.641+0000 7f466e7fc640 1 -- 172.21.15.82:0/3140763912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46700cc6d0 msgr2=0x7f467009c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.641+0000 7f466e7fc640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46700cc6d0 0x7f467009c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.641+0000 7f466e7fc640 1 -- 172.21.15.82:0/3140763912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4670147c10 con 0x7f4670072110 2024-06-02T22:54:19.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.641+0000 7f466e7fc640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4670072110 0x7f467009b420 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f465800c3c0 tx=0x7f465800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.641+0000 7f4667fff640 1 -- 172.21.15.82:0/3140763912 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4658017070 con 0x7f4670072110 2024-06-02T22:54:19.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.641+0000 7f4667fff640 1 -- 172.21.15.82:0/3140763912 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4658005ce0 con 0x7f4670072110 2024-06-02T22:54:19.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.641+0000 7f4667fff640 1 -- 172.21.15.82:0/3140763912 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580072f0 con 0x7f4670072110 2024-06-02T22:54:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.641+0000 7f46759a9640 1 -- 172.21.15.82:0/3140763912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46700cdb40 con 0x7f4670072110 2024-06-02T22:54:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.641+0000 7f46759a9640 1 -- 172.21.15.82:0/3140763912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467009c030 con 0x7f4670072110 2024-06-02T22:54:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.642+0000 7f46759a9640 1 -- 172.21.15.82:0/3140763912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4670068430 con 0x7f4670072110 2024-06-02T22:54:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.642+0000 7f4667fff640 1 -- 172.21.15.82:0/3140763912 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f465801a070 con 0x7f4670072110 2024-06-02T22:54:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.643+0000 7f4667fff640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f465006be30 0x7f465006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.643+0000 7f4667fff640 1 -- 172.21.15.82:0/3140763912 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f465808a040 con 0x7f4670072110 2024-06-02T22:54:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.643+0000 7f466effd640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f465006be30 0x7f465006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.643+0000 7f466effd640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f465006be30 0x7f465006e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4660034000 tx=0x7f466002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.647+0000 7f4667fff640 1 -- 172.21.15.82:0/3140763912 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4670147c10 con 0x7f4670072110 2024-06-02T22:54:19.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.828+0000 7f46759a9640 1 -- 172.21.15.82:0/3140763912 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4670068d40 con 0x7f465006be30 2024-06-02T22:54:19.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.828+0000 7f4667fff640 1 -- 172.21.15.82:0/3140763912 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4670068d40 con 0x7f465006be30 2024-06-02T22:54:19.830 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 1 to deep-scrub 2024-06-02T22:54:19.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.830+0000 7f46759a9640 1 -- 172.21.15.82:0/3140763912 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f465006be30 msgr2=0x7f465006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.830+0000 7f46759a9640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f465006be30 0x7f465006e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4660034000 tx=0x7f466002e000 comp rx=0 tx=0).stop 2024-06-02T22:54:19.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.830+0000 7f46759a9640 1 -- 172.21.15.82:0/3140763912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4670072110 msgr2=0x7f467009b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.830+0000 7f46759a9640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4670072110 0x7f467009b420 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f465800c3c0 tx=0x7f465800c880 comp rx=0 tx=0).stop 2024-06-02T22:54:19.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.830+0000 7f46759a9640 1 -- 172.21.15.82:0/3140763912 shutdown_connections 2024-06-02T22:54:19.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.830+0000 7f46759a9640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f465006be30 0x7f465006e2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.830+0000 7f46759a9640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46700cc6d0 0x7f467009c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.830+0000 7f46759a9640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4670072110 0x7f467009b420 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.830+0000 7f46759a9640 1 --2- 172.21.15.82:0/3140763912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4670071c60 0x7f46701476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.830+0000 7f46759a9640 1 -- 172.21.15.82:0/3140763912 >> 172.21.15.82:0/3140763912 conn(0x7f46700b19f0 msgr2=0x7f46700b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:19.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.831+0000 7f46759a9640 1 -- 172.21.15.82:0/3140763912 shutdown_connections 2024-06-02T22:54:19.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.831+0000 7f46759a9640 1 -- 172.21.15.82:0/3140763912 wait complete. 2024-06-02T22:54:19.842 INFO:tasks.ceph:Scrubbing osd.2 2024-06-02T22:54:19.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-06-02T22:54:19.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.946+0000 7f1028961640 1 Processor -- start 2024-06-02T22:54:19.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.946+0000 7f1028961640 1 -- start start 2024-06-02T22:54:19.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f1028961640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10240d0e00 0x7f10240d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f1028961640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102415ec90 con 0x7f102415e670 2024-06-02T22:54:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f1028961640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102415ef70 con 0x7f10240d1f30 2024-06-02T22:54:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f1028961640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f102415fa50 con 0x7f10240d0e00 2024-06-02T22:54:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f102259c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f102415e670 0x7f10240d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48456/0 (socket says 172.21.15.82:48456) 2024-06-02T22:54:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f102259c640 1 -- 172.21.15.82:0/2961560402 learned_addr learned my addr 172.21.15.82:0/2961560402 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f1021d9b640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10240d0e00 0x7f10240d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050976579 0 0) 0x7f102415ec90 con 0x7f102415e670 2024-06-02T22:54:19.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f100c003520 con 0x7f102415e670 2024-06-02T22:54:19.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 66299957 0 0) 0x7f100c003520 con 0x7f102415e670 2024-06-02T22:54:19.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10240d0e00 msgr2=0x7f10240d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f102159a640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10240d0e00 0x7f10240d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 >> v1:172.21.15.184:6789/0 conn(0x7f10240d1f30 legacy=0x7f10240cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102415f250 con 0x7f102415e670 2024-06-02T22:54:19.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.947+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f1014001670 con 0x7f102415e670 2024-06-02T22:54:19.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 >> v1:172.21.15.82:6789/0 conn(0x7f102415e670 legacy=0x7f10240d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f102159a640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100c0039e0 0x7f100c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f102159a640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c004800 0x7f100c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f102159a640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10240d0e00 0x7f100c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f102415fa50 con 0x7f100c004800 2024-06-02T22:54:19.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f100c00bb00 con 0x7f100c0039e0 2024-06-02T22:54:19.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f100c00bcd0 con 0x7f10240d0e00 2024-06-02T22:54:19.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f1021d9b640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c004800 0x7f100c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f102259c640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100c0039e0 0x7f100c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f1022d9d640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10240d0e00 0x7f100c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f1021d9b640 1 -- 172.21.15.82:0/2961560402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10240d0e00 msgr2=0x7f100c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f1021d9b640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10240d0e00 0x7f100c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f1021d9b640 1 -- 172.21.15.82:0/2961560402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100c0039e0 msgr2=0x7f100c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:19.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f1021d9b640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f100c0039e0 0x7f100c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.948+0000 7f1021d9b640 1 -- 172.21.15.82:0/2961560402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c003520 con 0x7f100c004800 2024-06-02T22:54:19.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.949+0000 7f1021d9b640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c004800 0x7f100c004c80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1018009ac0 tx=0x7f100c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c66859a0c02c813 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.949+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018036070 con 0x7f100c004800 2024-06-02T22:54:19.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.949+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1018031400 con 0x7f100c004800 2024-06-02T22:54:19.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.949+0000 7f102159a640 1 -- 172.21.15.82:0/2961560402 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018009690 con 0x7f100c004800 2024-06-02T22:54:19.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.949+0000 7f1028961640 1 -- 172.21.15.82:0/2961560402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c004800 msgr2=0x7f100c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.949+0000 7f1028961640 1 --2- 172.21.15.82:0/2961560402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100c004800 0x7f100c004c80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1018009ac0 tx=0x7f100c005830 comp rx=0 tx=0).stop 2024-06-02T22:54:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.949+0000 7f1022d9d640 1 -- 172.21.15.82:0/2961560402 reap_dead start 2024-06-02T22:54:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.949+0000 7f1028961640 1 -- 172.21.15.82:0/2961560402 shutdown_connections 2024-06-02T22:54:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.949+0000 7f1028961640 1 -- 172.21.15.82:0/2961560402 >> 172.21.15.82:0/2961560402 conn(0x7f102409d400 msgr2=0x7f10240d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.950+0000 7f1028961640 1 -- 172.21.15.82:0/2961560402 shutdown_connections 2024-06-02T22:54:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.950+0000 7f1028961640 1 -- 172.21.15.82:0/2961560402 wait complete. 2024-06-02T22:54:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.951+0000 7f1028961640 1 Processor -- start 2024-06-02T22:54:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.951+0000 7f1028961640 1 -- start start 2024-06-02T22:54:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1028961640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f100c004800 0x7f10240b96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1028961640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10240b8d20 0x7f102415c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1028961640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10240b4ac0 0x7f10240b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1028961640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10240d23b0 con 0x7f10240b4ac0 2024-06-02T22:54:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1028961640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f102415ea50 con 0x7f10240b8d20 2024-06-02T22:54:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1028961640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f10240d49f0 con 0x7f100c004800 2024-06-02T22:54:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1022d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10240b4ac0 0x7f10240b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1022d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10240b4ac0 0x7f10240b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33308/0 (socket says 172.21.15.82:33308) 2024-06-02T22:54:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f102259c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f100c004800 0x7f10240b96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1021d9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10240b8d20 0x7f102415c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1022d9d640 1 -- 172.21.15.82:0/900187134 learned_addr learned my addr 172.21.15.82:0/900187134 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1022d9d640 1 -- 172.21.15.82:0/900187134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f100c004800 msgr2=0x7f10240b96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1022d9d640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f100c004800 0x7f10240b96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1022d9d640 1 -- 172.21.15.82:0/900187134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10240b8d20 msgr2=0x7f102415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1022d9d640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10240b8d20 0x7f102415c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1022d9d640 1 -- 172.21.15.82:0/900187134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10240b9200 con 0x7f10240b4ac0 2024-06-02T22:54:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1022d9d640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10240b4ac0 0x7f10240b4f50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f102408e240 tx=0x7f101c00fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1012ffd640 1 -- 172.21.15.82:0/900187134 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c003970 con 0x7f10240b4ac0 2024-06-02T22:54:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1012ffd640 1 -- 172.21.15.82:0/900187134 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f101c018070 con 0x7f10240b4ac0 2024-06-02T22:54:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1012ffd640 1 -- 172.21.15.82:0/900187134 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c003d70 con 0x7f10240b4ac0 2024-06-02T22:54:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1028961640 1 -- 172.21.15.82:0/900187134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10240ccac0 con 0x7f10240b4ac0 2024-06-02T22:54:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.952+0000 7f1028961640 1 -- 172.21.15.82:0/900187134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f102415d200 con 0x7f10240b4ac0 2024-06-02T22:54:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.953+0000 7f1028961640 1 -- 172.21.15.82:0/900187134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1024068540 con 0x7f10240b4ac0 2024-06-02T22:54:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.954+0000 7f1012ffd640 1 -- 172.21.15.82:0/900187134 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f101c0050d0 con 0x7f10240b4ac0 2024-06-02T22:54:19.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.955+0000 7f1012ffd640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f100406be30 0x7f100406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.955+0000 7f102259c640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f100406be30 0x7f100406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.955+0000 7f1012ffd640 1 -- 172.21.15.82:0/900187134 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f101c08a990 con 0x7f10240b4ac0 2024-06-02T22:54:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.955+0000 7f1012ffd640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] conn(0x7f10040722d0 0x7f1004074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.955+0000 7f1012ffd640 1 -- 172.21.15.82:0/900187134 --> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1004074de0 con 0x7f10040722d0 2024-06-02T22:54:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.955+0000 7f1012ffd640 1 -- 172.21.15.82:0/900187134 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f101c08f2c0 con 0x7f10240b4ac0 2024-06-02T22:54:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.955+0000 7f1021d9b640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] conn(0x7f10040722d0 0x7f1004074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.955+0000 7f102259c640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f100406be30 0x7f100406e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1014001cf0 tx=0x7f1014001c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.956+0000 7f1021d9b640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] conn(0x7f10040722d0 0x7f1004074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:19.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.956+0000 7f1012ffd640 1 -- 172.21.15.82:0/900187134 <== osd.2 v2:172.21.15.82:6800/2442500293 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1004074de0 con 0x7f10040722d0 2024-06-02T22:54:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.969+0000 7f1028961640 1 -- 172.21.15.82:0/900187134 --> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1024068b30 con 0x7f10040722d0 2024-06-02T22:54:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.969+0000 7f1012ffd640 1 -- 172.21.15.82:0/900187134 <== osd.2 v2:172.21.15.82:6800/2442500293 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1024068b30 con 0x7f10040722d0 2024-06-02T22:54:19.971 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:54:19.971 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T22:54:19.971 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:54:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.970+0000 7f1028961640 1 -- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] conn(0x7f10040722d0 msgr2=0x7f1004074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.970+0000 7f1028961640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:6800/2442500293,v1:172.21.15.82:6801/2442500293] conn(0x7f10040722d0 0x7f1004074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.970+0000 7f1028961640 1 -- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f100406be30 msgr2=0x7f100406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.970+0000 7f1028961640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f100406be30 0x7f100406e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1014001cf0 tx=0x7f1014001c60 comp rx=0 tx=0).stop 2024-06-02T22:54:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.970+0000 7f1028961640 1 -- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10240b4ac0 msgr2=0x7f10240b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.970+0000 7f1028961640 1 --2- 172.21.15.82:0/900187134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10240b4ac0 0x7f10240b4f50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f102408e240 tx=0x7f101c00fb90 comp rx=0 tx=0).stop 2024-06-02T22:54:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.970+0000 7f1022d9d640 1 -- 172.21.15.82:0/900187134 reap_dead start 2024-06-02T22:54:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.970+0000 7f1028961640 1 -- 172.21.15.82:0/900187134 shutdown_connections 2024-06-02T22:54:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.970+0000 7f1028961640 1 -- 172.21.15.82:0/900187134 >> 172.21.15.82:0/900187134 conn(0x7f102409d400 msgr2=0x7f10240ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.970+0000 7f1028961640 1 -- 172.21.15.82:0/900187134 shutdown_connections 2024-06-02T22:54:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:19.970+0000 7f1028961640 1 -- 172.21.15.82:0/900187134 wait complete. 2024-06-02T22:54:19.981 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-06-02T22:54:20.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.080+0000 7fad56b9e640 1 Processor -- start 2024-06-02T22:54:20.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.080+0000 7fad56b9e640 1 -- start start 2024-06-02T22:54:20.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.081+0000 7fad56b9e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fad5015f1a0 0x7fad500d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.081+0000 7fad56b9e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad5015f5e0 con 0x7fad500d2680 2024-06-02T22:54:20.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.081+0000 7fad56b9e640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad500d0ad0 con 0x7fad500cef70 2024-06-02T22:54:20.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.081+0000 7fad56b9e640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fad500d13e0 con 0x7fad5015f1a0 2024-06-02T22:54:20.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.081+0000 7fad5493a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fad500d2680 0x7fad500d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48468/0 (socket says 172.21.15.82:48468) 2024-06-02T22:54:20.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.081+0000 7fad5493a640 1 -- 172.21.15.82:0/1388345458 learned_addr learned my addr 172.21.15.82:0/1388345458 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:20.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.081+0000 7fad4ffff640 1 --2- 172.21.15.82:0/1388345458 >> v2:172.21.15.184:3300/0 conn(0x7fad5015f1a0 0x7fad500d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.081+0000 7fad4f7fe640 1 -- 172.21.15.82:0/1388345458 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 725241291 0 0) 0x7fad5015f5e0 con 0x7fad500d2680 2024-06-02T22:54:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.081+0000 7fad4f7fe640 1 -- 172.21.15.82:0/1388345458 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad40003520 con 0x7fad500d2680 2024-06-02T22:54:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.082+0000 7fad4ffff640 1 -- 172.21.15.82:0/1388345458 >> v1:172.21.15.184:6789/0 conn(0x7fad500cef70 legacy=0x7fad500cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.082+0000 7fad4ffff640 1 -- 172.21.15.82:0/1388345458 >> v1:172.21.15.82:6789/0 conn(0x7fad500d2680 legacy=0x7fad500d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.082+0000 7fad4ffff640 1 -- 172.21.15.82:0/1388345458 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5015f890 con 0x7fad5015f1a0 2024-06-02T22:54:20.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.082+0000 7fad4ffff640 1 --2- 172.21.15.82:0/1388345458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad5015f1a0 0x7fad500d1fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0097a0 tx=0x7fad3c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93811618b1a14f6d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.082+0000 7fad4f7fe640 1 -- 172.21.15.82:0/1388345458 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c037070 con 0x7fad5015f1a0 2024-06-02T22:54:20.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.082+0000 7fad4f7fe640 1 -- 172.21.15.82:0/1388345458 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad3c032440 con 0x7fad5015f1a0 2024-06-02T22:54:20.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.083+0000 7fad4f7fe640 1 -- 172.21.15.82:0/1388345458 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c032810 con 0x7fad5015f1a0 2024-06-02T22:54:20.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.083+0000 7fad56b9e640 1 -- 172.21.15.82:0/1388345458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad5015f1a0 msgr2=0x7fad500d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.083+0000 7fad56b9e640 1 --2- 172.21.15.82:0/1388345458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad5015f1a0 0x7fad500d1fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0097a0 tx=0x7fad3c02a230 comp rx=0 tx=0).stop 2024-06-02T22:54:20.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.083+0000 7fad56b9e640 1 -- 172.21.15.82:0/1388345458 shutdown_connections 2024-06-02T22:54:20.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.083+0000 7fad56b9e640 1 --2- 172.21.15.82:0/1388345458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad5015f1a0 0x7fad500d1fc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.083+0000 7fad56b9e640 1 -- 172.21.15.82:0/1388345458 >> 172.21.15.82:0/1388345458 conn(0x7fad5009d3f0 msgr2=0x7fad500d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:20.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.083+0000 7fad56b9e640 1 -- 172.21.15.82:0/1388345458 shutdown_connections 2024-06-02T22:54:20.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.083+0000 7fad56b9e640 1 -- 172.21.15.82:0/1388345458 wait complete. 2024-06-02T22:54:20.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.084+0000 7fad56b9e640 1 Processor -- start 2024-06-02T22:54:20.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.084+0000 7fad56b9e640 1 -- start start 2024-06-02T22:54:20.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.085+0000 7fad56b9e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad500cef70 0x7fad500cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.085+0000 7fad56b9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad500d2680 0x7fad50159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.085+0000 7fad56b9e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad5015f1a0 0x7fad50159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.085+0000 7fad56b9e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fad500d4f00 con 0x7fad500d2680 2024-06-02T22:54:20.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.085+0000 7fad56b9e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fad500d1070 con 0x7fad500cef70 2024-06-02T22:54:20.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.085+0000 7fad56b9e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fad500d1870 con 0x7fad5015f1a0 2024-06-02T22:54:20.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.085+0000 7fad4ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad500d2680 0x7fad50159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.085+0000 7fad4ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad500d2680 0x7fad50159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33310/0 (socket says 172.21.15.82:33310) 2024-06-02T22:54:20.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.085+0000 7fad4ffff640 1 -- 172.21.15.82:0/2860607908 learned_addr learned my addr 172.21.15.82:0/2860607908 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:20.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.085+0000 7fad5493a640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad500cef70 0x7fad500cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.085+0000 7fad5513b640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad5015f1a0 0x7fad50159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad4ffff640 1 -- 172.21.15.82:0/2860607908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad5015f1a0 msgr2=0x7fad50159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad4ffff640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad5015f1a0 0x7fad50159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad4ffff640 1 -- 172.21.15.82:0/2860607908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad500cef70 msgr2=0x7fad500cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad4ffff640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad500cef70 0x7fad500cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad4ffff640 1 -- 172.21.15.82:0/2860607908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5015b760 con 0x7fad500d2680 2024-06-02T22:54:20.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad5513b640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad5015f1a0 0x7fad50159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:20.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad4ffff640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad500d2680 0x7fad50159440 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad3c035040 tx=0x7fad3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad4d7fa640 1 -- 172.21.15.82:0/2860607908 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c037040 con 0x7fad500d2680 2024-06-02T22:54:20.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad4d7fa640 1 -- 172.21.15.82:0/2860607908 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad3c030500 con 0x7fad500d2680 2024-06-02T22:54:20.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad56b9e640 1 -- 172.21.15.82:0/2860607908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad5015ba40 con 0x7fad500d2680 2024-06-02T22:54:20.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad4d7fa640 1 -- 172.21.15.82:0/2860607908 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c030910 con 0x7fad500d2680 2024-06-02T22:54:20.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.086+0000 7fad56b9e640 1 -- 172.21.15.82:0/2860607908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad5015c000 con 0x7fad500d2680 2024-06-02T22:54:20.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.087+0000 7fad56b9e640 1 -- 172.21.15.82:0/2860607908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad5009d7d0 con 0x7fad500d2680 2024-06-02T22:54:20.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.088+0000 7fad4d7fa640 1 -- 172.21.15.82:0/2860607908 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad3c044020 con 0x7fad500d2680 2024-06-02T22:54:20.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.088+0000 7fad4d7fa640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fad3406be30 0x7fad3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.088+0000 7fad4d7fa640 1 -- 172.21.15.82:0/2860607908 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fad3c0aaec0 con 0x7fad500d2680 2024-06-02T22:54:20.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.088+0000 7fad5493a640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fad3406be30 0x7fad3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.088+0000 7fad5493a640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fad3406be30 0x7fad3406e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fad440011e0 tx=0x7fad44007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.092+0000 7fad4d7fa640 1 -- 172.21.15.82:0/2860607908 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fad5009d7d0 con 0x7fad500d2680 2024-06-02T22:54:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.267+0000 7fad56b9e640 1 -- 172.21.15.82:0/2860607908 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fad50068430 con 0x7fad3406be30 2024-06-02T22:54:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.268+0000 7fad4d7fa640 1 -- 172.21.15.82:0/2860607908 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fad50068430 con 0x7fad3406be30 2024-06-02T22:54:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 2 to deep-scrub 2024-06-02T22:54:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.269+0000 7fad56b9e640 1 -- 172.21.15.82:0/2860607908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fad3406be30 msgr2=0x7fad3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.269+0000 7fad56b9e640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fad3406be30 0x7fad3406e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fad440011e0 tx=0x7fad44007d30 comp rx=0 tx=0).stop 2024-06-02T22:54:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.269+0000 7fad56b9e640 1 -- 172.21.15.82:0/2860607908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad500d2680 msgr2=0x7fad50159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.269+0000 7fad56b9e640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad500d2680 0x7fad50159440 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad3c035040 tx=0x7fad3c0046c0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.270+0000 7fad56b9e640 1 -- 172.21.15.82:0/2860607908 shutdown_connections 2024-06-02T22:54:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.270+0000 7fad56b9e640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fad3406be30 0x7fad3406e2f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.270+0000 7fad56b9e640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad5015f1a0 0x7fad50159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.270+0000 7fad56b9e640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad500d2680 0x7fad50159440 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.270+0000 7fad56b9e640 1 --2- 172.21.15.82:0/2860607908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad500cef70 0x7fad500cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.270+0000 7fad56b9e640 1 -- 172.21.15.82:0/2860607908 >> 172.21.15.82:0/2860607908 conn(0x7fad5009d3f0 msgr2=0x7fad5015a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.270+0000 7fad56b9e640 1 -- 172.21.15.82:0/2860607908 shutdown_connections 2024-06-02T22:54:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.270+0000 7fad56b9e640 1 -- 172.21.15.82:0/2860607908 wait complete. 2024-06-02T22:54:20.281 INFO:tasks.ceph:Scrubbing osd.3 2024-06-02T22:54:20.281 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-06-02T22:54:20.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.383+0000 7f71a0012640 1 Processor -- start 2024-06-02T22:54:20.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.383+0000 7f71a0012640 1 -- start start 2024-06-02T22:54:20.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f71a0012640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7198155590 0x7f719815b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f71a0012640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f719815b9a0 0x7f71980cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f71a0012640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71980cf1a0 0x7f719815eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f71a0012640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f71980acd40 con 0x7f719815b9a0 2024-06-02T22:54:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f71a0012640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f719815bfe0 con 0x7f7198155590 2024-06-02T22:54:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f71a0012640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f719815c2c0 con 0x7f71980cf1a0 2024-06-02T22:54:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f719d5ad640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f719815b9a0 0x7f71980cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f719d5ad640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f719815b9a0 0x7f71980cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33318/0 (socket says 172.21.15.82:33318) 2024-06-02T22:54:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f719d5ad640 1 -- 172.21.15.82:0/3442679957 learned_addr learned my addr 172.21.15.82:0/3442679957 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f719ddae640 1 --2- 172.21.15.82:0/3442679957 >> v2:172.21.15.184:3300/0 conn(0x7f7198155590 0x7f719815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f719e5af640 1 --2- 172.21.15.82:0/3442679957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71980cf1a0 0x7f719815eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f719d5ad640 1 -- 172.21.15.82:0/3442679957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71980cf1a0 msgr2=0x7f719815eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f719d5ad640 1 --2- 172.21.15.82:0/3442679957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71980cf1a0 0x7f719815eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f719d5ad640 1 -- 172.21.15.82:0/3442679957 >> v2:172.21.15.184:3300/0 conn(0x7f7198155590 msgr2=0x7f719815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f719d5ad640 1 --2- 172.21.15.82:0/3442679957 >> v2:172.21.15.184:3300/0 conn(0x7f7198155590 0x7f719815b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f719d5ad640 1 -- 172.21.15.82:0/3442679957 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71980ad000 con 0x7f719815b9a0 2024-06-02T22:54:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.384+0000 7f719e5af640 1 --2- 172.21.15.82:0/3442679957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71980cf1a0 0x7f719815eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.385+0000 7f719d5ad640 1 --2- 172.21.15.82:0/3442679957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f719815b9a0 0x7f71980cec60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7198074220 tx=0x7f718802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2218e73319829404 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.385+0000 7f719cdac640 1 -- 172.21.15.82:0/3442679957 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188037070 con 0x7f719815b9a0 2024-06-02T22:54:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.385+0000 7f719cdac640 1 -- 172.21.15.82:0/3442679957 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7188032440 con 0x7f719815b9a0 2024-06-02T22:54:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.385+0000 7f719cdac640 1 -- 172.21.15.82:0/3442679957 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188032810 con 0x7f719815b9a0 2024-06-02T22:54:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.385+0000 7f71a0012640 1 -- 172.21.15.82:0/3442679957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f719815b9a0 msgr2=0x7f71980cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.385+0000 7f71a0012640 1 --2- 172.21.15.82:0/3442679957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f719815b9a0 0x7f71980cec60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7198074220 tx=0x7f718802a1e0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.385+0000 7f71a0012640 1 -- 172.21.15.82:0/3442679957 shutdown_connections 2024-06-02T22:54:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.385+0000 7f71a0012640 1 --2- 172.21.15.82:0/3442679957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71980cf1a0 0x7f719815eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.385+0000 7f71a0012640 1 --2- 172.21.15.82:0/3442679957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f719815b9a0 0x7f71980cec60 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.386+0000 7f71a0012640 1 --2- 172.21.15.82:0/3442679957 >> v2:172.21.15.184:3300/0 conn(0x7f7198155590 0x7f719815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.386+0000 7f71a0012640 1 -- 172.21.15.82:0/3442679957 >> 172.21.15.82:0/3442679957 conn(0x7f71980b1980 msgr2=0x7f71980b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.386+0000 7f71a0012640 1 -- 172.21.15.82:0/3442679957 shutdown_connections 2024-06-02T22:54:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.386+0000 7f71a0012640 1 -- 172.21.15.82:0/3442679957 wait complete. 2024-06-02T22:54:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.387+0000 7f71a0012640 1 Processor -- start 2024-06-02T22:54:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.387+0000 7f71a0012640 1 -- start start 2024-06-02T22:54:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.387+0000 7f71a0012640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71980cf1a0 0x7f7198147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.387+0000 7f71a0012640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7198155590 0x7f71981f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.387+0000 7f71a0012640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f719815b9a0 0x7f719815e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.387+0000 7f71a0012640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f719815efe0 con 0x7f71980cf1a0 2024-06-02T22:54:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.387+0000 7f71a0012640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f71980b26d0 con 0x7f719815b9a0 2024-06-02T22:54:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.387+0000 7f71a0012640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f719815f160 con 0x7f7198155590 2024-06-02T22:54:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719ddae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71980cf1a0 0x7f7198147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719ddae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71980cf1a0 0x7f7198147750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33320/0 (socket says 172.21.15.82:33320) 2024-06-02T22:54:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719ddae640 1 -- 172.21.15.82:0/168632354 learned_addr learned my addr 172.21.15.82:0/168632354 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719e5af640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f719815b9a0 0x7f719815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719d5ad640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7198155590 0x7f71981f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719ddae640 1 -- 172.21.15.82:0/168632354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7198155590 msgr2=0x7f71981f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719ddae640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7198155590 0x7f71981f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719ddae640 1 -- 172.21.15.82:0/168632354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f719815b9a0 msgr2=0x7f719815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719ddae640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f719815b9a0 0x7f719815e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719ddae640 1 -- 172.21.15.82:0/168632354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719815e790 con 0x7f71980cf1a0 2024-06-02T22:54:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719e5af640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f719815b9a0 0x7f719815e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:54:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719d5ad640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7198155590 0x7f71981f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:54:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f719ddae640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71980cf1a0 0x7f7198147750 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f719400e9e0 tx=0x7f719400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f718e7fc640 1 -- 172.21.15.82:0/168632354 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194017070 con 0x7f71980cf1a0 2024-06-02T22:54:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f718e7fc640 1 -- 172.21.15.82:0/168632354 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719400c970 con 0x7f71980cf1a0 2024-06-02T22:54:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f71a0012640 1 -- 172.21.15.82:0/168632354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719815c500 con 0x7f71980cf1a0 2024-06-02T22:54:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f718e7fc640 1 -- 172.21.15.82:0/168632354 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719400cd60 con 0x7f71980cf1a0 2024-06-02T22:54:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.388+0000 7f71a0012640 1 -- 172.21.15.82:0/168632354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71981f49d0 con 0x7f71980cf1a0 2024-06-02T22:54:20.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.389+0000 7f71a0012640 1 -- 172.21.15.82:0/168632354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7198068540 con 0x7f71980cf1a0 2024-06-02T22:54:20.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.390+0000 7f718e7fc640 1 -- 172.21.15.82:0/168632354 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f719401a070 con 0x7f71980cf1a0 2024-06-02T22:54:20.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.390+0000 7f718e7fc640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f717c06be30 0x7f717c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.390+0000 7f718e7fc640 1 -- 172.21.15.82:0/168632354 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f719408ac90 con 0x7f71980cf1a0 2024-06-02T22:54:20.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.390+0000 7f719d5ad640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f717c06be30 0x7f717c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.390+0000 7f718e7fc640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] conn(0x7f717c0722d0 0x7f717c074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.390+0000 7f718e7fc640 1 -- 172.21.15.82:0/168632354 --> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f717c074de0 con 0x7f717c0722d0 2024-06-02T22:54:20.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.390+0000 7f718e7fc640 1 -- 172.21.15.82:0/168632354 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f719408d390 con 0x7f71980cf1a0 2024-06-02T22:54:20.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.390+0000 7f719e5af640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] conn(0x7f717c0722d0 0x7f717c074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.390+0000 7f719d5ad640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f717c06be30 0x7f717c06e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7188034000 tx=0x7f718802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.391+0000 7f719e5af640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] conn(0x7f717c0722d0 0x7f717c074710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.391+0000 7f718e7fc640 1 -- 172.21.15.82:0/168632354 <== osd.3 v2:172.21.15.82:6816/1784876455 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f717c074de0 con 0x7f717c0722d0 2024-06-02T22:54:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.404+0000 7f71a0012640 1 -- 172.21.15.82:0/168632354 --> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f719815b5e0 con 0x7f717c0722d0 2024-06-02T22:54:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.404+0000 7f718e7fc640 1 -- 172.21.15.82:0/168632354 <== osd.3 v2:172.21.15.82:6816/1784876455 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f719815b5e0 con 0x7f717c0722d0 2024-06-02T22:54:20.405 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:54:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T22:54:20.406 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:54:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.405+0000 7f71a0012640 1 -- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] conn(0x7f717c0722d0 msgr2=0x7f717c074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.405+0000 7f71a0012640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:6816/1784876455,v1:172.21.15.82:6818/1784876455] conn(0x7f717c0722d0 0x7f717c074710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.405+0000 7f71a0012640 1 -- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f717c06be30 msgr2=0x7f717c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.405+0000 7f71a0012640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f717c06be30 0x7f717c06e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7188034000 tx=0x7f718802e000 comp rx=0 tx=0).stop 2024-06-02T22:54:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.405+0000 7f71a0012640 1 -- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71980cf1a0 msgr2=0x7f7198147750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.405+0000 7f71a0012640 1 --2- 172.21.15.82:0/168632354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71980cf1a0 0x7f7198147750 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f719400e9e0 tx=0x7f719400eea0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.405+0000 7f719e5af640 1 -- 172.21.15.82:0/168632354 reap_dead start 2024-06-02T22:54:20.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.405+0000 7f71a0012640 1 -- 172.21.15.82:0/168632354 shutdown_connections 2024-06-02T22:54:20.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.405+0000 7f71a0012640 1 -- 172.21.15.82:0/168632354 >> 172.21.15.82:0/168632354 conn(0x7f71980b1980 msgr2=0x7f71980722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:20.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.405+0000 7f71a0012640 1 -- 172.21.15.82:0/168632354 shutdown_connections 2024-06-02T22:54:20.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.405+0000 7f71a0012640 1 -- 172.21.15.82:0/168632354 wait complete. 2024-06-02T22:54:20.416 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-06-02T22:54:20.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.515+0000 7f365b934640 1 Processor -- start 2024-06-02T22:54:20.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.515+0000 7f365b934640 1 -- start start 2024-06-02T22:54:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.516+0000 7f365b934640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540d2680 0x7f365415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.516+0000 7f365b934640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36540d0ad0 con 0x7f36540cef70 2024-06-02T22:54:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.516+0000 7f365b934640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365415f890 con 0x7f36540d1fc0 2024-06-02T22:54:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.516+0000 7f365b934640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f36540d13e0 con 0x7f36540d2680 2024-06-02T22:54:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.516+0000 7f3659ed1640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f36540cef70 0x7f36540cf400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48472/0 (socket says 172.21.15.82:48472) 2024-06-02T22:54:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.516+0000 7f3659ed1640 1 -- 172.21.15.82:0/3522917506 learned_addr learned my addr 172.21.15.82:0/3522917506 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880944376 0 0) 0x7f36540d0ad0 con 0x7f36540cef70 2024-06-02T22:54:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f36596d0640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540d2680 0x7f365415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f363c003520 con 0x7f36540cef70 2024-06-02T22:54:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2929588844 0 0) 0x7f363c003520 con 0x7f36540cef70 2024-06-02T22:54:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540d2680 msgr2=0x7f365415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540d2680 0x7f365415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 >> v1:172.21.15.184:6789/0 conn(0x7f36540d1fc0 legacy=0x7f36540d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36540d0d90 con 0x7f36540cef70 2024-06-02T22:54:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f364c001670 con 0x7f36540cef70 2024-06-02T22:54:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 >> v1:172.21.15.82:6789/0 conn(0x7f36540cef70 legacy=0x7f36540cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f363c0039e0 0x7f363c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c004390 0x7f363c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540d2680 0x7f363c0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36540d13e0 con 0x7f363c0039e0 2024-06-02T22:54:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f363c00b9c0 con 0x7f363c004390 2024-06-02T22:54:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f363c00bbc0 con 0x7f36540d2680 2024-06-02T22:54:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f36596d0640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f363c0039e0 0x7f363c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3658ecf640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c004390 0x7f363c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f3659ed1640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540d2680 0x7f363c0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f36596d0640 1 -- 172.21.15.82:0/3522917506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540d2680 msgr2=0x7f363c0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f36596d0640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540d2680 0x7f363c0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f36596d0640 1 -- 172.21.15.82:0/3522917506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c004390 msgr2=0x7f363c004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f36596d0640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c004390 0x7f363c004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.517+0000 7f36596d0640 1 -- 172.21.15.82:0/3522917506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363c003520 con 0x7f363c0039e0 2024-06-02T22:54:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.518+0000 7f36596d0640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f363c0039e0 0x7f363c003dc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3644009fc0 tx=0x7f363c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fe16ae350f9d45 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.518+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644009c10 con 0x7f363c0039e0 2024-06-02T22:54:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.518+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3644036070 con 0x7f363c0039e0 2024-06-02T22:54:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.518+0000 7f3653fff640 1 -- 172.21.15.82:0/3522917506 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644031880 con 0x7f363c0039e0 2024-06-02T22:54:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.519+0000 7f365b934640 1 -- 172.21.15.82:0/3522917506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f363c0039e0 msgr2=0x7f363c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.519+0000 7f365b934640 1 --2- 172.21.15.82:0/3522917506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f363c0039e0 0x7f363c003dc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3644009fc0 tx=0x7f363c005830 comp rx=0 tx=0).stop 2024-06-02T22:54:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.519+0000 7f3659ed1640 1 -- 172.21.15.82:0/3522917506 reap_dead start 2024-06-02T22:54:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.519+0000 7f365b934640 1 -- 172.21.15.82:0/3522917506 shutdown_connections 2024-06-02T22:54:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.519+0000 7f365b934640 1 -- 172.21.15.82:0/3522917506 >> 172.21.15.82:0/3522917506 conn(0x7f365409d3f0 msgr2=0x7f36540d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.519+0000 7f365b934640 1 -- 172.21.15.82:0/3522917506 shutdown_connections 2024-06-02T22:54:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.519+0000 7f365b934640 1 -- 172.21.15.82:0/3522917506 wait complete. 2024-06-02T22:54:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.520+0000 7f365b934640 1 Processor -- start 2024-06-02T22:54:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.520+0000 7f365b934640 1 -- start start 2024-06-02T22:54:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f365b934640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c0039e0 0x7f365414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f365b934640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540a1980 0x7f365415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f365b934640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365409f930 0x7f365409fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f365b934640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36540d4f00 con 0x7f365409f930 2024-06-02T22:54:20.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f365b934640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f36540d2400 con 0x7f363c0039e0 2024-06-02T22:54:20.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f365b934640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f36540d1870 con 0x7f36540a1980 2024-06-02T22:54:20.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3659ed1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365409f930 0x7f365409fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3659ed1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365409f930 0x7f365409fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33336/0 (socket says 172.21.15.82:33336) 2024-06-02T22:54:20.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3659ed1640 1 -- 172.21.15.82:0/949508769 learned_addr learned my addr 172.21.15.82:0/949508769 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f36596d0640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c0039e0 0x7f365414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3658ecf640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540a1980 0x7f365415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3659ed1640 1 -- 172.21.15.82:0/949508769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540a1980 msgr2=0x7f365415c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3659ed1640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540a1980 0x7f365415c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3659ed1640 1 -- 172.21.15.82:0/949508769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c0039e0 msgr2=0x7f365414e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3659ed1640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c0039e0 0x7f365414e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3659ed1640 1 -- 172.21.15.82:0/949508769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365415eaf0 con 0x7f365409f930 2024-06-02T22:54:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3659ed1640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365409f930 0x7f365409fdb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f365408caa0 tx=0x7f364c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3651ffb640 1 -- 172.21.15.82:0/949508769 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c019070 con 0x7f365409f930 2024-06-02T22:54:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3651ffb640 1 -- 172.21.15.82:0/949508769 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c00c630 con 0x7f365409f930 2024-06-02T22:54:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f365b934640 1 -- 172.21.15.82:0/949508769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365415b230 con 0x7f365409f930 2024-06-02T22:54:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.521+0000 7f3651ffb640 1 -- 172.21.15.82:0/949508769 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c00ca00 con 0x7f365409f930 2024-06-02T22:54:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.522+0000 7f365b934640 1 -- 172.21.15.82:0/949508769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365415b7f0 con 0x7f365409f930 2024-06-02T22:54:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.522+0000 7f365b934640 1 -- 172.21.15.82:0/949508769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3654068430 con 0x7f365409f930 2024-06-02T22:54:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.523+0000 7f3651ffb640 1 -- 172.21.15.82:0/949508769 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f364c00cba0 con 0x7f365409f930 2024-06-02T22:54:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.523+0000 7f3651ffb640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f364006be60 0x7f364006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.523+0000 7f36596d0640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f364006be60 0x7f364006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.523+0000 7f3651ffb640 1 -- 172.21.15.82:0/949508769 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f364c089db0 con 0x7f365409f930 2024-06-02T22:54:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.524+0000 7f36596d0640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f364006be60 0x7f364006e320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3644007090 tx=0x7f364402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.528+0000 7f3651ffb640 1 -- 172.21.15.82:0/949508769 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f365415eaf0 con 0x7f365409f930 2024-06-02T22:54:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.700+0000 7f365b934640 1 -- 172.21.15.82:0/949508769 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f36540d04e0 con 0x7f364006be60 2024-06-02T22:54:20.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.701+0000 7f3651ffb640 1 -- 172.21.15.82:0/949508769 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f36540d04e0 con 0x7f364006be60 2024-06-02T22:54:20.702 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 3 to deep-scrub 2024-06-02T22:54:20.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 -- 172.21.15.82:0/949508769 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f364006be60 msgr2=0x7f364006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f364006be60 0x7f364006e320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3644007090 tx=0x7f364402f000 comp rx=0 tx=0).stop 2024-06-02T22:54:20.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 -- 172.21.15.82:0/949508769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365409f930 msgr2=0x7f365409fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365409f930 0x7f365409fdb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f365408caa0 tx=0x7f364c00eb90 comp rx=0 tx=0).stop 2024-06-02T22:54:20.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 -- 172.21.15.82:0/949508769 shutdown_connections 2024-06-02T22:54:20.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f364006be60 0x7f364006e320 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f365409f930 0x7f365409fdb0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36540a1980 0x7f365415c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 --2- 172.21.15.82:0/949508769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c0039e0 0x7f365414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 -- 172.21.15.82:0/949508769 >> 172.21.15.82:0/949508769 conn(0x7f365409d3f0 msgr2=0x7f36540c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 -- 172.21.15.82:0/949508769 shutdown_connections 2024-06-02T22:54:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.703+0000 7f365b934640 1 -- 172.21.15.82:0/949508769 wait complete. 2024-06-02T22:54:20.714 INFO:tasks.ceph:Scrubbing osd.4 2024-06-02T22:54:20.715 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-06-02T22:54:20.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.817+0000 7f22ec2ba640 1 Processor -- start 2024-06-02T22:54:20.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.817+0000 7f22ec2ba640 1 -- start start 2024-06-02T22:54:20.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.818+0000 7f22ec2ba640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40d0e00 0x7f22e40d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.818+0000 7f22ec2ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e415ec90 con 0x7f22e415e670 2024-06-02T22:54:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.818+0000 7f22ec2ba640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e415ef70 con 0x7f22e40d1f30 2024-06-02T22:54:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.818+0000 7f22ec2ba640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f22e415fa50 con 0x7f22e40d0e00 2024-06-02T22:54:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22ea056640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f22e415e670 0x7f22e40d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48478/0 (socket says 172.21.15.82:48478) 2024-06-02T22:54:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22ea056640 1 -- 172.21.15.82:0/1889561085 learned_addr learned my addr 172.21.15.82:0/1889561085 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9855640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40d0e00 0x7f22e40d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632331836 0 0) 0x7f22e415ec90 con 0x7f22e415e670 2024-06-02T22:54:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22d0003520 con 0x7f22e415e670 2024-06-02T22:54:20.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973664238 0 0) 0x7f22e415ef70 con 0x7f22e40d1f30 2024-06-02T22:54:20.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22e415ec90 con 0x7f22e40d1f30 2024-06-02T22:54:20.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 515837269 0 0) 0x7f22d0003520 con 0x7f22e415e670 2024-06-02T22:54:20.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40d0e00 msgr2=0x7f22e40d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:20.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40d0e00 0x7f22e40d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 >> v1:172.21.15.184:6789/0 conn(0x7f22e40d1f30 legacy=0x7f22e40cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e415f250 con 0x7f22e415e670 2024-06-02T22:54:20.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f22e0001670 con 0x7f22e415e670 2024-06-02T22:54:20.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 >> v1:172.21.15.82:6789/0 conn(0x7f22e415e670 legacy=0x7f22e40d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40d0e00 0x7f22d0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22d00040d0 0x7f22d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d0004d40 0x7f22d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22e415fa50 con 0x7f22d00040d0 2024-06-02T22:54:20.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f22d000baa0 con 0x7f22d0004d40 2024-06-02T22:54:20.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f22d000bca0 con 0x7f22e40d0e00 2024-06-02T22:54:20.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22e9855640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22d00040d0 0x7f22d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22ea056640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40d0e00 0x7f22d0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.819+0000 7f22ea857640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d0004d40 0x7f22d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.820+0000 7f22e9855640 1 -- 172.21.15.82:0/1889561085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40d0e00 msgr2=0x7f22d0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.820+0000 7f22e9855640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40d0e00 0x7f22d0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.820+0000 7f22e9855640 1 -- 172.21.15.82:0/1889561085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d0004d40 msgr2=0x7f22d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.820+0000 7f22e9855640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d0004d40 0x7f22d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.820+0000 7f22e9855640 1 -- 172.21.15.82:0/1889561085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d0003520 con 0x7f22d00040d0 2024-06-02T22:54:20.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.820+0000 7f22e9855640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22d00040d0 0x7f22d0004800 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009ac0 tx=0x7f22d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7246de2d4c659ca server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.820+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4036070 con 0x7f22d00040d0 2024-06-02T22:54:20.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.820+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d4031400 con 0x7f22d00040d0 2024-06-02T22:54:20.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.820+0000 7f22e9054640 1 -- 172.21.15.82:0/1889561085 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4009690 con 0x7f22d00040d0 2024-06-02T22:54:20.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.821+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1889561085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22d00040d0 msgr2=0x7f22d0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.821+0000 7f22ec2ba640 1 --2- 172.21.15.82:0/1889561085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22d00040d0 0x7f22d0004800 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009ac0 tx=0x7f22d0005830 comp rx=0 tx=0).stop 2024-06-02T22:54:20.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.821+0000 7f22ea857640 1 -- 172.21.15.82:0/1889561085 reap_dead start 2024-06-02T22:54:20.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.821+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1889561085 shutdown_connections 2024-06-02T22:54:20.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.821+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1889561085 >> 172.21.15.82:0/1889561085 conn(0x7f22e409d400 msgr2=0x7f22e40d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.821+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1889561085 shutdown_connections 2024-06-02T22:54:20.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.821+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1889561085 wait complete. 2024-06-02T22:54:20.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.822+0000 7f22ec2ba640 1 Processor -- start 2024-06-02T22:54:20.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.822+0000 7f22ec2ba640 1 -- start start 2024-06-02T22:54:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ec2ba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d00040d0 0x7f22e41f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ec2ba640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40ca280 0x7f22e40ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ec2ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e41f7510 0x7f22e41f79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ec2ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22e40d23b0 con 0x7f22e41f7510 2024-06-02T22:54:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ec2ba640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f22e415ea50 con 0x7f22d00040d0 2024-06-02T22:54:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ec2ba640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f22e40d49f0 con 0x7f22e40ca280 2024-06-02T22:54:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ea857640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e41f7510 0x7f22e41f79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ea857640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e41f7510 0x7f22e41f79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33344/0 (socket says 172.21.15.82:33344) 2024-06-02T22:54:20.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ea857640 1 -- 172.21.15.82:0/1847151750 learned_addr learned my addr 172.21.15.82:0/1847151750 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:20.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ea056640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d00040d0 0x7f22e41f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22e9855640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40ca280 0x7f22e40ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ea857640 1 -- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40ca280 msgr2=0x7f22e40ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ea857640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40ca280 0x7f22e40ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ea857640 1 -- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d00040d0 msgr2=0x7f22e41f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ea857640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d00040d0 0x7f22e41f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22ea857640 1 -- 172.21.15.82:0/1847151750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e40cd650 con 0x7f22e41f7510 2024-06-02T22:54:20.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.823+0000 7f22e9855640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22e40ca280 0x7f22e40ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:54:20.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.824+0000 7f22ea857640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e41f7510 0x7f22e41f79c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f22e408e240 tx=0x7f22dc00fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.824+0000 7f22daffd640 1 -- 172.21.15.82:0/1847151750 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc019070 con 0x7f22e41f7510 2024-06-02T22:54:20.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.824+0000 7f22daffd640 1 -- 172.21.15.82:0/1847151750 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22dc006e20 con 0x7f22e41f7510 2024-06-02T22:54:20.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.824+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1847151750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e40cd930 con 0x7f22e41f7510 2024-06-02T22:54:20.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.824+0000 7f22daffd640 1 -- 172.21.15.82:0/1847151750 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc003b70 con 0x7f22e41f7510 2024-06-02T22:54:20.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.824+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1847151750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e40cdef0 con 0x7f22e41f7510 2024-06-02T22:54:20.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.824+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1847151750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22e4068540 con 0x7f22e41f7510 2024-06-02T22:54:20.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.825+0000 7f22daffd640 1 -- 172.21.15.82:0/1847151750 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22dc01c070 con 0x7f22e41f7510 2024-06-02T22:54:20.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.825+0000 7f22daffd640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f22c806be30 0x7f22c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.826+0000 7f22daffd640 1 -- 172.21.15.82:0/1847151750 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f22dc089fe0 con 0x7f22e41f7510 2024-06-02T22:54:20.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.826+0000 7f22ea056640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f22c806be30 0x7f22c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.826+0000 7f22daffd640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] conn(0x7f22c80722d0 0x7f22c8074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.826+0000 7f22daffd640 1 -- 172.21.15.82:0/1847151750 --> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22dc00ce50 con 0x7f22c80722d0 2024-06-02T22:54:20.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.826+0000 7f22daffd640 1 -- 172.21.15.82:0/1847151750 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f22dc091050 con 0x7f22e41f7510 2024-06-02T22:54:20.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.826+0000 7f22e9855640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] conn(0x7f22c80722d0 0x7f22c8074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.826+0000 7f22ea056640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f22c806be30 0x7f22c806e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f22e0001eb0 tx=0x7f22e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.826+0000 7f22e9855640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] conn(0x7f22c80722d0 0x7f22c8074710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.827+0000 7f22daffd640 1 -- 172.21.15.82:0/1847151750 <== osd.4 v2:172.21.15.184:6816/3577676185 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f22dc00ce50 con 0x7f22c80722d0 2024-06-02T22:54:20.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.840+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1847151750 --> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f22e40caf50 con 0x7f22c80722d0 2024-06-02T22:54:20.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22daffd640 1 -- 172.21.15.82:0/1847151750 <== osd.4 v2:172.21.15.184:6816/3577676185 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f22e40caf50 con 0x7f22c80722d0 2024-06-02T22:54:20.842 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:54:20.842 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T22:54:20.842 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:54:20.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] conn(0x7f22c80722d0 msgr2=0x7f22c8074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22ec2ba640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.184:6816/3577676185,v1:172.21.15.184:6817/3577676185] conn(0x7f22c80722d0 0x7f22c8074710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1847151750 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f22c806be30 msgr2=0x7f22c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22ec2ba640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f22c806be30 0x7f22c806e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f22e0001eb0 tx=0x7f22e0009040 comp rx=0 tx=0).stop 2024-06-02T22:54:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1847151750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e41f7510 msgr2=0x7f22e41f79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22ec2ba640 1 --2- 172.21.15.82:0/1847151750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22e41f7510 0x7f22e41f79c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f22e408e240 tx=0x7f22dc00fd60 comp rx=0 tx=0).stop 2024-06-02T22:54:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22ea857640 1 -- 172.21.15.82:0/1847151750 reap_dead start 2024-06-02T22:54:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1847151750 shutdown_connections 2024-06-02T22:54:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1847151750 >> 172.21.15.82:0/1847151750 conn(0x7f22e409d400 msgr2=0x7f22e40b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1847151750 shutdown_connections 2024-06-02T22:54:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.842+0000 7f22ec2ba640 1 -- 172.21.15.82:0/1847151750 wait complete. 2024-06-02T22:54:20.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-06-02T22:54:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275885d640 1 Processor -- start 2024-06-02T22:54:20.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275885d640 1 -- start start 2024-06-02T22:54:20.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275885d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f275415a870 0x7f275406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275885d640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f27540af3d0 0x7f27540cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275885d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275406e390 con 0x7f27540aef70 2024-06-02T22:54:20.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275885d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f275415ac50 con 0x7f275415a870 2024-06-02T22:54:20.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275885d640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f275406cdb0 con 0x7f27540af3d0 2024-06-02T22:54:20.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f275415a870 0x7f275406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f2749d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f27540aef70 0x7f27540b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48488/0 (socket says 172.21.15.82:48488) 2024-06-02T22:54:20.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f2749d9b640 1 -- 172.21.15.82:0/2759533665 learned_addr learned my addr 172.21.15.82:0/2759533665 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:20.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f2752d9d640 1 --2- 172.21.15.82:0/2759533665 >> v2:172.21.15.184:3300/0 conn(0x7f27540af3d0 0x7f27540cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275259c640 1 -- 172.21.15.82:0/2759533665 >> v2:172.21.15.184:3300/0 conn(0x7f27540af3d0 msgr2=0x7f27540cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:20.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275259c640 1 --2- 172.21.15.82:0/2759533665 >> v2:172.21.15.184:3300/0 conn(0x7f27540af3d0 0x7f27540cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275259c640 1 -- 172.21.15.82:0/2759533665 >> v1:172.21.15.82:6789/0 conn(0x7f27540aef70 legacy=0x7f27540b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f2751d9b640 1 -- 172.21.15.82:0/2759533665 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2742295114 0 0) 0x7f275406e390 con 0x7f27540aef70 2024-06-02T22:54:20.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f275259c640 1 -- 172.21.15.82:0/2759533665 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275406d090 con 0x7f275415a870 2024-06-02T22:54:20.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.953+0000 7f2752d9d640 1 --2- 172.21.15.82:0/2759533665 >> v2:172.21.15.184:3300/0 conn(0x7f27540af3d0 0x7f27540cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:20.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.954+0000 7f275259c640 1 --2- 172.21.15.82:0/2759533665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275415a870 0x7f275406de50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f275406c8b0 tx=0x7f274402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce43e00edb49d567 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.954+0000 7f2751d9b640 1 -- 172.21.15.82:0/2759533665 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2744037070 con 0x7f275415a870 2024-06-02T22:54:20.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.954+0000 7f2751d9b640 1 -- 172.21.15.82:0/2759533665 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2744032440 con 0x7f275415a870 2024-06-02T22:54:20.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.954+0000 7f2751d9b640 1 -- 172.21.15.82:0/2759533665 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274402ae60 con 0x7f275415a870 2024-06-02T22:54:20.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.954+0000 7f275885d640 1 -- 172.21.15.82:0/2759533665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275415a870 msgr2=0x7f275406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.954+0000 7f275885d640 1 --2- 172.21.15.82:0/2759533665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275415a870 0x7f275406de50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f275406c8b0 tx=0x7f274402a110 comp rx=0 tx=0).stop 2024-06-02T22:54:20.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.954+0000 7f275885d640 1 -- 172.21.15.82:0/2759533665 shutdown_connections 2024-06-02T22:54:20.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.954+0000 7f275885d640 1 --2- 172.21.15.82:0/2759533665 >> v2:172.21.15.184:3300/0 conn(0x7f27540af3d0 0x7f27540cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.954+0000 7f275885d640 1 --2- 172.21.15.82:0/2759533665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275415a870 0x7f275406de50 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.954+0000 7f275885d640 1 -- 172.21.15.82:0/2759533665 >> 172.21.15.82:0/2759533665 conn(0x7f27540b19f0 msgr2=0x7f27540b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.954+0000 7f275885d640 1 -- 172.21.15.82:0/2759533665 shutdown_connections 2024-06-02T22:54:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.955+0000 7f275885d640 1 -- 172.21.15.82:0/2759533665 wait complete. 2024-06-02T22:54:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.956+0000 7f275885d640 1 Processor -- start 2024-06-02T22:54:20.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.956+0000 7f275885d640 1 -- start start 2024-06-02T22:54:20.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f275885d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27540aef70 0x7f275414bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f275885d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27540af3d0 0x7f27540ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f275885d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275415a870 0x7f27540b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f275885d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f275406d930 con 0x7f275415a870 2024-06-02T22:54:20.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f275885d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f275406d650 con 0x7f27540aef70 2024-06-02T22:54:20.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f275885d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f27540b2e40 con 0x7f27540af3d0 2024-06-02T22:54:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f2752d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275415a870 0x7f27540b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f2752d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275415a870 0x7f27540b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33348/0 (socket says 172.21.15.82:33348) 2024-06-02T22:54:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f2752d9d640 1 -- 172.21.15.82:0/1634511294 learned_addr learned my addr 172.21.15.82:0/1634511294 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f275259c640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27540aef70 0x7f275414bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f2749d9b640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27540af3d0 0x7f27540ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f2752d9d640 1 -- 172.21.15.82:0/1634511294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27540af3d0 msgr2=0x7f27540ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f2752d9d640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27540af3d0 0x7f27540ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f2752d9d640 1 -- 172.21.15.82:0/1634511294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27540aef70 msgr2=0x7f275414bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f2752d9d640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27540aef70 0x7f275414bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:20.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f2752d9d640 1 -- 172.21.15.82:0/1634511294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275414c070 con 0x7f275415a870 2024-06-02T22:54:20.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f2749d9b640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27540af3d0 0x7f27540ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:20.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f2752d9d640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275415a870 0x7f27540b4520 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f274c007f20 tx=0x7f274c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f274b7fe640 1 -- 172.21.15.82:0/1634511294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c01a070 con 0x7f275415a870 2024-06-02T22:54:20.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f274b7fe640 1 -- 172.21.15.82:0/1634511294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c003b90 con 0x7f275415a870 2024-06-02T22:54:20.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f275885d640 1 -- 172.21.15.82:0/1634511294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27540ae030 con 0x7f275415a870 2024-06-02T22:54:20.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.957+0000 7f274b7fe640 1 -- 172.21.15.82:0/1634511294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c004030 con 0x7f275415a870 2024-06-02T22:54:20.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.958+0000 7f275885d640 1 -- 172.21.15.82:0/1634511294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27540ae5f0 con 0x7f275415a870 2024-06-02T22:54:20.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.959+0000 7f275885d640 1 -- 172.21.15.82:0/1634511294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2754068430 con 0x7f275415a870 2024-06-02T22:54:20.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.959+0000 7f274b7fe640 1 -- 172.21.15.82:0/1634511294 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f274c01d070 con 0x7f275415a870 2024-06-02T22:54:20.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.959+0000 7f274b7fe640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f273406be30 0x7f273406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:20.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.959+0000 7f274b7fe640 1 -- 172.21.15.82:0/1634511294 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f274c08aed0 con 0x7f275415a870 2024-06-02T22:54:20.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.960+0000 7f275259c640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f273406be30 0x7f273406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.960+0000 7f275259c640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f273406be30 0x7f273406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2744034000 tx=0x7f274402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:20.965+0000 7f274b7fe640 1 -- 172.21.15.82:0/1634511294 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f274c010070 con 0x7f275415a870 2024-06-02T22:54:21.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.136+0000 7f275885d640 1 -- 172.21.15.82:0/1634511294 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f27541554b0 con 0x7f273406be30 2024-06-02T22:54:21.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.136+0000 7f274b7fe640 1 -- 172.21.15.82:0/1634511294 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f27541554b0 con 0x7f273406be30 2024-06-02T22:54:21.138 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 4 to deep-scrub 2024-06-02T22:54:21.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 -- 172.21.15.82:0/1634511294 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f273406be30 msgr2=0x7f273406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f273406be30 0x7f273406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2744034000 tx=0x7f274402e000 comp rx=0 tx=0).stop 2024-06-02T22:54:21.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 -- 172.21.15.82:0/1634511294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275415a870 msgr2=0x7f27540b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275415a870 0x7f27540b4520 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f274c007f20 tx=0x7f274c00d560 comp rx=0 tx=0).stop 2024-06-02T22:54:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 -- 172.21.15.82:0/1634511294 shutdown_connections 2024-06-02T22:54:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f273406be30 0x7f273406e2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f275415a870 0x7f27540b4520 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27540af3d0 0x7f27540ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 --2- 172.21.15.82:0/1634511294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27540aef70 0x7f275414bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 -- 172.21.15.82:0/1634511294 >> 172.21.15.82:0/1634511294 conn(0x7f27540b19f0 msgr2=0x7f275406de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:21.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 -- 172.21.15.82:0/1634511294 shutdown_connections 2024-06-02T22:54:21.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.139+0000 7f275885d640 1 -- 172.21.15.82:0/1634511294 wait complete. 2024-06-02T22:54:21.150 INFO:tasks.ceph:Scrubbing osd.5 2024-06-02T22:54:21.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-06-02T22:54:21.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.252+0000 7f38d40df640 1 Processor -- start 2024-06-02T22:54:21.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.253+0000 7f38d40df640 1 -- start start 2024-06-02T22:54:21.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.253+0000 7f38d40df640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38cc15e670 0x7f38cc0d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.253+0000 7f38d40df640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38cc0d1f30 0x7f38cc0d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.253+0000 7f38d40df640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38cc15ec90 con 0x7f38cc0d0c30 2024-06-02T22:54:21.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.253+0000 7f38d40df640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f38cc15fa50 con 0x7f38cc0d1f30 2024-06-02T22:54:21.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.253+0000 7f38d40df640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f38cc0d1090 con 0x7f38cc15e670 2024-06-02T22:54:21.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d267c640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f38cc0d0c30 0x7f38cc162010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.82:44988/0 (socket says 172.21.15.82:44988) 2024-06-02T22:54:21.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d267c640 1 -- 172.21.15.82:0/4223597900 learned_addr learned my addr 172.21.15.82:0/4223597900 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942930488 0 0) 0x7f38cc15ec90 con 0x7f38cc0d0c30 2024-06-02T22:54:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b4003520 con 0x7f38cc0d0c30 2024-06-02T22:54:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d1e7b640 1 --2- 172.21.15.82:0/4223597900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38cc15e670 0x7f38cc0d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d167a640 1 --2- 172.21.15.82:0/4223597900 >> v2:172.21.15.184:3300/0 conn(0x7f38cc0d1f30 0x7f38cc0d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1308007330 0 0) 0x7f38b4003520 con 0x7f38cc0d0c30 2024-06-02T22:54:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38cc15e670 msgr2=0x7f38cc0d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 --2- 172.21.15.82:0/4223597900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38cc15e670 0x7f38cc0d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 >> v2:172.21.15.184:3300/0 conn(0x7f38cc0d1f30 msgr2=0x7f38cc0d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 --2- 172.21.15.82:0/4223597900 >> v2:172.21.15.184:3300/0 conn(0x7f38cc0d1f30 0x7f38cc0d06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38cc15ef70 con 0x7f38cc0d0c30 2024-06-02T22:54:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f38c4001670 con 0x7f38cc0d0c30 2024-06-02T22:54:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 >> v1:172.21.15.184:6789/0 conn(0x7f38cc0d0c30 legacy=0x7f38cc162010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 --2- 172.21.15.82:0/4223597900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b40039b0 0x7f38b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 --2- 172.21.15.82:0/4223597900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38b4004800 0x7f38b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 --2- 172.21.15.82:0/4223597900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38cc15e670 0x7f38b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc15fa50 con 0x7f38b4004800 2024-06-02T22:54:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f38b400ba80 con 0x7f38b40039b0 2024-06-02T22:54:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f38b400bc80 con 0x7f38cc15e670 2024-06-02T22:54:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d167a640 1 --2- 172.21.15.82:0/4223597900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38b4004800 0x7f38b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.254+0000 7f38d1e7b640 1 --2- 172.21.15.82:0/4223597900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b40039b0 0x7f38b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.255+0000 7f38d167a640 1 -- 172.21.15.82:0/4223597900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38cc15e670 msgr2=0x7f38b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.255+0000 7f38d167a640 1 --2- 172.21.15.82:0/4223597900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38cc15e670 0x7f38b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.255+0000 7f38d167a640 1 -- 172.21.15.82:0/4223597900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b40039b0 msgr2=0x7f38b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.255+0000 7f38d167a640 1 --2- 172.21.15.82:0/4223597900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b40039b0 0x7f38b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.255+0000 7f38d167a640 1 -- 172.21.15.82:0/4223597900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b4003520 con 0x7f38b4004800 2024-06-02T22:54:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.255+0000 7f38d167a640 1 --2- 172.21.15.82:0/4223597900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38b4004800 0x7f38b4004c80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f38c000ba00 tx=0x7f38b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac4154793952e0e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.256+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0030070 con 0x7f38b4004800 2024-06-02T22:54:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.256+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c002adb0 con 0x7f38b4004800 2024-06-02T22:54:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.256+0000 7f38d0e79640 1 -- 172.21.15.82:0/4223597900 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c000b600 con 0x7f38b4004800 2024-06-02T22:54:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.256+0000 7f38d40df640 1 -- 172.21.15.82:0/4223597900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38b4004800 msgr2=0x7f38b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.256+0000 7f38d40df640 1 --2- 172.21.15.82:0/4223597900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38b4004800 0x7f38b4004c80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f38c000ba00 tx=0x7f38b4005830 comp rx=0 tx=0).stop 2024-06-02T22:54:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.256+0000 7f38d267c640 1 -- 172.21.15.82:0/4223597900 reap_dead start 2024-06-02T22:54:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.256+0000 7f38d40df640 1 -- 172.21.15.82:0/4223597900 shutdown_connections 2024-06-02T22:54:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.256+0000 7f38d40df640 1 -- 172.21.15.82:0/4223597900 >> 172.21.15.82:0/4223597900 conn(0x7f38cc09d400 msgr2=0x7f38cc0d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.256+0000 7f38d40df640 1 -- 172.21.15.82:0/4223597900 shutdown_connections 2024-06-02T22:54:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.256+0000 7f38d40df640 1 -- 172.21.15.82:0/4223597900 wait complete. 2024-06-02T22:54:21.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.257+0000 7f38d40df640 1 Processor -- start 2024-06-02T22:54:21.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.257+0000 7f38d40df640 1 -- start start 2024-06-02T22:54:21.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.258+0000 7f38d40df640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b4004800 0x7f38cc15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.258+0000 7f38d40df640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38cc0b7390 0x7f38cc0b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.258+0000 7f38d40df640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc0b9440 0x7f38cc0b98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.258+0000 7f38d40df640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc15f530 con 0x7f38cc0b9440 2024-06-02T22:54:21.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.258+0000 7f38d40df640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc15ea50 con 0x7f38b4004800 2024-06-02T22:54:21.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.258+0000 7f38d40df640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f38cc0d2370 con 0x7f38cc0b7390 2024-06-02T22:54:21.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.258+0000 7f38d267c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc0b9440 0x7f38cc0b98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.258+0000 7f38d267c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc0b9440 0x7f38cc0b98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54644/0 (socket says 172.21.15.82:54644) 2024-06-02T22:54:21.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.258+0000 7f38d267c640 1 -- 172.21.15.82:0/3736851726 learned_addr learned my addr 172.21.15.82:0/3736851726 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:21.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38d267c640 1 -- 172.21.15.82:0/3736851726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38cc0b7390 msgr2=0x7f38cc0b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38d267c640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38cc0b7390 0x7f38cc0b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38d267c640 1 -- 172.21.15.82:0/3736851726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b4004800 msgr2=0x7f38cc15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38d1e7b640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b4004800 0x7f38cc15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38d267c640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b4004800 0x7f38cc15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38d267c640 1 -- 172.21.15.82:0/3736851726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38cc0b2e80 con 0x7f38cc0b9440 2024-06-02T22:54:21.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38d267c640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc0b9440 0x7f38cc0b98a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f38c4001050 tx=0x7f38c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38ca7fc640 1 -- 172.21.15.82:0/3736851726 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4004bf0 con 0x7f38cc0b9440 2024-06-02T22:54:21.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38ca7fc640 1 -- 172.21.15.82:0/3736851726 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c4004db0 con 0x7f38cc0b9440 2024-06-02T22:54:21.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38d40df640 1 -- 172.21.15.82:0/3736851726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38cc0cc280 con 0x7f38cc0b9440 2024-06-02T22:54:21.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38ca7fc640 1 -- 172.21.15.82:0/3736851726 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4007270 con 0x7f38cc0b9440 2024-06-02T22:54:21.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.259+0000 7f38d40df640 1 -- 172.21.15.82:0/3736851726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38cc0cc840 con 0x7f38cc0b9440 2024-06-02T22:54:21.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.260+0000 7f38d40df640 1 -- 172.21.15.82:0/3736851726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38cc068540 con 0x7f38cc0b9440 2024-06-02T22:54:21.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.260+0000 7f38ca7fc640 1 -- 172.21.15.82:0/3736851726 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38c4007410 con 0x7f38cc0b9440 2024-06-02T22:54:21.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.261+0000 7f38ca7fc640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38b806be30 0x7f38b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.261+0000 7f38ca7fc640 1 -- 172.21.15.82:0/3736851726 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f38c408a2e0 con 0x7f38cc0b9440 2024-06-02T22:54:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.261+0000 7f38d1e7b640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38b806be30 0x7f38b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.261+0000 7f38ca7fc640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] conn(0x7f38b80722d0 0x7f38b8074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.261+0000 7f38ca7fc640 1 -- 172.21.15.82:0/3736851726 --> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38b8074de0 con 0x7f38b80722d0 2024-06-02T22:54:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.261+0000 7f38ca7fc640 1 -- 172.21.15.82:0/3736851726 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f38c4091050 con 0x7f38cc0b9440 2024-06-02T22:54:21.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.261+0000 7f38d1e7b640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38b806be30 0x7f38b806e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f38bc003aa0 tx=0x7f38bc009760 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.261+0000 7f38d167a640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] conn(0x7f38b80722d0 0x7f38b8074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.262+0000 7f38d167a640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] conn(0x7f38b80722d0 0x7f38b8074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.263+0000 7f38ca7fc640 1 -- 172.21.15.82:0/3736851726 <== osd.5 v2:172.21.15.184:6800/1215748399 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38b8074de0 con 0x7f38b80722d0 2024-06-02T22:54:21.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d40df640 1 -- 172.21.15.82:0/3736851726 --> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f38cc0d47d0 con 0x7f38b80722d0 2024-06-02T22:54:21.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38ca7fc640 1 -- 172.21.15.82:0/3736851726 <== osd.5 v2:172.21.15.184:6800/1215748399 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f38cc0d47d0 con 0x7f38b80722d0 2024-06-02T22:54:21.280 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:54:21.280 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T22:54:21.280 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:54:21.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d40df640 1 -- 172.21.15.82:0/3736851726 >> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] conn(0x7f38b80722d0 msgr2=0x7f38b8074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d40df640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.184:6800/1215748399,v1:172.21.15.184:6801/1215748399] conn(0x7f38b80722d0 0x7f38b8074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d40df640 1 -- 172.21.15.82:0/3736851726 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38b806be30 msgr2=0x7f38b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d40df640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38b806be30 0x7f38b806e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f38bc003aa0 tx=0x7f38bc009760 comp rx=0 tx=0).stop 2024-06-02T22:54:21.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d40df640 1 -- 172.21.15.82:0/3736851726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc0b9440 msgr2=0x7f38cc0b98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d40df640 1 --2- 172.21.15.82:0/3736851726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38cc0b9440 0x7f38cc0b98a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f38c4001050 tx=0x7f38c400c8e0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d267c640 1 -- 172.21.15.82:0/3736851726 reap_dead start 2024-06-02T22:54:21.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d40df640 1 -- 172.21.15.82:0/3736851726 shutdown_connections 2024-06-02T22:54:21.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d40df640 1 -- 172.21.15.82:0/3736851726 >> 172.21.15.82:0/3736851726 conn(0x7f38cc09d400 msgr2=0x7f38cc0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:21.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d40df640 1 -- 172.21.15.82:0/3736851726 shutdown_connections 2024-06-02T22:54:21.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.276+0000 7f38d40df640 1 -- 172.21.15.82:0/3736851726 wait complete. 2024-06-02T22:54:21.287 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-06-02T22:54:21.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.388+0000 7f66e0db7640 1 Processor -- start 2024-06-02T22:54:21.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.388+0000 7f66e0db7640 1 -- start start 2024-06-02T22:54:21.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66e0db7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f66dc0ae910 0x7f66dc06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66e0db7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66dc0cf360 0x7f66dc0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66e0db7640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc06d130 con 0x7f66dc06ea20 2024-06-02T22:54:21.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66e0db7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f66dc06ee90 con 0x7f66dc0ae910 2024-06-02T22:54:21.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66e0db7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f66dc06d410 con 0x7f66dc0cf360 2024-06-02T22:54:21.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66da59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f66dc0ae910 0x7f66dc06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66da59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f66dc0ae910 0x7f66dc06e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54652/0 (socket says 172.21.15.82:54652) 2024-06-02T22:54:21.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66da59c640 1 -- 172.21.15.82:0/2843524699 learned_addr learned my addr 172.21.15.82:0/2843524699 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:21.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66dad9d640 1 --2- 172.21.15.82:0/2843524699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66dc0cf360 0x7f66dc0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66da59c640 1 -- 172.21.15.82:0/2843524699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66dc0cf360 msgr2=0x7f66dc0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:21.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66da59c640 1 --2- 172.21.15.82:0/2843524699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66dc0cf360 0x7f66dc0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66da59c640 1 -- 172.21.15.82:0/2843524699 >> v1:172.21.15.184:6789/0 conn(0x7f66dc06ea20 legacy=0x7f66dc0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.389+0000 7f66da59c640 1 -- 172.21.15.82:0/2843524699 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc06d6f0 con 0x7f66dc0ae910 2024-06-02T22:54:21.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.390+0000 7f66da59c640 1 --2- 172.21.15.82:0/2843524699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66dc0ae910 0x7f66dc06e4e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00bb10 tx=0x7f66cc02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4dc0d10a24ea319 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.390+0000 7f66d9d9b640 1 -- 172.21.15.82:0/2843524699 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc032790 con 0x7f66dc0ae910 2024-06-02T22:54:21.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.390+0000 7f66d9d9b640 1 -- 172.21.15.82:0/2843524699 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66cc038070 con 0x7f66dc0ae910 2024-06-02T22:54:21.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.390+0000 7f66d9d9b640 1 -- 172.21.15.82:0/2843524699 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc032b50 con 0x7f66dc0ae910 2024-06-02T22:54:21.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.391+0000 7f66e0db7640 1 -- 172.21.15.82:0/2843524699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66dc0ae910 msgr2=0x7f66dc06e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.391+0000 7f66e0db7640 1 --2- 172.21.15.82:0/2843524699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66dc0ae910 0x7f66dc06e4e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00bb10 tx=0x7f66cc02c890 comp rx=0 tx=0).stop 2024-06-02T22:54:21.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.391+0000 7f66e0db7640 1 -- 172.21.15.82:0/2843524699 shutdown_connections 2024-06-02T22:54:21.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.391+0000 7f66e0db7640 1 --2- 172.21.15.82:0/2843524699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66dc0cf360 0x7f66dc0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.391+0000 7f66e0db7640 1 --2- 172.21.15.82:0/2843524699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66dc0ae910 0x7f66dc06e4e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.391+0000 7f66e0db7640 1 -- 172.21.15.82:0/2843524699 >> 172.21.15.82:0/2843524699 conn(0x7f66dc0b19f0 msgr2=0x7f66dc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:21.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.391+0000 7f66e0db7640 1 -- 172.21.15.82:0/2843524699 shutdown_connections 2024-06-02T22:54:21.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.391+0000 7f66e0db7640 1 -- 172.21.15.82:0/2843524699 wait complete. 2024-06-02T22:54:21.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.392+0000 7f66e0db7640 1 Processor -- start 2024-06-02T22:54:21.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.392+0000 7f66e0db7640 1 -- start start 2024-06-02T22:54:21.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.393+0000 7f66e0db7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66dc06ea20 0x7f66dc151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.393+0000 7f66e0db7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66dc0ae910 0x7f66dc14f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.393+0000 7f66e0db7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66dc0cf360 0x7f66dc0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.393+0000 7f66e0db7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc0ad280 con 0x7f66dc0cf360 2024-06-02T22:54:21.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.393+0000 7f66e0db7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc0aecf0 con 0x7f66dc06ea20 2024-06-02T22:54:21.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.393+0000 7f66e0db7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f66dc0ad400 con 0x7f66dc0ae910 2024-06-02T22:54:21.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.393+0000 7f66dad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66dc0cf360 0x7f66dc0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.393+0000 7f66dad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66dc0cf360 0x7f66dc0b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54664/0 (socket says 172.21.15.82:54664) 2024-06-02T22:54:21.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.393+0000 7f66dad9d640 1 -- 172.21.15.82:0/3868426911 learned_addr learned my addr 172.21.15.82:0/3868426911 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:21.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.393+0000 7f66da59c640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66dc06ea20 0x7f66dc151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.393+0000 7f66d1d9b640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66dc0ae910 0x7f66dc14f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66dad9d640 1 -- 172.21.15.82:0/3868426911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66dc0ae910 msgr2=0x7f66dc14f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66dad9d640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66dc0ae910 0x7f66dc14f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66dad9d640 1 -- 172.21.15.82:0/3868426911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66dc06ea20 msgr2=0x7f66dc151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66dad9d640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66dc06ea20 0x7f66dc151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66dad9d640 1 -- 172.21.15.82:0/3868426911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc15e3a0 con 0x7f66dc0cf360 2024-06-02T22:54:21.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66d1d9b640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66dc0ae910 0x7f66dc14f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:21.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66dad9d640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66dc0cf360 0x7f66dc0b0cf0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f66d4007e40 tx=0x7f66d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66d37fe640 1 -- 172.21.15.82:0/3868426911 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4014620 con 0x7f66dc0cf360 2024-06-02T22:54:21.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66d37fe640 1 -- 172.21.15.82:0/3868426911 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d4019070 con 0x7f66dc0cf360 2024-06-02T22:54:21.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66d37fe640 1 -- 172.21.15.82:0/3868426911 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4014a20 con 0x7f66dc0cf360 2024-06-02T22:54:21.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66e0db7640 1 -- 172.21.15.82:0/3868426911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66dc1503d0 con 0x7f66dc0cf360 2024-06-02T22:54:21.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.394+0000 7f66e0db7640 1 -- 172.21.15.82:0/3868426911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66dc150990 con 0x7f66dc0cf360 2024-06-02T22:54:21.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.395+0000 7f66e0db7640 1 -- 172.21.15.82:0/3868426911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66dc068430 con 0x7f66dc0cf360 2024-06-02T22:54:21.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.395+0000 7f66d37fe640 1 -- 172.21.15.82:0/3868426911 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66d4014bc0 con 0x7f66dc0cf360 2024-06-02T22:54:21.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.396+0000 7f66d37fe640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f66bc06be60 0x7f66bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.396+0000 7f66da59c640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f66bc06be60 0x7f66bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.396+0000 7f66d37fe640 1 -- 172.21.15.82:0/3868426911 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f66d408b400 con 0x7f66dc0cf360 2024-06-02T22:54:21.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.396+0000 7f66da59c640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f66bc06be60 0x7f66bc06e320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66cc037000 tx=0x7f66cc03e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.401+0000 7f66d37fe640 1 -- 172.21.15.82:0/3868426911 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f66d4059fb0 con 0x7f66dc0cf360 2024-06-02T22:54:21.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.573+0000 7f66e0db7640 1 -- 172.21.15.82:0/3868426911 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f66dc0ce830 con 0x7f66bc06be60 2024-06-02T22:54:21.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.574+0000 7f66d37fe640 1 -- 172.21.15.82:0/3868426911 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f66dc0ce830 con 0x7f66bc06be60 2024-06-02T22:54:21.575 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 5 to deep-scrub 2024-06-02T22:54:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.575+0000 7f66e0db7640 1 -- 172.21.15.82:0/3868426911 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f66bc06be60 msgr2=0x7f66bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.575+0000 7f66e0db7640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f66bc06be60 0x7f66bc06e320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66cc037000 tx=0x7f66cc03e040 comp rx=0 tx=0).stop 2024-06-02T22:54:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.575+0000 7f66e0db7640 1 -- 172.21.15.82:0/3868426911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66dc0cf360 msgr2=0x7f66dc0b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.575+0000 7f66e0db7640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66dc0cf360 0x7f66dc0b0cf0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f66d4007e40 tx=0x7f66d400e4b0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.575+0000 7f66e0db7640 1 -- 172.21.15.82:0/3868426911 shutdown_connections 2024-06-02T22:54:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.575+0000 7f66e0db7640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f66bc06be60 0x7f66bc06e320 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.575+0000 7f66e0db7640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66dc0cf360 0x7f66dc0b0cf0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.575+0000 7f66e0db7640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66dc0ae910 0x7f66dc14f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.575+0000 7f66e0db7640 1 --2- 172.21.15.82:0/3868426911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66dc06ea20 0x7f66dc151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.575+0000 7f66e0db7640 1 -- 172.21.15.82:0/3868426911 >> 172.21.15.82:0/3868426911 conn(0x7f66dc0b19f0 msgr2=0x7f66dc0727f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:21.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.576+0000 7f66e0db7640 1 -- 172.21.15.82:0/3868426911 shutdown_connections 2024-06-02T22:54:21.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.576+0000 7f66e0db7640 1 -- 172.21.15.82:0/3868426911 wait complete. 2024-06-02T22:54:21.587 INFO:tasks.ceph:Scrubbing osd.6 2024-06-02T22:54:21.587 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-06-02T22:54:21.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.691+0000 7fa427088640 1 Processor -- start 2024-06-02T22:54:21.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.691+0000 7fa427088640 1 -- start start 2024-06-02T22:54:21.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.691+0000 7fa427088640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa42015c740 0x7fa4200cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.691+0000 7fa427088640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa42015c230 0x7fa4200ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.691+0000 7fa427088640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4200722a0 con 0x7fa42015be50 2024-06-02T22:54:21.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.691+0000 7fa427088640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa4200b3020 con 0x7fa42015c230 2024-06-02T22:54:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.691+0000 7fa427088640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fa420072570 con 0x7fa42015c740 2024-06-02T22:54:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.691+0000 7fa425625640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa42015c230 0x7fa4200ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.691+0000 7fa424e24640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa42015be50 0x7fa420071b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43814/0 (socket says 172.21.15.82:43814) 2024-06-02T22:54:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.691+0000 7fa424e24640 1 -- 172.21.15.82:0/2242924880 learned_addr learned my addr 172.21.15.82:0/2242924880 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa41ffff640 1 --2- 172.21.15.82:0/2242924880 >> v2:172.21.15.184:3300/0 conn(0x7fa42015c740 0x7fa4200cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa425625640 1 -- 172.21.15.82:0/2242924880 >> v2:172.21.15.184:3300/0 conn(0x7fa42015c740 msgr2=0x7fa4200cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa425625640 1 --2- 172.21.15.82:0/2242924880 >> v2:172.21.15.184:3300/0 conn(0x7fa42015c740 0x7fa4200cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa41f7fe640 1 -- 172.21.15.82:0/2242924880 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150802775 0 0) 0x7fa4200722a0 con 0x7fa42015be50 2024-06-02T22:54:21.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa425625640 1 -- 172.21.15.82:0/2242924880 >> v1:172.21.15.82:6789/0 conn(0x7fa42015be50 legacy=0x7fa420071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa425625640 1 -- 172.21.15.82:0/2242924880 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa420072850 con 0x7fa42015c230 2024-06-02T22:54:21.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa41ffff640 1 --2- 172.21.15.82:0/2242924880 >> v2:172.21.15.184:3300/0 conn(0x7fa42015c740 0x7fa4200cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:54:21.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa425625640 1 --2- 172.21.15.82:0/2242924880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa42015c230 0x7fa4200ccb60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa42006f4d0 tx=0x7fa41802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bec07ce7a4a48c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa41f7fe640 1 -- 172.21.15.82:0/2242924880 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418007740 con 0x7fa42015c230 2024-06-02T22:54:21.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa41f7fe640 1 -- 172.21.15.82:0/2242924880 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4180078e0 con 0x7fa42015c230 2024-06-02T22:54:21.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa41f7fe640 1 -- 172.21.15.82:0/2242924880 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418007cb0 con 0x7fa42015c230 2024-06-02T22:54:21.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa427088640 1 -- 172.21.15.82:0/2242924880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa42015c230 msgr2=0x7fa4200ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa427088640 1 --2- 172.21.15.82:0/2242924880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa42015c230 0x7fa4200ccb60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa42006f4d0 tx=0x7fa41802a680 comp rx=0 tx=0).stop 2024-06-02T22:54:21.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa427088640 1 -- 172.21.15.82:0/2242924880 shutdown_connections 2024-06-02T22:54:21.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa427088640 1 --2- 172.21.15.82:0/2242924880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa42015c230 0x7fa4200ccb60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa427088640 1 --2- 172.21.15.82:0/2242924880 >> v2:172.21.15.184:3300/0 conn(0x7fa42015c740 0x7fa4200cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa427088640 1 -- 172.21.15.82:0/2242924880 >> 172.21.15.82:0/2242924880 conn(0x7fa4200b1980 msgr2=0x7fa4200b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:21.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa427088640 1 -- 172.21.15.82:0/2242924880 shutdown_connections 2024-06-02T22:54:21.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.693+0000 7fa427088640 1 -- 172.21.15.82:0/2242924880 wait complete. 2024-06-02T22:54:21.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.695+0000 7fa427088640 1 Processor -- start 2024-06-02T22:54:21.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.695+0000 7fa427088640 1 -- start start 2024-06-02T22:54:21.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa427088640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42015be50 0x7fa42014aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa427088640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa42015c230 0x7fa4201469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa427088640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa42015c740 0x7fa420143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa427088640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4200b34b0 con 0x7fa42015c230 2024-06-02T22:54:21.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa427088640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa420072e10 con 0x7fa42015be50 2024-06-02T22:54:21.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa427088640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fa4200b3630 con 0x7fa42015c740 2024-06-02T22:54:21.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa42015c230 0x7fa4201469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa42015c230 0x7fa4201469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54684/0 (socket says 172.21.15.82:54684) 2024-06-02T22:54:21.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41ffff640 1 -- 172.21.15.82:0/2315039576 learned_addr learned my addr 172.21.15.82:0/2315039576 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:21.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa424e24640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42015be50 0x7fa42014aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa425625640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa42015c740 0x7fa420143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41ffff640 1 -- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa42015c740 msgr2=0x7fa420143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41ffff640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa42015c740 0x7fa420143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41ffff640 1 -- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42015be50 msgr2=0x7fa42014aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41ffff640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42015be50 0x7fa42014aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41ffff640 1 -- 172.21.15.82:0/2315039576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4201f4e70 con 0x7fa42015c230 2024-06-02T22:54:21.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa424e24640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42015be50 0x7fa42014aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:54:21.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41ffff640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa42015c230 0x7fa4201469a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c820 tx=0x7fa41400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41d7fa640 1 -- 172.21.15.82:0/2315039576 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414015070 con 0x7fa42015c230 2024-06-02T22:54:21.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41d7fa640 1 -- 172.21.15.82:0/2315039576 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa414007a30 con 0x7fa42015c230 2024-06-02T22:54:21.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa427088640 1 -- 172.21.15.82:0/2315039576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4201471f0 con 0x7fa42015c230 2024-06-02T22:54:21.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa41d7fa640 1 -- 172.21.15.82:0/2315039576 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414007de0 con 0x7fa42015c230 2024-06-02T22:54:21.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.696+0000 7fa427088640 1 -- 172.21.15.82:0/2315039576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4201f5110 con 0x7fa42015c230 2024-06-02T22:54:21.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.698+0000 7fa427088640 1 -- 172.21.15.82:0/2315039576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa420068540 con 0x7fa42015c230 2024-06-02T22:54:21.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.698+0000 7fa41d7fa640 1 -- 172.21.15.82:0/2315039576 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa414018070 con 0x7fa42015c230 2024-06-02T22:54:21.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.699+0000 7fa41d7fa640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa40c06be30 0x7fa40c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.699+0000 7fa41d7fa640 1 -- 172.21.15.82:0/2315039576 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fa41408b0b0 con 0x7fa42015c230 2024-06-02T22:54:21.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.699+0000 7fa424e24640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa40c06be30 0x7fa40c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.699+0000 7fa41d7fa640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] conn(0x7fa40c0722d0 0x7fa40c074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.699+0000 7fa41d7fa640 1 -- 172.21.15.82:0/2315039576 --> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa414009f20 con 0x7fa40c0722d0 2024-06-02T22:54:21.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.699+0000 7fa41d7fa640 1 -- 172.21.15.82:0/2315039576 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fa41408b540 con 0x7fa42015c230 2024-06-02T22:54:21.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.699+0000 7fa425625640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] conn(0x7fa40c0722d0 0x7fa40c074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.699+0000 7fa424e24640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa40c06be30 0x7fa40c06e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa410000f60 tx=0x7fa410009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.700+0000 7fa425625640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] conn(0x7fa40c0722d0 0x7fa40c074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.700+0000 7fa41d7fa640 1 -- 172.21.15.82:0/2315039576 <== osd.6 v2:172.21.15.184:6808/4289735887 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa414009f20 con 0x7fa40c0722d0 2024-06-02T22:54:21.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.713+0000 7fa427088640 1 -- 172.21.15.82:0/2315039576 --> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa420154db0 con 0x7fa40c0722d0 2024-06-02T22:54:21.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa41d7fa640 1 -- 172.21.15.82:0/2315039576 <== osd.6 v2:172.21.15.184:6808/4289735887 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa420154db0 con 0x7fa40c0722d0 2024-06-02T22:54:21.714 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:54:21.714 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T22:54:21.714 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:54:21.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa427088640 1 -- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] conn(0x7fa40c0722d0 msgr2=0x7fa40c074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa427088640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.184:6808/4289735887,v1:172.21.15.184:6809/4289735887] conn(0x7fa40c0722d0 0x7fa40c074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa427088640 1 -- 172.21.15.82:0/2315039576 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa40c06be30 msgr2=0x7fa40c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa427088640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fa40c06be30 0x7fa40c06e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa410000f60 tx=0x7fa410009040 comp rx=0 tx=0).stop 2024-06-02T22:54:21.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa427088640 1 -- 172.21.15.82:0/2315039576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa42015c230 msgr2=0x7fa4201469a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa427088640 1 --2- 172.21.15.82:0/2315039576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa42015c230 0x7fa4201469a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c820 tx=0x7fa41400cce0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa425625640 1 -- 172.21.15.82:0/2315039576 reap_dead start 2024-06-02T22:54:21.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa427088640 1 -- 172.21.15.82:0/2315039576 shutdown_connections 2024-06-02T22:54:21.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa427088640 1 -- 172.21.15.82:0/2315039576 >> 172.21.15.82:0/2315039576 conn(0x7fa4200b1980 msgr2=0x7fa42015db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:21.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa427088640 1 -- 172.21.15.82:0/2315039576 shutdown_connections 2024-06-02T22:54:21.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.714+0000 7fa427088640 1 -- 172.21.15.82:0/2315039576 wait complete. 2024-06-02T22:54:21.724 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-06-02T22:54:21.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.825+0000 7f901fd7e640 1 Processor -- start 2024-06-02T22:54:21.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.825+0000 7f901fd7e640 1 -- start start 2024-06-02T22:54:21.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901fd7e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90181553c0 0x7f90180cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901fd7e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f90180cec50 0x7f90180cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901fd7e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90180b3170 con 0x7f90180b2cf0 2024-06-02T22:54:21.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901fd7e640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f90180b3420 con 0x7f90180cec50 2024-06-02T22:54:21.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901fd7e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f90180cc750 con 0x7f90181553c0 2024-06-02T22:54:21.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901d319640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f90180b2cf0 0x7f901815beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43830/0 (socket says 172.21.15.82:43830) 2024-06-02T22:54:21.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901d319640 1 -- 172.21.15.82:0/4292661926 learned_addr learned my addr 172.21.15.82:0/4292661926 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:21.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 143557736 0 0) 0x7f90180b3170 con 0x7f90180b2cf0 2024-06-02T22:54:21.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901db1a640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90181553c0 0x7f90180cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9004005730 con 0x7f90180b2cf0 2024-06-02T22:54:21.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901e31b640 1 --2- 172.21.15.82:0/4292661926 >> v2:172.21.15.184:3300/0 conn(0x7f90180cec50 0x7f90180cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3482825011 0 0) 0x7f9004005730 con 0x7f90180b2cf0 2024-06-02T22:54:21.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90181553c0 msgr2=0x7f90180cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90181553c0 0x7f90180cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 >> v2:172.21.15.184:3300/0 conn(0x7f90180cec50 msgr2=0x7f90180cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 --2- 172.21.15.82:0/4292661926 >> v2:172.21.15.184:3300/0 conn(0x7f90180cec50 0x7f90180cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90180cca30 con 0x7f90180b2cf0 2024-06-02T22:54:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f9008001670 con 0x7f90180b2cf0 2024-06-02T22:54:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 >> v1:172.21.15.82:6789/0 conn(0x7f90180b2cf0 legacy=0x7f901815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9004005bc0 0x7f9004005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90181553c0 0x7f9004006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9004006f50 0x7f90040073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f90180b3420 con 0x7f9004006f50 2024-06-02T22:54:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f90180cc750 con 0x7f9004005bc0 2024-06-02T22:54:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.826+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f900400dbd0 con 0x7f90181553c0 2024-06-02T22:54:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.827+0000 7f901e31b640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9004006f50 0x7f90040073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.827+0000 7f901db1a640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9004005bc0 0x7f9004005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.827+0000 7f901d319640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90181553c0 0x7f9004006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.827+0000 7f901e31b640 1 -- 172.21.15.82:0/4292661926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90181553c0 msgr2=0x7f9004006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:21.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.827+0000 7f901e31b640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90181553c0 0x7f9004006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.827+0000 7f901e31b640 1 -- 172.21.15.82:0/4292661926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9004005bc0 msgr2=0x7f9004005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:21.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.827+0000 7f901e31b640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9004005bc0 0x7f9004005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.827+0000 7f901e31b640 1 -- 172.21.15.82:0/4292661926 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9004005730 con 0x7f9004006f50 2024-06-02T22:54:21.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.827+0000 7f901e31b640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9004006f50 0x7f90040073d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9010009fc0 tx=0x7f9004007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5302aba65cd44fd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.828+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010009c10 con 0x7f9004006f50 2024-06-02T22:54:21.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.828+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9010036070 con 0x7f9004006f50 2024-06-02T22:54:21.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.828+0000 7f901cb18640 1 -- 172.21.15.82:0/4292661926 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901002d070 con 0x7f9004006f50 2024-06-02T22:54:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.828+0000 7f901fd7e640 1 -- 172.21.15.82:0/4292661926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9004006f50 msgr2=0x7f90040073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.828+0000 7f901fd7e640 1 --2- 172.21.15.82:0/4292661926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9004006f50 0x7f90040073d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9010009fc0 tx=0x7f9004007a40 comp rx=0 tx=0).stop 2024-06-02T22:54:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.828+0000 7f901e31b640 1 -- 172.21.15.82:0/4292661926 reap_dead start 2024-06-02T22:54:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.828+0000 7f901fd7e640 1 -- 172.21.15.82:0/4292661926 shutdown_connections 2024-06-02T22:54:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.828+0000 7f901fd7e640 1 -- 172.21.15.82:0/4292661926 >> 172.21.15.82:0/4292661926 conn(0x7f90180b19f0 msgr2=0x7f90180b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.828+0000 7f901fd7e640 1 -- 172.21.15.82:0/4292661926 shutdown_connections 2024-06-02T22:54:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.828+0000 7f901fd7e640 1 -- 172.21.15.82:0/4292661926 wait complete. 2024-06-02T22:54:21.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.829+0000 7f901fd7e640 1 Processor -- start 2024-06-02T22:54:21.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.830+0000 7f901fd7e640 1 -- start start 2024-06-02T22:54:21.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.830+0000 7f901fd7e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9004006f50 0x7f901814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.830+0000 7f901fd7e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901815cff0 0x7f9018159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.830+0000 7f901fd7e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f901815a480 0x7f901815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.830+0000 7f901fd7e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f90181557a0 con 0x7f901815cff0 2024-06-02T22:54:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.830+0000 7f901fd7e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f90180b3700 con 0x7f9004006f50 2024-06-02T22:54:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.830+0000 7f901fd7e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f9018155920 con 0x7f901815a480 2024-06-02T22:54:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.830+0000 7f901d319640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901815cff0 0x7f9018159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.830+0000 7f901d319640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901815cff0 0x7f9018159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54708/0 (socket says 172.21.15.82:54708) 2024-06-02T22:54:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.830+0000 7f901d319640 1 -- 172.21.15.82:0/2916118170 learned_addr learned my addr 172.21.15.82:0/2916118170 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.831+0000 7f901d319640 1 -- 172.21.15.82:0/2916118170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f901815a480 msgr2=0x7f901815dbb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:54:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.831+0000 7f901d319640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f901815a480 0x7f901815dbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.831+0000 7f901d319640 1 -- 172.21.15.82:0/2916118170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9004006f50 msgr2=0x7f901814d830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:54:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.831+0000 7f901d319640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9004006f50 0x7f901814d830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.831+0000 7f901d319640 1 -- 172.21.15.82:0/2916118170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901815bf50 con 0x7f901815cff0 2024-06-02T22:54:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.831+0000 7f901d319640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901815cff0 0x7f9018159f40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9008007290 tx=0x7f9008007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.831+0000 7f900e7fc640 1 -- 172.21.15.82:0/2916118170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900800f940 con 0x7f901815cff0 2024-06-02T22:54:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.831+0000 7f900e7fc640 1 -- 172.21.15.82:0/2916118170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9008018070 con 0x7f901815cff0 2024-06-02T22:54:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.831+0000 7f901fd7e640 1 -- 172.21.15.82:0/2916118170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901815c230 con 0x7f901815cff0 2024-06-02T22:54:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.831+0000 7f900e7fc640 1 -- 172.21.15.82:0/2916118170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900800fd00 con 0x7f901815cff0 2024-06-02T22:54:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.831+0000 7f901fd7e640 1 -- 172.21.15.82:0/2916118170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901815c7f0 con 0x7f901815cff0 2024-06-02T22:54:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.832+0000 7f901fd7e640 1 -- 172.21.15.82:0/2916118170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90180cd230 con 0x7f901815cff0 2024-06-02T22:54:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.832+0000 7f900e7fc640 1 -- 172.21.15.82:0/2916118170 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f900801d460 con 0x7f901815cff0 2024-06-02T22:54:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.833+0000 7f900e7fc640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ffc06be30 0x7f8ffc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.833+0000 7f900e7fc640 1 -- 172.21.15.82:0/2916118170 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f900808ae50 con 0x7f901815cff0 2024-06-02T22:54:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.833+0000 7f901db1a640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ffc06be30 0x7f8ffc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.833+0000 7f901db1a640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ffc06be30 0x7f8ffc06e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9014009940 tx=0x7f9014009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:21.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:21.837+0000 7f900e7fc640 1 -- 172.21.15.82:0/2916118170 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f90180cd230 con 0x7f901815cff0 2024-06-02T22:54:22.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.013+0000 7f901fd7e640 1 -- 172.21.15.82:0/2916118170 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f9018068430 con 0x7f8ffc06be30 2024-06-02T22:54:22.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.013+0000 7f900e7fc640 1 -- 172.21.15.82:0/2916118170 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9018068430 con 0x7f8ffc06be30 2024-06-02T22:54:22.013 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 6 to deep-scrub 2024-06-02T22:54:22.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 -- 172.21.15.82:0/2916118170 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ffc06be30 msgr2=0x7f8ffc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ffc06be30 0x7f8ffc06e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9014009940 tx=0x7f9014009190 comp rx=0 tx=0).stop 2024-06-02T22:54:22.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 -- 172.21.15.82:0/2916118170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901815cff0 msgr2=0x7f9018159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901815cff0 0x7f9018159f40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9008007290 tx=0x7f9008007750 comp rx=0 tx=0).stop 2024-06-02T22:54:22.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 -- 172.21.15.82:0/2916118170 shutdown_connections 2024-06-02T22:54:22.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f8ffc06be30 0x7f8ffc06e2f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f901815a480 0x7f901815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f901815cff0 0x7f9018159f40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 --2- 172.21.15.82:0/2916118170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9004006f50 0x7f901814d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 -- 172.21.15.82:0/2916118170 >> 172.21.15.82:0/2916118170 conn(0x7f90180b19f0 msgr2=0x7f90180cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:22.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 -- 172.21.15.82:0/2916118170 shutdown_connections 2024-06-02T22:54:22.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.015+0000 7f901fd7e640 1 -- 172.21.15.82:0/2916118170 wait complete. 2024-06-02T22:54:22.026 INFO:tasks.ceph:Scrubbing osd.7 2024-06-02T22:54:22.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-06-02T22:54:22.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.129+0000 7f38dfcb3640 1 Processor -- start 2024-06-02T22:54:22.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.130+0000 7f38dfcb3640 1 -- start start 2024-06-02T22:54:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.130+0000 7f38dfcb3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f38d815e670 0x7f38d80d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.130+0000 7f38dfcb3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80d0e00 0x7f38d80cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.130+0000 7f38dfcb3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38d815ec90 con 0x7f38d80d1f30 2024-06-02T22:54:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.130+0000 7f38dfcb3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f38d815fa50 con 0x7f38d815e670 2024-06-02T22:54:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.130+0000 7f38dfcb3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f38d815ea50 con 0x7f38d80d0e00 2024-06-02T22:54:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.131+0000 7f38dda4f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f38d815e670 0x7f38d80d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.131+0000 7f38dd24e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f38d80d1f30 0x7f38d80d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43834/0 (socket says 172.21.15.82:43834) 2024-06-02T22:54:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.131+0000 7f38dd24e640 1 -- 172.21.15.82:0/2764640214 learned_addr learned my addr 172.21.15.82:0/2764640214 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.131+0000 7f38de250640 1 --2- 172.21.15.82:0/2764640214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80d0e00 0x7f38d80cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.131+0000 7f38dda4f640 1 -- 172.21.15.82:0/2764640214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80d0e00 msgr2=0x7f38d80cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.131+0000 7f38dda4f640 1 --2- 172.21.15.82:0/2764640214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80d0e00 0x7f38d80cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.131+0000 7f38dda4f640 1 -- 172.21.15.82:0/2764640214 >> v1:172.21.15.82:6789/0 conn(0x7f38d80d1f30 legacy=0x7f38d80d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.131+0000 7f38dda4f640 1 -- 172.21.15.82:0/2764640214 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d815ef70 con 0x7f38d815e670 2024-06-02T22:54:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.131+0000 7f38dca4d640 1 -- 172.21.15.82:0/2764640214 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2702896040 0 0) 0x7f38d815ec90 con 0x7f38d80d1f30 2024-06-02T22:54:22.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dda4f640 1 --2- 172.21.15.82:0/2764640214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d815e670 0x7f38d80d49f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097a0 tx=0x7f38cc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321b146ed7496bc8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:22.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dca4d640 1 -- 172.21.15.82:0/2764640214 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc037070 con 0x7f38d815e670 2024-06-02T22:54:22.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dca4d640 1 -- 172.21.15.82:0/2764640214 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38cc032440 con 0x7f38d815e670 2024-06-02T22:54:22.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dca4d640 1 -- 172.21.15.82:0/2764640214 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc032810 con 0x7f38d815e670 2024-06-02T22:54:22.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dfcb3640 1 -- 172.21.15.82:0/2764640214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d815e670 msgr2=0x7f38d80d49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dfcb3640 1 --2- 172.21.15.82:0/2764640214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d815e670 0x7f38d80d49f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097a0 tx=0x7f38cc02a210 comp rx=0 tx=0).stop 2024-06-02T22:54:22.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dfcb3640 1 -- 172.21.15.82:0/2764640214 shutdown_connections 2024-06-02T22:54:22.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dfcb3640 1 --2- 172.21.15.82:0/2764640214 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80d0e00 0x7f38d80cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dfcb3640 1 --2- 172.21.15.82:0/2764640214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d815e670 0x7f38d80d49f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dfcb3640 1 -- 172.21.15.82:0/2764640214 >> 172.21.15.82:0/2764640214 conn(0x7f38d809d400 msgr2=0x7f38d80d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:22.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dfcb3640 1 -- 172.21.15.82:0/2764640214 shutdown_connections 2024-06-02T22:54:22.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.132+0000 7f38dfcb3640 1 -- 172.21.15.82:0/2764640214 wait complete. 2024-06-02T22:54:22.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.133+0000 7f38dfcb3640 1 Processor -- start 2024-06-02T22:54:22.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.134+0000 7f38dfcb3640 1 -- start start 2024-06-02T22:54:22.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.134+0000 7f38dfcb3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80d0e00 0x7f38d80b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.134+0000 7f38dfcb3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d80d1f30 0x7f38d806c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.134+0000 7f38dfcb3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d815e670 0x7f38d80cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.134+0000 7f38dfcb3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38d80d2370 con 0x7f38d815e670 2024-06-02T22:54:22.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.134+0000 7f38dfcb3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f38d815f530 con 0x7f38d80d1f30 2024-06-02T22:54:22.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.134+0000 7f38dfcb3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f38d80cf110 con 0x7f38d80d0e00 2024-06-02T22:54:22.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.134+0000 7f38de250640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d815e670 0x7f38d80cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:22.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.134+0000 7f38de250640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d815e670 0x7f38d80cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54716/0 (socket says 172.21.15.82:54716) 2024-06-02T22:54:22.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.134+0000 7f38de250640 1 -- 172.21.15.82:0/1120981441 learned_addr learned my addr 172.21.15.82:0/1120981441 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:22.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.135+0000 7f38de250640 1 -- 172.21.15.82:0/1120981441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80d0e00 msgr2=0x7f38d80b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.135+0000 7f38de250640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80d0e00 0x7f38d80b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.135+0000 7f38de250640 1 -- 172.21.15.82:0/1120981441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d80d1f30 msgr2=0x7f38d806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.135+0000 7f38de250640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d80d1f30 0x7f38d806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.135+0000 7f38de250640 1 -- 172.21.15.82:0/1120981441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d81f7530 con 0x7f38d815e670 2024-06-02T22:54:22.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.135+0000 7f38de250640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d815e670 0x7f38d80cd710 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f38d000cd40 tx=0x7f38d000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:22.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.135+0000 7f38ca7fc640 1 -- 172.21.15.82:0/1120981441 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0003b90 con 0x7f38d815e670 2024-06-02T22:54:22.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.135+0000 7f38ca7fc640 1 -- 172.21.15.82:0/1120981441 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d0003d30 con 0x7f38d815e670 2024-06-02T22:54:22.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.135+0000 7f38ca7fc640 1 -- 172.21.15.82:0/1120981441 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0004240 con 0x7f38d815e670 2024-06-02T22:54:22.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.135+0000 7f38dfcb3640 1 -- 172.21.15.82:0/1120981441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d81f7810 con 0x7f38d815e670 2024-06-02T22:54:22.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.135+0000 7f38dfcb3640 1 -- 172.21.15.82:0/1120981441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d81f7dd0 con 0x7f38d815e670 2024-06-02T22:54:22.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.136+0000 7f38dfcb3640 1 -- 172.21.15.82:0/1120981441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38d81f8420 con 0x7f38d815e670 2024-06-02T22:54:22.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.136+0000 7f38ca7fc640 1 -- 172.21.15.82:0/1120981441 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38d00043e0 con 0x7f38d815e670 2024-06-02T22:54:22.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.137+0000 7f38ca7fc640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38bc06be60 0x7f38bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.137+0000 7f38ca7fc640 1 -- 172.21.15.82:0/1120981441 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f38d008b6f0 con 0x7f38d815e670 2024-06-02T22:54:22.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.137+0000 7f38dda4f640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38bc06be60 0x7f38bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:22.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.137+0000 7f38ca7fc640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] conn(0x7f38bc072300 0x7f38bc074740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.137+0000 7f38ca7fc640 1 -- 172.21.15.82:0/1120981441 --> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38d001ce50 con 0x7f38bc072300 2024-06-02T22:54:22.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.137+0000 7f38ca7fc640 1 -- 172.21.15.82:0/1120981441 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f38d0092050 con 0x7f38d815e670 2024-06-02T22:54:22.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.137+0000 7f38dda4f640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38bc06be60 0x7f38bc06e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f38cc034000 tx=0x7f38cc02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:22.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.137+0000 7f38dd24e640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] conn(0x7f38bc072300 0x7f38bc074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:22.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.138+0000 7f38dd24e640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] conn(0x7f38bc072300 0x7f38bc074740 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:22.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.138+0000 7f38ca7fc640 1 -- 172.21.15.82:0/1120981441 <== osd.7 v2:172.21.15.184:6824/3753375553 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38d001ce50 con 0x7f38bc072300 2024-06-02T22:54:22.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.151+0000 7f38dfcb3640 1 -- 172.21.15.82:0/1120981441 --> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f38d8068540 con 0x7f38bc072300 2024-06-02T22:54:22.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.152+0000 7f38ca7fc640 1 -- 172.21.15.82:0/1120981441 <== osd.7 v2:172.21.15.184:6824/3753375553 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f38d8068540 con 0x7f38bc072300 2024-06-02T22:54:22.152 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-02T22:54:22.152 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-02T22:54:22.152 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-02T22:54:22.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.152+0000 7f38dfcb3640 1 -- 172.21.15.82:0/1120981441 >> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] conn(0x7f38bc072300 msgr2=0x7f38bc074740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.152+0000 7f38dfcb3640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.184:6824/3753375553,v1:172.21.15.184:6825/3753375553] conn(0x7f38bc072300 0x7f38bc074740 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.152+0000 7f38dfcb3640 1 -- 172.21.15.82:0/1120981441 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38bc06be60 msgr2=0x7f38bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.152+0000 7f38dfcb3640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f38bc06be60 0x7f38bc06e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f38cc034000 tx=0x7f38cc02c000 comp rx=0 tx=0).stop 2024-06-02T22:54:22.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.152+0000 7f38dfcb3640 1 -- 172.21.15.82:0/1120981441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d815e670 msgr2=0x7f38d80cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.152+0000 7f38dfcb3640 1 --2- 172.21.15.82:0/1120981441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d815e670 0x7f38d80cd710 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f38d000cd40 tx=0x7f38d000a660 comp rx=0 tx=0).stop 2024-06-02T22:54:22.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.152+0000 7f38de250640 1 -- 172.21.15.82:0/1120981441 reap_dead start 2024-06-02T22:54:22.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.152+0000 7f38dfcb3640 1 -- 172.21.15.82:0/1120981441 shutdown_connections 2024-06-02T22:54:22.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.152+0000 7f38dfcb3640 1 -- 172.21.15.82:0/1120981441 >> 172.21.15.82:0/1120981441 conn(0x7f38d809d400 msgr2=0x7f38d806d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:22.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.152+0000 7f38dfcb3640 1 -- 172.21.15.82:0/1120981441 shutdown_connections 2024-06-02T22:54:22.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.153+0000 7f38dfcb3640 1 -- 172.21.15.82:0/1120981441 wait complete. 2024-06-02T22:54:22.163 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-06-02T22:54:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.264+0000 7f7709ff9640 1 Processor -- start 2024-06-02T22:54:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.264+0000 7f7709ff9640 1 -- start start 2024-06-02T22:54:22.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.264+0000 7f7709ff9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f77040d1fc0 0x7f77040cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.264+0000 7f7709ff9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f770415f5e0 con 0x7f770415f1a0 2024-06-02T22:54:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.264+0000 7f7709ff9640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77040d0ad0 con 0x7f77040d2680 2024-06-02T22:54:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.264+0000 7f7709ff9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f77040d13e0 con 0x7f77040d1fc0 2024-06-02T22:54:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.265+0000 7f7702ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f770415f1a0 0x7f77040cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43840/0 (socket says 172.21.15.82:43840) 2024-06-02T22:54:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.265+0000 7f7702ffd640 1 -- 172.21.15.82:0/855902484 learned_addr learned my addr 172.21.15.82:0/855902484 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.265+0000 7f7703fff640 1 --2- 172.21.15.82:0/855902484 >> v2:172.21.15.82:3300/0 conn(0x7f77040d1fc0 0x7f77040cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.265+0000 7f77027fc640 1 -- 172.21.15.82:0/855902484 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 460711169 0 0) 0x7f770415f5e0 con 0x7f770415f1a0 2024-06-02T22:54:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.265+0000 7f77027fc640 1 -- 172.21.15.82:0/855902484 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76ec003520 con 0x7f770415f1a0 2024-06-02T22:54:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.265+0000 7f7703fff640 1 -- 172.21.15.82:0/855902484 >> v1:172.21.15.184:6789/0 conn(0x7f77040d2680 legacy=0x7f77040d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.265+0000 7f7703fff640 1 -- 172.21.15.82:0/855902484 >> v1:172.21.15.82:6789/0 conn(0x7f770415f1a0 legacy=0x7f77040cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.265+0000 7f7703fff640 1 -- 172.21.15.82:0/855902484 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770415f890 con 0x7f77040d1fc0 2024-06-02T22:54:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.266+0000 7f7703fff640 1 --2- 172.21.15.82:0/855902484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77040d1fc0 0x7f77040cf680 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009d90 tx=0x7f76fc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b90e8be5f34222 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.266+0000 7f77027fc640 1 -- 172.21.15.82:0/855902484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc007740 con 0x7f77040d1fc0 2024-06-02T22:54:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.266+0000 7f77027fc640 1 -- 172.21.15.82:0/855902484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76fc0078e0 con 0x7f77040d1fc0 2024-06-02T22:54:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.266+0000 7f77027fc640 1 -- 172.21.15.82:0/855902484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc007cb0 con 0x7f77040d1fc0 2024-06-02T22:54:22.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.266+0000 7f7709ff9640 1 -- 172.21.15.82:0/855902484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77040d1fc0 msgr2=0x7f77040cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.266+0000 7f7709ff9640 1 --2- 172.21.15.82:0/855902484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77040d1fc0 0x7f77040cf680 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009d90 tx=0x7f76fc02a6f0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.266+0000 7f7709ff9640 1 -- 172.21.15.82:0/855902484 shutdown_connections 2024-06-02T22:54:22.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.266+0000 7f7709ff9640 1 --2- 172.21.15.82:0/855902484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77040d1fc0 0x7f77040cf680 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.266+0000 7f7709ff9640 1 -- 172.21.15.82:0/855902484 >> 172.21.15.82:0/855902484 conn(0x7f770409d3f0 msgr2=0x7f77040d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:22.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.266+0000 7f7709ff9640 1 -- 172.21.15.82:0/855902484 shutdown_connections 2024-06-02T22:54:22.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.266+0000 7f7709ff9640 1 -- 172.21.15.82:0/855902484 wait complete. 2024-06-02T22:54:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.267+0000 7f7709ff9640 1 Processor -- start 2024-06-02T22:54:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.268+0000 7f7709ff9640 1 -- start start 2024-06-02T22:54:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.268+0000 7f7709ff9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77040d1fc0 0x7f77040cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.268+0000 7f7709ff9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77040d2680 0x7f7704152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.268+0000 7f7709ff9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770415f1a0 0x7f7704153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.268+0000 7f7709ff9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77040d2410 con 0x7f770415f1a0 2024-06-02T22:54:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.268+0000 7f7709ff9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f77040d1070 con 0x7f77040d1fc0 2024-06-02T22:54:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.268+0000 7f7709ff9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f77040d4f00 con 0x7f77040d2680 2024-06-02T22:54:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.268+0000 7f7703fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770415f1a0 0x7f7704153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.268+0000 7f7703fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770415f1a0 0x7f7704153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54726/0 (socket says 172.21.15.82:54726) 2024-06-02T22:54:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.268+0000 7f7703fff640 1 -- 172.21.15.82:0/885456177 learned_addr learned my addr 172.21.15.82:0/885456177 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.269+0000 7f7703fff640 1 -- 172.21.15.82:0/885456177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77040d2680 msgr2=0x7f7704152cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:54:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.269+0000 7f7703fff640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77040d2680 0x7f7704152cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.269+0000 7f7703fff640 1 -- 172.21.15.82:0/885456177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77040d1fc0 msgr2=0x7f77040cd670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:54:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.269+0000 7f7703fff640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77040d1fc0 0x7f77040cd670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.269+0000 7f7703fff640 1 -- 172.21.15.82:0/885456177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7704156ec0 con 0x7f770415f1a0 2024-06-02T22:54:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.269+0000 7f7703fff640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770415f1a0 0x7f7704153230 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009eb0 tx=0x7f76fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.269+0000 7f76ebfff640 1 -- 172.21.15.82:0/885456177 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc040070 con 0x7f770415f1a0 2024-06-02T22:54:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.269+0000 7f76ebfff640 1 -- 172.21.15.82:0/885456177 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76fc031bc0 con 0x7f770415f1a0 2024-06-02T22:54:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.269+0000 7f7709ff9640 1 -- 172.21.15.82:0/885456177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7704157130 con 0x7f770415f1a0 2024-06-02T22:54:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.269+0000 7f76ebfff640 1 -- 172.21.15.82:0/885456177 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc009450 con 0x7f770415f1a0 2024-06-02T22:54:22.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.269+0000 7f7709ff9640 1 -- 172.21.15.82:0/885456177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77041576f0 con 0x7f770415f1a0 2024-06-02T22:54:22.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.270+0000 7f7709ff9640 1 -- 172.21.15.82:0/885456177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7704068430 con 0x7f770415f1a0 2024-06-02T22:54:22.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.271+0000 7f76ebfff640 1 -- 172.21.15.82:0/885456177 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76fc039040 con 0x7f770415f1a0 2024-06-02T22:54:22.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.271+0000 7f76ebfff640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f76f006be30 0x7f76f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.271+0000 7f76ebfff640 1 -- 172.21.15.82:0/885456177 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f76fc0ac530 con 0x7f770415f1a0 2024-06-02T22:54:22.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.271+0000 7f77037fe640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f76f006be30 0x7f76f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:22.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.272+0000 7f77037fe640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f76f006be30 0x7f76f006e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f76f40014e0 tx=0x7f76f40079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:22.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.275+0000 7f76ebfff640 1 -- 172.21.15.82:0/885456177 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f76fc043360 con 0x7f770415f1a0 2024-06-02T22:54:22.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.447+0000 7f7709ff9640 1 -- 172.21.15.82:0/885456177 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f77040d04e0 con 0x7f76f006be30 2024-06-02T22:54:22.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.448+0000 7f76ebfff640 1 -- 172.21.15.82:0/885456177 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f77040d04e0 con 0x7f76f006be30 2024-06-02T22:54:22.448 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 7 to deep-scrub 2024-06-02T22:54:22.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 -- 172.21.15.82:0/885456177 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f76f006be30 msgr2=0x7f76f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f76f006be30 0x7f76f006e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f76f40014e0 tx=0x7f76f40079d0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 -- 172.21.15.82:0/885456177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770415f1a0 msgr2=0x7f7704153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770415f1a0 0x7f7704153230 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009eb0 tx=0x7f76fc004a40 comp rx=0 tx=0).stop 2024-06-02T22:54:22.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 -- 172.21.15.82:0/885456177 shutdown_connections 2024-06-02T22:54:22.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f76f006be30 0x7f76f006e2f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770415f1a0 0x7f7704153230 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77040d2680 0x7f7704152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 --2- 172.21.15.82:0/885456177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77040d1fc0 0x7f77040cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 -- 172.21.15.82:0/885456177 >> 172.21.15.82:0/885456177 conn(0x7f770409d3f0 msgr2=0x7f77040c83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:22.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 -- 172.21.15.82:0/885456177 shutdown_connections 2024-06-02T22:54:22.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.450+0000 7f7709ff9640 1 -- 172.21.15.82:0/885456177 wait complete. 2024-06-02T22:54:22.460 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:54:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.560+0000 7ffb16714640 1 Processor -- start 2024-06-02T22:54:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.560+0000 7ffb16714640 1 -- start start 2024-06-02T22:54:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.560+0000 7ffb16714640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ffb100ae910 0x7ffb1006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.560+0000 7ffb16714640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ffb1006ea20 0x7ffb100cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.560+0000 7ffb16714640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb100cf190 0x7ffb1015ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.560+0000 7ffb16714640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ffb1006ee90 con 0x7ffb100ae910 2024-06-02T22:54:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.560+0000 7ffb16714640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7ffb100cf620 con 0x7ffb1006ea20 2024-06-02T22:54:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.560+0000 7ffb16714640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1006d130 con 0x7ffb100cf190 2024-06-02T22:54:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.561+0000 7ffb0ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ffb100ae910 0x7ffb1006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.561+0000 7ffb0ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ffb100ae910 0x7ffb1006e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54740/0 (socket says 172.21.15.82:54740) 2024-06-02T22:54:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.561+0000 7ffb0ffff640 1 -- 172.21.15.82:0/1444856875 learned_addr learned my addr 172.21.15.82:0/1444856875 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.561+0000 7ffb0ffff640 1 -- 172.21.15.82:0/1444856875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb100cf190 msgr2=0x7ffb1015ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.561+0000 7ffb0ffff640 1 --2- 172.21.15.82:0/1444856875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb100cf190 0x7ffb1015ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.561+0000 7ffb0ffff640 1 -- 172.21.15.82:0/1444856875 >> v2:172.21.15.184:3300/0 conn(0x7ffb1006ea20 msgr2=0x7ffb100cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.561+0000 7ffb0ffff640 1 --2- 172.21.15.82:0/1444856875 >> v2:172.21.15.184:3300/0 conn(0x7ffb1006ea20 0x7ffb100cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.561+0000 7ffb0ffff640 1 -- 172.21.15.82:0/1444856875 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1006d410 con 0x7ffb100ae910 2024-06-02T22:54:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb0ffff640 1 --2- 172.21.15.82:0/1444856875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb100ae910 0x7ffb1006e4e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ffb10070c80 tx=0x7ffb0002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb594d4b5a77dc1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb0effd640 1 -- 172.21.15.82:0/1444856875 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00037070 con 0x7ffb100ae910 2024-06-02T22:54:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb0effd640 1 -- 172.21.15.82:0/1444856875 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb00032440 con 0x7ffb100ae910 2024-06-02T22:54:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb0effd640 1 -- 172.21.15.82:0/1444856875 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00032810 con 0x7ffb100ae910 2024-06-02T22:54:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb16714640 1 -- 172.21.15.82:0/1444856875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb100ae910 msgr2=0x7ffb1006e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb16714640 1 --2- 172.21.15.82:0/1444856875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb100ae910 0x7ffb1006e4e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ffb10070c80 tx=0x7ffb0002a140 comp rx=0 tx=0).stop 2024-06-02T22:54:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb16714640 1 -- 172.21.15.82:0/1444856875 shutdown_connections 2024-06-02T22:54:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb16714640 1 --2- 172.21.15.82:0/1444856875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb100cf190 0x7ffb1015ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb16714640 1 --2- 172.21.15.82:0/1444856875 >> v2:172.21.15.184:3300/0 conn(0x7ffb1006ea20 0x7ffb100cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb16714640 1 --2- 172.21.15.82:0/1444856875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb100ae910 0x7ffb1006e4e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb16714640 1 -- 172.21.15.82:0/1444856875 >> 172.21.15.82:0/1444856875 conn(0x7ffb100b19f0 msgr2=0x7ffb100b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb16714640 1 -- 172.21.15.82:0/1444856875 shutdown_connections 2024-06-02T22:54:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.562+0000 7ffb16714640 1 -- 172.21.15.82:0/1444856875 wait complete. 2024-06-02T22:54:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.563+0000 7ffb16714640 1 Processor -- start 2024-06-02T22:54:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.564+0000 7ffb16714640 1 -- start start 2024-06-02T22:54:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.564+0000 7ffb16714640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1006ea20 0x7ffb1014f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.564+0000 7ffb16714640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb100ae910 0x7ffb1009d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.564+0000 7ffb16714640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb100cf190 0x7ffb100ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.564+0000 7ffb16714640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb100aecf0 con 0x7ffb1006ea20 2024-06-02T22:54:22.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.564+0000 7ffb16714640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1006d9d0 con 0x7ffb100ae910 2024-06-02T22:54:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.564+0000 7ffb16714640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1015f010 con 0x7ffb100cf190 2024-06-02T22:54:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.564+0000 7ffb0ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1006ea20 0x7ffb1014f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.564+0000 7ffb0ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1006ea20 0x7ffb1014f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54750/0 (socket says 172.21.15.82:54750) 2024-06-02T22:54:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb0ffff640 1 -- 172.21.15.82:0/995503653 learned_addr learned my addr 172.21.15.82:0/995503653 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb0ffff640 1 -- 172.21.15.82:0/995503653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb100cf190 msgr2=0x7ffb100ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb0ffff640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb100cf190 0x7ffb100ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb0ffff640 1 -- 172.21.15.82:0/995503653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb100ae910 msgr2=0x7ffb1009d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb0ffff640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb100ae910 0x7ffb1009d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb0ffff640 1 -- 172.21.15.82:0/995503653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1009ae80 con 0x7ffb1006ea20 2024-06-02T22:54:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb0ffff640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1006ea20 0x7ffb1014f620 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ffb00000c00 tx=0x7ffb000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb0cff9640 1 -- 172.21.15.82:0/995503653 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00041070 con 0x7ffb1006ea20 2024-06-02T22:54:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb0cff9640 1 -- 172.21.15.82:0/995503653 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0003c870 con 0x7ffb1006ea20 2024-06-02T22:54:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb16714640 1 -- 172.21.15.82:0/995503653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1009b160 con 0x7ffb1006ea20 2024-06-02T22:54:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb0cff9640 1 -- 172.21.15.82:0/995503653 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00037040 con 0x7ffb1006ea20 2024-06-02T22:54:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.565+0000 7ffb16714640 1 -- 172.21.15.82:0/995503653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1009b720 con 0x7ffb1006ea20 2024-06-02T22:54:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.566+0000 7ffb16714640 1 -- 172.21.15.82:0/995503653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb10068430 con 0x7ffb1006ea20 2024-06-02T22:54:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.567+0000 7ffb0cff9640 1 -- 172.21.15.82:0/995503653 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb00044070 con 0x7ffb1006ea20 2024-06-02T22:54:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.567+0000 7ffb0cff9640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffafc06be30 0x7ffafc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.567+0000 7ffb0cff9640 1 -- 172.21.15.82:0/995503653 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7ffb000aba80 con 0x7ffb1006ea20 2024-06-02T22:54:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.567+0000 7ffb0f7fe640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffafc06be30 0x7ffafc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.568+0000 7ffb0f7fe640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffafc06be30 0x7ffafc06e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffb100ae480 tx=0x7ffb04006bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.571+0000 7ffb0cff9640 1 -- 172.21.15.82:0/995503653 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffb0007a750 con 0x7ffb1006ea20 2024-06-02T22:54:22.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.741+0000 7ffb16714640 1 -- 172.21.15.82:0/995503653 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb100ceda0 con 0x7ffafc06be30 2024-06-02T22:54:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.742+0000 7ffb0cff9640 1 -- 172.21.15.82:0/995503653 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13468 (secure 0 0 0) 0x7ffb100ceda0 con 0x7ffafc06be30 2024-06-02T22:54:22.742 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:22.743 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:54:22.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 -- 172.21.15.82:0/995503653 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffafc06be30 msgr2=0x7ffafc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffafc06be30 0x7ffafc06e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffb100ae480 tx=0x7ffb04006bf0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 -- 172.21.15.82:0/995503653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1006ea20 msgr2=0x7ffb1014f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1006ea20 0x7ffb1014f620 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ffb00000c00 tx=0x7ffb000046c0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 -- 172.21.15.82:0/995503653 shutdown_connections 2024-06-02T22:54:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7ffafc06be30 0x7ffafc06e2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb100cf190 0x7ffb100ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb100ae910 0x7ffb1009d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 --2- 172.21.15.82:0/995503653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb1006ea20 0x7ffb1014f620 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 -- 172.21.15.82:0/995503653 >> 172.21.15.82:0/995503653 conn(0x7ffb100b19f0 msgr2=0x7ffb1015a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 -- 172.21.15.82:0/995503653 shutdown_connections 2024-06-02T22:54:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:22.744+0000 7ffb16714640 1 -- 172.21.15.82:0/995503653 wait complete. 2024-06-02T22:54:22.754 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-06-02T22:54:21.852212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222748,"kb_used_data":6568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751972,"statfs":{"total":773094113280,"available":772866019328,"internally_reserved":0,"allocated":6725632,"data_stored":3665552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.154195"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":239,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-06-02T22:54:14.736887+0000","last_change":"2024-06-02T22:51:52.913770+0000","last_active":"2024-06-02T22:54:14.736887+0000","last_peered":"2024-06-02T22:54:14.736887+0000","last_clean":"2024-06-02T22:54:14.736887+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:54:14.736887+0000","last_undegraded":"2024-06-02T22:54:14.736887+0000","last_fullsized":"2024-06-02T22:54:14.736887+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:51:51.860217+0000","last_clean_scrub_stamp":"2024-06-02T22:51:51.860217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:13:02.591034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1286144,"data_stored":900970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1286144,"data_stored":900970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:54:22.757 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-06-02T22:51:51.860217+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=22, tm_min=51, tm_sec=51, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=22, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=154, tm_isdst=0) 2024-06-02T22:54:22.757 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-06-02T22:54:34.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:54:34.202 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:54:42.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T22:54:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.870+0000 7fb1483e7640 1 Processor -- start 2024-06-02T22:54:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.870+0000 7fb1483e7640 1 -- start start 2024-06-02T22:54:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.871+0000 7fb1483e7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb14006ebf0 0x7fb1400cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.871+0000 7fb1483e7640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1400cf190 0x7fb1400acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.871+0000 7fb1483e7640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1400cf640 con 0x7fb1400ae910 2024-06-02T22:54:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.871+0000 7fb1483e7640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7fb14006d130 con 0x7fb1400cf190 2024-06-02T22:54:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.871+0000 7fb1483e7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb14006d410 con 0x7fb14006ebf0 2024-06-02T22:54:42.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.871+0000 7fb146183640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb1400ae910 0x7fb14006e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33254/0 (socket says 172.21.15.82:33254) 2024-06-02T22:54:42.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.872+0000 7fb146183640 1 -- 172.21.15.82:0/587477779 learned_addr learned my addr 172.21.15.82:0/587477779 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:42.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.872+0000 7fb146984640 1 --2- 172.21.15.82:0/587477779 >> v2:172.21.15.184:3300/0 conn(0x7fb1400cf190 0x7fb1400acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:42.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.872+0000 7fb145982640 1 --2- 172.21.15.82:0/587477779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb14006ebf0 0x7fb1400cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:42.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.872+0000 7fb145181640 1 -- 172.21.15.82:0/587477779 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760721781 0 0) 0x7fb1400cf640 con 0x7fb1400ae910 2024-06-02T22:54:42.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.872+0000 7fb145181640 1 -- 172.21.15.82:0/587477779 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb128005730 con 0x7fb1400ae910 2024-06-02T22:54:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.872+0000 7fb145181640 1 -- 172.21.15.82:0/587477779 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 90748680 0 0) 0x7fb128005730 con 0x7fb1400ae910 2024-06-02T22:54:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.872+0000 7fb146984640 1 -- 172.21.15.82:0/587477779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb14006ebf0 msgr2=0x7fb1400cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.872+0000 7fb146984640 1 --2- 172.21.15.82:0/587477779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb14006ebf0 0x7fb1400cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.872+0000 7fb146984640 1 -- 172.21.15.82:0/587477779 >> v1:172.21.15.82:6789/0 conn(0x7fb1400ae910 legacy=0x7fb14006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.872+0000 7fb146984640 1 -- 172.21.15.82:0/587477779 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14006d6f0 con 0x7fb1400cf190 2024-06-02T22:54:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.872+0000 7fb145982640 1 --2- 172.21.15.82:0/587477779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb14006ebf0 0x7fb1400cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:54:42.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.873+0000 7fb146984640 1 --2- 172.21.15.82:0/587477779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1400cf190 0x7fb1400acd40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb1300097d0 tx=0x7fb13002a0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2460593951829e16 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:42.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.873+0000 7fb145181640 1 -- 172.21.15.82:0/587477779 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb130037070 con 0x7fb1400cf190 2024-06-02T22:54:42.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.873+0000 7fb145181640 1 -- 172.21.15.82:0/587477779 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13002ab40 con 0x7fb1400cf190 2024-06-02T22:54:42.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.873+0000 7fb145181640 1 -- 172.21.15.82:0/587477779 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138001670 con 0x7fb1400cf190 2024-06-02T22:54:42.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.874+0000 7fb1483e7640 1 -- 172.21.15.82:0/587477779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1400cf190 msgr2=0x7fb1400acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:42.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.874+0000 7fb1483e7640 1 --2- 172.21.15.82:0/587477779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1400cf190 0x7fb1400acd40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb1300097d0 tx=0x7fb13002a0b0 comp rx=0 tx=0).stop 2024-06-02T22:54:42.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.874+0000 7fb1483e7640 1 -- 172.21.15.82:0/587477779 shutdown_connections 2024-06-02T22:54:42.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.874+0000 7fb1483e7640 1 --2- 172.21.15.82:0/587477779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1400cf190 0x7fb1400acd40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:42.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.874+0000 7fb1483e7640 1 --2- 172.21.15.82:0/587477779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb14006ebf0 0x7fb1400cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:42.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.874+0000 7fb1483e7640 1 -- 172.21.15.82:0/587477779 >> 172.21.15.82:0/587477779 conn(0x7fb1400b19f0 msgr2=0x7fb1400b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:42.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.874+0000 7fb1483e7640 1 -- 172.21.15.82:0/587477779 shutdown_connections 2024-06-02T22:54:42.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.874+0000 7fb1483e7640 1 -- 172.21.15.82:0/587477779 wait complete. 2024-06-02T22:54:42.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.875+0000 7fb1483e7640 1 Processor -- start 2024-06-02T22:54:42.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.875+0000 7fb1483e7640 1 -- start start 2024-06-02T22:54:42.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb1483e7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb14006ebf0 0x7fb14009aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:42.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb1483e7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1400ae910 0x7fb14014b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:42.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb1483e7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1400cf190 0x7fb140157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:42.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb1483e7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb1400ad280 con 0x7fb1400ae910 2024-06-02T22:54:42.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb1483e7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb1400aecf0 con 0x7fb1400cf190 2024-06-02T22:54:42.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb1483e7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fb1400ad400 con 0x7fb14006ebf0 2024-06-02T22:54:42.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb145982640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1400ae910 0x7fb14014b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:42.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb145982640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1400ae910 0x7fb14014b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37030/0 (socket says 172.21.15.82:37030) 2024-06-02T22:54:42.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb145982640 1 -- 172.21.15.82:0/1515459712 learned_addr learned my addr 172.21.15.82:0/1515459712 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb146183640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb14006ebf0 0x7fb14009aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb146984640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1400cf190 0x7fb140157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb145982640 1 -- 172.21.15.82:0/1515459712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb14006ebf0 msgr2=0x7fb14009aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb145982640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb14006ebf0 0x7fb14009aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb145982640 1 -- 172.21.15.82:0/1515459712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1400cf190 msgr2=0x7fb140157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb145982640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1400cf190 0x7fb140157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:42.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb145982640 1 -- 172.21.15.82:0/1515459712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14015d130 con 0x7fb1400ae910 2024-06-02T22:54:42.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.876+0000 7fb145982640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1400ae910 0x7fb14014b7d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb134009ec0 tx=0x7fb13400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:42.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.877+0000 7fb13effd640 1 -- 172.21.15.82:0/1515459712 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134018020 con 0x7fb1400ae910 2024-06-02T22:54:42.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.877+0000 7fb13effd640 1 -- 172.21.15.82:0/1515459712 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb134014680 con 0x7fb1400ae910 2024-06-02T22:54:42.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.877+0000 7fb1483e7640 1 -- 172.21.15.82:0/1515459712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14015d410 con 0x7fb1400ae910 2024-06-02T22:54:42.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.877+0000 7fb13effd640 1 -- 172.21.15.82:0/1515459712 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134014a50 con 0x7fb1400ae910 2024-06-02T22:54:42.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.877+0000 7fb1483e7640 1 -- 172.21.15.82:0/1515459712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14015d9d0 con 0x7fb1400ae910 2024-06-02T22:54:42.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.878+0000 7fb1483e7640 1 -- 172.21.15.82:0/1515459712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb140068430 con 0x7fb1400ae910 2024-06-02T22:54:42.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.878+0000 7fb13effd640 1 -- 172.21.15.82:0/1515459712 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb134005d10 con 0x7fb1400ae910 2024-06-02T22:54:42.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.879+0000 7fb13effd640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb12c06be30 0x7fb12c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:42.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.879+0000 7fb13effd640 1 -- 172.21.15.82:0/1515459712 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fb13408b9b0 con 0x7fb1400ae910 2024-06-02T22:54:42.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.879+0000 7fb146183640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb12c06be30 0x7fb12c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:42.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.879+0000 7fb146183640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb12c06be30 0x7fb12c06e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb138005880 tx=0x7fb1380057f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:42.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:42.883+0000 7fb13effd640 1 -- 172.21.15.82:0/1515459712 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb134022030 con 0x7fb1400ae910 2024-06-02T22:54:43.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.054+0000 7fb1483e7640 1 -- 172.21.15.82:0/1515459712 --> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb140158ce0 con 0x7fb12c06be30 2024-06-02T22:54:43.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.055+0000 7fb13effd640 1 -- 172.21.15.82:0/1515459712 <== mgr.4104 v2:172.21.15.82:6832/2392286815 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7fb140158ce0 con 0x7fb12c06be30 2024-06-02T22:54:43.055 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:43.056 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-02T22:54:43.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 -- 172.21.15.82:0/1515459712 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb12c06be30 msgr2=0x7fb12c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb12c06be30 0x7fb12c06e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb138005880 tx=0x7fb1380057f0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 -- 172.21.15.82:0/1515459712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1400ae910 msgr2=0x7fb14014b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1400ae910 0x7fb14014b7d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb134009ec0 tx=0x7fb13400c490 comp rx=0 tx=0).stop 2024-06-02T22:54:43.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 -- 172.21.15.82:0/1515459712 shutdown_connections 2024-06-02T22:54:43.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fb12c06be30 0x7fb12c06e2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1400cf190 0x7fb140157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1400ae910 0x7fb14014b7d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 --2- 172.21.15.82:0/1515459712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb14006ebf0 0x7fb14009aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 -- 172.21.15.82:0/1515459712 >> 172.21.15.82:0/1515459712 conn(0x7fb1400b19f0 msgr2=0x7fb1400725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:43.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 -- 172.21.15.82:0/1515459712 shutdown_connections 2024-06-02T22:54:43.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.057+0000 7fb1483e7640 1 -- 172.21.15.82:0/1515459712 wait complete. 2024-06-02T22:54:43.068 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-06-02T22:54:41.856352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222732,"kb_used_data":6568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751988,"statfs":{"total":773094113280,"available":772866035712,"internally_reserved":0,"allocated":6725632,"data_stored":3665552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002589"},"pg_stats":[{"pgid":"1.0","version":"57'119","reported_seq":250,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-06-02T22:54:23.443356+0000","last_change":"2024-06-02T22:54:23.443426+0000","last_active":"2024-06-02T22:54:23.443356+0000","last_peered":"2024-06-02T22:54:23.443356+0000","last_clean":"2024-06-02T22:54:23.443356+0000","last_became_active":"2024-06-02T22:51:52.910334+0000","last_became_peered":"2024-06-02T22:51:52.910334+0000","last_unstale":"2024-06-02T22:54:23.443356+0000","last_undegraded":"2024-06-02T22:54:23.443356+0000","last_fullsized":"2024-06-02T22:54:23.443356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'119","last_scrub_stamp":"2024-06-02T22:54:23.443253+0000","last_deep_scrub":"57'119","last_deep_scrub_stamp":"2024-06-02T22:54:23.443253+0000","last_clean_scrub_stamp":"2024-06-02T22:54:23.443253+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:37:32.869631+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1286144,"data_stored":900970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":310602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1286144,"data_stored":900970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:54:43.069 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-06-02T22:54:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.167+0000 7f304c9e7640 1 Processor -- start 2024-06-02T22:54:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.167+0000 7f304c9e7640 1 -- start start 2024-06-02T22:54:43.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.168+0000 7f304c9e7640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3048155320 0x7f30480b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.168+0000 7f304c9e7640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3048155700 con 0x7f30480d0800 2024-06-02T22:54:43.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.168+0000 7f304c9e7640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f304815b6b0 con 0x7f30480b34e0 2024-06-02T22:54:43.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.168+0000 7f304c9e7640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 -- 0x7f304815b990 con 0x7f3048155320 2024-06-02T22:54:43.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.168+0000 7f3046d9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f30480d0800 0x7f304806e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33258/0 (socket says 172.21.15.82:33258) 2024-06-02T22:54:43.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.168+0000 7f3046d9d640 1 -- 172.21.15.82:0/2157005388 learned_addr learned my addr 172.21.15.82:0/2157005388 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:43.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.168+0000 7f304659c640 1 --2- 172.21.15.82:0/2157005388 >> v2:172.21.15.184:3300/0 conn(0x7f3048155320 0x7f30480b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.168+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288119949 0 0) 0x7f3048155700 con 0x7f30480d0800 2024-06-02T22:54:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3034003520 con 0x7f30480d0800 2024-06-02T22:54:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2983835066 0 0) 0x7f3034003520 con 0x7f30480d0800 2024-06-02T22:54:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 >> v2:172.21.15.184:3300/0 conn(0x7f3048155320 msgr2=0x7f30480b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 --2- 172.21.15.82:0/2157005388 >> v2:172.21.15.184:3300/0 conn(0x7f3048155320 0x7f30480b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 >> v1:172.21.15.184:6789/0 conn(0x7f30480b34e0 legacy=0x7f30480d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304815bc70 con 0x7f30480d0800 2024-06-02T22:54:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2575529210 0 0) 0x7f30400019f0 con 0x7f30480d0800 2024-06-02T22:54:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 >> v1:172.21.15.82:6789/0 conn(0x7f30480d0800 legacy=0x7f304806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 --2- 172.21.15.82:0/2157005388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30340039b0 0x7f3034003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 --2- 172.21.15.82:0/2157005388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3034004800 0x7f3034004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 --2- 172.21.15.82:0/2157005388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30340051c0 0x7f303400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f304815b990 con 0x7f30340051c0 2024-06-02T22:54:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f303400c060 con 0x7f3034004800 2024-06-02T22:54:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f303400c260 con 0x7f30340039b0 2024-06-02T22:54:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3046d9d640 1 --2- 172.21.15.82:0/2157005388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30340051c0 0x7f303400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f304659c640 1 --2- 172.21.15.82:0/2157005388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30340039b0 0x7f3034003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f303dd9b640 1 --2- 172.21.15.82:0/2157005388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3034004800 0x7f3034004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3046d9d640 1 -- 172.21.15.82:0/2157005388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30340039b0 msgr2=0x7f3034003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:43.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3046d9d640 1 --2- 172.21.15.82:0/2157005388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30340039b0 0x7f3034003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3046d9d640 1 -- 172.21.15.82:0/2157005388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3034004800 msgr2=0x7f3034004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:54:43.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3046d9d640 1 --2- 172.21.15.82:0/2157005388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3034004800 0x7f3034004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.169+0000 7f3046d9d640 1 -- 172.21.15.82:0/2157005388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3034003520 con 0x7f30340051c0 2024-06-02T22:54:43.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.170+0000 7f3046d9d640 1 -- 172.21.15.82:0/2157005388 reap_dead start 2024-06-02T22:54:43.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.170+0000 7f3046d9d640 1 --2- 172.21.15.82:0/2157005388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30340051c0 0x7f303400b9c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f304000a840 tx=0x7f3034005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0657eba4d33882 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.170+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304000a460 con 0x7f30340051c0 2024-06-02T22:54:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.170+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f304002f070 con 0x7f30340051c0 2024-06-02T22:54:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.170+0000 7f3045d9b640 1 -- 172.21.15.82:0/2157005388 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304002bcb0 con 0x7f30340051c0 2024-06-02T22:54:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.171+0000 7f304c9e7640 1 -- 172.21.15.82:0/2157005388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30340051c0 msgr2=0x7f303400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.171+0000 7f304c9e7640 1 --2- 172.21.15.82:0/2157005388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30340051c0 0x7f303400b9c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f304000a840 tx=0x7f3034005830 comp rx=0 tx=0).stop 2024-06-02T22:54:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.171+0000 7f304c9e7640 1 -- 172.21.15.82:0/2157005388 shutdown_connections 2024-06-02T22:54:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.171+0000 7f304c9e7640 1 --2- 172.21.15.82:0/2157005388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30340051c0 0x7f303400b9c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.171+0000 7f304c9e7640 1 -- 172.21.15.82:0/2157005388 >> 172.21.15.82:0/2157005388 conn(0x7f30480b1d10 msgr2=0x7f30480b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:43.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.171+0000 7f304c9e7640 1 -- 172.21.15.82:0/2157005388 shutdown_connections 2024-06-02T22:54:43.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.171+0000 7f304c9e7640 1 -- 172.21.15.82:0/2157005388 wait complete. 2024-06-02T22:54:43.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.172+0000 7f304c9e7640 1 Processor -- start 2024-06-02T22:54:43.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.172+0000 7f304c9e7640 1 -- start start 2024-06-02T22:54:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f304c9e7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30340051c0 0x7f3048158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f304c9e7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3048155920 0x7f304814f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f304c9e7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30481514c0 0x7f3048151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f304c9e7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f304815b470 con 0x7f30481514c0 2024-06-02T22:54:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f304c9e7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f304815b2f0 con 0x7f3048155920 2024-06-02T22:54:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f304c9e7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7f30480b2fa0 con 0x7f30340051c0 2024-06-02T22:54:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f3046d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30481514c0 0x7f3048151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f3046d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30481514c0 0x7f3048151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37054/0 (socket says 172.21.15.82:37054) 2024-06-02T22:54:43.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f3046d9d640 1 -- 172.21.15.82:0/3431009184 learned_addr learned my addr 172.21.15.82:0/3431009184 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:43.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f303dd9b640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3048155920 0x7f304814f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f304659c640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30340051c0 0x7f3048158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f3046d9d640 1 -- 172.21.15.82:0/3431009184 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30340051c0 msgr2=0x7f3048158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f3046d9d640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30340051c0 0x7f3048158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f3046d9d640 1 -- 172.21.15.82:0/3431009184 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3048155920 msgr2=0x7f304814f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f3046d9d640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3048155920 0x7f304814f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f3046d9d640 1 -- 172.21.15.82:0/3431009184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3048155e50 con 0x7f30481514c0 2024-06-02T22:54:43.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.173+0000 7f304659c640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30340051c0 0x7f3048158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:43.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.174+0000 7f3046d9d640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30481514c0 0x7f3048151940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f304000a960 tx=0x7f304815b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:43.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.174+0000 7f303f7fe640 1 -- 172.21.15.82:0/3431009184 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304002bc60 con 0x7f30481514c0 2024-06-02T22:54:43.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.174+0000 7f303f7fe640 1 -- 172.21.15.82:0/3431009184 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f304002be00 con 0x7f30481514c0 2024-06-02T22:54:43.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.174+0000 7f304c9e7640 1 -- 172.21.15.82:0/3431009184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3048156130 con 0x7f30481514c0 2024-06-02T22:54:43.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.174+0000 7f303f7fe640 1 -- 172.21.15.82:0/3431009184 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040034670 con 0x7f30481514c0 2024-06-02T22:54:43.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.174+0000 7f304c9e7640 1 -- 172.21.15.82:0/3431009184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30481566f0 con 0x7f30481514c0 2024-06-02T22:54:43.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.175+0000 7f304c9e7640 1 -- 172.21.15.82:0/3431009184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30480d0620 con 0x7f30481514c0 2024-06-02T22:54:43.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.175+0000 7f303f7fe640 1 -- 172.21.15.82:0/3431009184 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30400348d0 con 0x7f30481514c0 2024-06-02T22:54:43.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.176+0000 7f303f7fe640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f302806be30 0x7f302806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.176+0000 7f303f7fe640 1 -- 172.21.15.82:0/3431009184 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f30400ab130 con 0x7f30481514c0 2024-06-02T22:54:43.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.176+0000 7f304659c640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f302806be30 0x7f302806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.176+0000 7f304659c640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f302806be30 0x7f302806e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3038009b40 tx=0x7f3038008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:43.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.180+0000 7f303f7fe640 1 -- 172.21.15.82:0/3431009184 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f30480d0620 con 0x7f30481514c0 2024-06-02T22:54:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.352+0000 7f304c9e7640 1 -- 172.21.15.82:0/3431009184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f30480683c0 con 0x7f30481514c0 2024-06-02T22:54:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.355+0000 7f303f7fe640 1 -- 172.21.15.82:0/3431009184 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7f3040046060 con 0x7f30481514c0 2024-06-02T22:54:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.356+0000 7f303f7fe640 1 -- 172.21.15.82:0/3431009184 <== mon.0 v2:172.21.15.82:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f304002f0c0 con 0x7f30481514c0 2024-06-02T22:54:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 -- 172.21.15.82:0/3431009184 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f302806be30 msgr2=0x7f302806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f302806be30 0x7f302806e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3038009b40 tx=0x7f3038008040 comp rx=0 tx=0).stop 2024-06-02T22:54:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 -- 172.21.15.82:0/3431009184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30481514c0 msgr2=0x7f3048151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30481514c0 0x7f3048151940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f304000a960 tx=0x7f304815b880 comp rx=0 tx=0).stop 2024-06-02T22:54:43.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 -- 172.21.15.82:0/3431009184 shutdown_connections 2024-06-02T22:54:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7f302806be30 0x7f302806e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30481514c0 0x7f3048151940 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3048155920 0x7f304814f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 --2- 172.21.15.82:0/3431009184 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30340051c0 0x7f3048158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 -- 172.21.15.82:0/3431009184 >> 172.21.15.82:0/3431009184 conn(0x7f30480b1d10 msgr2=0x7f30480b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 -- 172.21.15.82:0/3431009184 shutdown_connections 2024-06-02T22:54:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.358+0000 7f304c9e7640 1 -- 172.21.15.82:0/3431009184 wait complete. 2024-06-02T22:54:43.369 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T22:54:43.369 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T22:54:43.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.468+0000 7fe09885d640 1 Processor -- start 2024-06-02T22:54:43.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.468+0000 7fe09885d640 1 -- start start 2024-06-02T22:54:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.469+0000 7fe09885d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe094072370 0x7fe094166c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.469+0000 7fe09885d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe094072820 con 0x7fe0940cc6d0 2024-06-02T22:54:43.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.469+0000 7fe09885d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe094072b00 con 0x7fe0940b46d0 2024-06-02T22:54:43.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.469+0000 7fe09885d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe094072de0 con 0x7fe094072370 2024-06-02T22:54:43.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.469+0000 7fe09259c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe0940cc6d0 0x7fe0940ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33272/0 (socket says 172.21.15.82:33272) 2024-06-02T22:54:43.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.469+0000 7fe09259c640 1 -- 172.21.15.82:0/97502168 learned_addr learned my addr 172.21.15.82:0/97502168 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-06-02T22:54:43.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.469+0000 7fe092d9d640 1 --2- 172.21.15.82:0/97502168 >> v2:172.21.15.82:3300/0 conn(0x7fe094072370 0x7fe094166c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.470+0000 7fe09159a640 1 -- 172.21.15.82:0/97502168 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321599723 0 0) 0x7fe094072820 con 0x7fe0940cc6d0 2024-06-02T22:54:43.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.470+0000 7fe09159a640 1 -- 172.21.15.82:0/97502168 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe080003520 con 0x7fe0940cc6d0 2024-06-02T22:54:43.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.470+0000 7fe092d9d640 1 -- 172.21.15.82:0/97502168 >> v1:172.21.15.184:6789/0 conn(0x7fe0940b46d0 legacy=0x7fe094071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.470+0000 7fe092d9d640 1 -- 172.21.15.82:0/97502168 >> v1:172.21.15.82:6789/0 conn(0x7fe0940cc6d0 legacy=0x7fe0940ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.470+0000 7fe092d9d640 1 -- 172.21.15.82:0/97502168 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0940b31a0 con 0x7fe094072370 2024-06-02T22:54:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.470+0000 7fe092d9d640 1 --2- 172.21.15.82:0/97502168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094072370 0x7fe094166c40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe0840097a0 tx=0x7fe08402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be888a5bf247e339 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.470+0000 7fe09159a640 1 -- 172.21.15.82:0/97502168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084037070 con 0x7fe094072370 2024-06-02T22:54:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.471+0000 7fe09159a640 1 -- 172.21.15.82:0/97502168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe084032440 con 0x7fe094072370 2024-06-02T22:54:43.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.471+0000 7fe09159a640 1 -- 172.21.15.82:0/97502168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084032830 con 0x7fe094072370 2024-06-02T22:54:43.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.471+0000 7fe09885d640 1 -- 172.21.15.82:0/97502168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094072370 msgr2=0x7fe094166c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.471+0000 7fe09885d640 1 --2- 172.21.15.82:0/97502168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094072370 0x7fe094166c40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe0840097a0 tx=0x7fe08402a230 comp rx=0 tx=0).stop 2024-06-02T22:54:43.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.471+0000 7fe09885d640 1 -- 172.21.15.82:0/97502168 shutdown_connections 2024-06-02T22:54:43.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.471+0000 7fe09885d640 1 --2- 172.21.15.82:0/97502168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe094072370 0x7fe094166c40 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.471+0000 7fe09885d640 1 -- 172.21.15.82:0/97502168 >> 172.21.15.82:0/97502168 conn(0x7fe0940b19f0 msgr2=0x7fe0940b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:43.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.471+0000 7fe09885d640 1 -- 172.21.15.82:0/97502168 shutdown_connections 2024-06-02T22:54:43.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.471+0000 7fe09885d640 1 -- 172.21.15.82:0/97502168 wait complete. 2024-06-02T22:54:43.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.472+0000 7fe09885d640 1 Processor -- start 2024-06-02T22:54:43.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.472+0000 7fe09885d640 1 -- start start 2024-06-02T22:54:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.473+0000 7fe09885d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe094072370 0x7fe09409db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.473+0000 7fe09885d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0940b46d0 0x7fe0940cf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.473+0000 7fe09885d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0940cc6d0 0x7fe09415b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.473+0000 7fe09885d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe094167180 con 0x7fe0940cc6d0 2024-06-02T22:54:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.473+0000 7fe09885d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe094159f60 con 0x7fe0940b46d0 2024-06-02T22:54:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.473+0000 7fe09885d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 -- 0x7fe094167300 con 0x7fe094072370 2024-06-02T22:54:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.473+0000 7fe092d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0940cc6d0 0x7fe09415b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.473+0000 7fe092d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0940cc6d0 0x7fe09415b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37074/0 (socket says 172.21.15.82:37074) 2024-06-02T22:54:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.473+0000 7fe092d9d640 1 -- 172.21.15.82:0/3200725144 learned_addr learned my addr 172.21.15.82:0/3200725144 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-02T22:54:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe091d9b640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0940b46d0 0x7fe0940cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe09259c640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe094072370 0x7fe09409db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe092d9d640 1 -- 172.21.15.82:0/3200725144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe094072370 msgr2=0x7fe09409db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe092d9d640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe094072370 0x7fe09409db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe092d9d640 1 -- 172.21.15.82:0/3200725144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0940b46d0 msgr2=0x7fe0940cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe092d9d640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0940b46d0 0x7fe0940cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe092d9d640 1 -- 172.21.15.82:0/3200725144 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe094154100 con 0x7fe0940cc6d0 2024-06-02T22:54:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe091d9b640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0940b46d0 0x7fe0940cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:54:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe092d9d640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0940cc6d0 0x7fe09415b3a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe0840098c0 tx=0x7fe0840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe08affd640 1 -- 172.21.15.82:0/3200725144 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084037040 con 0x7fe0940cc6d0 2024-06-02T22:54:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe08affd640 1 -- 172.21.15.82:0/3200725144 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe084042070 con 0x7fe0940cc6d0 2024-06-02T22:54:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe09885d640 1 -- 172.21.15.82:0/3200725144 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0941543e0 con 0x7fe0940cc6d0 2024-06-02T22:54:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe08affd640 1 -- 172.21.15.82:0/3200725144 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084030940 con 0x7fe0940cc6d0 2024-06-02T22:54:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.474+0000 7fe09885d640 1 -- 172.21.15.82:0/3200725144 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0941549a0 con 0x7fe0940cc6d0 2024-06-02T22:54:43.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.475+0000 7fe09885d640 1 -- 172.21.15.82:0/3200725144 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe094068430 con 0x7fe0940cc6d0 2024-06-02T22:54:43.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.475+0000 7fe08affd640 1 -- 172.21.15.82:0/3200725144 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe084030ae0 con 0x7fe0940cc6d0 2024-06-02T22:54:43.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.476+0000 7fe08affd640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe07406be30 0x7fe07406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:43.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.476+0000 7fe08affd640 1 -- 172.21.15.82:0/3200725144 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fe0840ab770 con 0x7fe0940cc6d0 2024-06-02T22:54:43.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.476+0000 7fe09259c640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe07406be30 0x7fe07406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:43.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.476+0000 7fe09259c640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe07406be30 0x7fe07406e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe08c001560 tx=0x7fe08c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:43.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.480+0000 7fe08affd640 1 -- 172.21.15.82:0/3200725144 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe084045360 con 0x7fe0940cc6d0 2024-06-02T22:54:43.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.687+0000 7fe09885d640 1 -- 172.21.15.82:0/3200725144 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe094068ad0 con 0x7fe0940cc6d0 2024-06-02T22:54:43.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.688+0000 7fe08affd640 1 -- 172.21.15.82:0/3200725144 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+3875 (secure 0 0 0) 0x7fe08407a200 con 0x7fe0940cc6d0 2024-06-02T22:54:43.688 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-02T22:54:43.689 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6834/2836777878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":2836777878},{"type":"v1","addr":"172.21.15.184:6834","nonce":2836777878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1408890584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":1408890584},{"type":"v1","addr":"172.21.15.184:6835","nonce":1408890584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3064310162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3064310162},{"type":"v1","addr":"172.21.15.82:6835","nonce":3064310162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3170592460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3170592460},{"type":"v1","addr":"172.21.15.82:6837","nonce":3170592460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[]} 2024-06-02T22:54:43.689 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2024-06-02T22:54:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 -- 172.21.15.82:0/3200725144 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe07406be30 msgr2=0x7fe07406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe07406be30 0x7fe07406e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe08c001560 tx=0x7fe08c009040 comp rx=0 tx=0).stop 2024-06-02T22:54:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 -- 172.21.15.82:0/3200725144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0940cc6d0 msgr2=0x7fe09415b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0940cc6d0 0x7fe09415b3a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe0840098c0 tx=0x7fe0840046c0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 -- 172.21.15.82:0/3200725144 shutdown_connections 2024-06-02T22:54:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.82:6832/2392286815,v1:172.21.15.82:6833/2392286815] conn(0x7fe07406be30 0x7fe07406e2f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0940cc6d0 0x7fe09415b3a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0940b46d0 0x7fe0940cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 --2- 172.21.15.82:0/3200725144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe094072370 0x7fe09409db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 -- 172.21.15.82:0/3200725144 >> 172.21.15.82:0/3200725144 conn(0x7fe0940b19f0 msgr2=0x7fe09415ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 -- 172.21.15.82:0/3200725144 shutdown_connections 2024-06-02T22:54:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-02T22:54:43.690+0000 7fe09885d640 1 -- 172.21.15.82:0/3200725144 wait complete. 2024-06-02T22:54:43.701 DEBUG:tasks.cephfs.filesystem:already dead... 2024-06-02T22:54:43.701 INFO:teuthology.misc:Shutting down mds daemons... 2024-06-02T22:54:43.702 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-02T22:54:43.702 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:43.711 INFO:tasks.ceph.mds.a:Stopped 2024-06-02T22:54:43.711 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-02T22:54:43.711 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:43.760 INFO:tasks.ceph.mds.c:Stopped 2024-06-02T22:54:43.760 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-02T22:54:43.761 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:43.772 INFO:tasks.ceph.mds.b:Stopped 2024-06-02T22:54:43.773 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-02T22:54:43.773 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:43.825 INFO:tasks.ceph.mds.d:Stopped 2024-06-02T22:54:43.825 INFO:teuthology.misc:Shutting down osd daemons... 2024-06-02T22:54:43.825 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-06-02T22:54:43.825 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:43.858 INFO:tasks.ceph.osd.0:Stopped 2024-06-02T22:54:43.859 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-06-02T22:54:43.859 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:43.922 INFO:tasks.ceph.osd.1:Stopped 2024-06-02T22:54:43.922 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-06-02T22:54:43.922 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:43.989 INFO:tasks.ceph.osd.2:Stopped 2024-06-02T22:54:43.990 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-06-02T22:54:43.990 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:44.056 INFO:tasks.ceph.osd.3:Stopped 2024-06-02T22:54:44.057 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-06-02T22:54:44.057 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:44.091 INFO:tasks.ceph.osd.4:Stopped 2024-06-02T22:54:44.091 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-06-02T22:54:44.091 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:44.164 INFO:tasks.ceph.osd.5:Stopped 2024-06-02T22:54:44.165 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-06-02T22:54:44.165 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:44.231 INFO:tasks.ceph.osd.6:Stopped 2024-06-02T22:54:44.232 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-06-02T22:54:44.232 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:44.300 INFO:tasks.ceph.osd.7:Stopped 2024-06-02T22:54:44.300 INFO:teuthology.misc:Shutting down mgr daemons... 2024-06-02T22:54:44.301 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-06-02T22:54:44.301 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:44.327 INFO:tasks.ceph.mgr.y:Stopped 2024-06-02T22:54:44.327 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-06-02T22:54:44.327 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:44.368 INFO:tasks.ceph.mgr.x:Stopped 2024-06-02T22:54:44.369 INFO:teuthology.misc:Shutting down mon daemons... 2024-06-02T22:54:44.369 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-06-02T22:54:44.369 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:44.380 INFO:tasks.ceph.mon.a:Stopped 2024-06-02T22:54:44.380 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-06-02T22:54:44.380 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:44.421 INFO:tasks.ceph.mon.b:Stopped 2024-06-02T22:54:44.422 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-06-02T22:54:44.422 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:54:44.474 INFO:tasks.ceph.mon.c:Stopped 2024-06-02T22:54:44.474 INFO:tasks.ceph:Checking cluster log for badness... 2024-06-02T22:54:44.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-06-02T22:54:44.511 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:54:44.511 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-06-02T22:54:44.720 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:54:44.721 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-06-02T22:54:44.829 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:54:44.829 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-06-02T22:54:44.888 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:54:44.889 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-06-02T22:54:44.947 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:54:44.947 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-06-02T22:54:45.078 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:54:45.079 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-06-02T22:54:45.192 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:54:45.193 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-06-02T22:54:45.249 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:54:45.250 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-06-02T22:54:45.308 INFO:tasks.ceph:Archiving mon data... 2024-06-02T22:54:45.310 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633/data/mon.a.tgz 2024-06-02T22:54:45.310 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-06-02T22:54:45.326 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.3fCtGByAke 2024-06-02T22:54:45.326 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.3fCtGByAke 2024-06-02T22:54:45.469 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.3fCtGByAke 2024-06-02T22:54:45.552 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.3fCtGByAke is 339KB 2024-06-02T22:54:45.620 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.3fCtGByAke 2024-06-02T22:54:45.635 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633/data/mon.b.tgz 2024-06-02T22:54:45.635 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-06-02T22:54:45.654 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.NaeeoojXv7 2024-06-02T22:54:45.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.NaeeoojXv7 2024-06-02T22:54:45.819 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.NaeeoojXv7 2024-06-02T22:54:45.904 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.NaeeoojXv7 is 453KB 2024-06-02T22:54:46.002 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.NaeeoojXv7 2024-06-02T22:54:46.017 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633/data/mon.c.tgz 2024-06-02T22:54:46.018 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-06-02T22:54:46.072 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.aySNwlQ6Wl 2024-06-02T22:54:46.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.aySNwlQ6Wl 2024-06-02T22:54:46.219 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.aySNwlQ6Wl 2024-06-02T22:54:46.302 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.aySNwlQ6Wl is 453KB 2024-06-02T22:54:46.370 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.aySNwlQ6Wl 2024-06-02T22:54:46.385 INFO:tasks.ceph:Cleaning ceph cluster... 2024-06-02T22:54:46.385 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-02T22:54:46.387 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-02T22:54:46.469 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-02T22:54:46.504 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-02T22:54:46.505 INFO:tasks.ceph:Archiving crash dumps... 2024-06-02T22:54:46.506 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633/remote/smithi082/crash 2024-06-02T22:54:46.507 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-02T22:54:46.536 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633/remote/smithi184/crash 2024-06-02T22:54:46.537 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-02T22:54:46.568 INFO:tasks.ceph:Shutting down logrotate 2024-06-02T22:54:46.568 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:54:46.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T22:54:46.655 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-06-02T22:54:46.680 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-06-02T22:54:46.704 INFO:tasks.ceph:Compressing logs... 2024-06-02T22:54:46.704 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-02T22:54:46.723 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-02T22:54:46.745 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49814.log 2024-06-02T22:54:46.745 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51075.log 2024-06-02T22:54:46.779 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37591.log 2024-06-02T22:54:46.779 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37882.log 2024-06-02T22:54:46.780 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37715.log 2024-06-02T22:54:46.780 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37591.log: /var/log/ceph/ceph-client.admin.37882.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-02T22:54:46.780 INFO:teuthology.orchestra.run.smithi184.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37591.log.gz 2024-06-02T22:54:46.780 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37715.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37882.log.gz -5 2024-06-02T22:54:46.780 INFO:teuthology.orchestra.run.smithi184.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-06-02T22:54:46.780 INFO:teuthology.orchestra.run.smithi184.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37715.log.gz 2024-06-02T22:54:46.780 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-06-02T22:54:46.780 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-06-02T22:54:46.781 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-06-02T22:54:46.781 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-06-02T22:54:46.781 INFO:teuthology.orchestra.run.smithi184.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-02T22:54:46.781 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37802.log 2024-06-02T22:54:46.781 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37762.log 2024-06-02T22:54:46.781 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37802.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-06-02T22:54:46.781 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37762.log: 87.2% 93.8% -- replaced with /var/log/ceph/ceph-client.admin.37802.log.gz 2024-06-02T22:54:46.781 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-02T22:54:46.781 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-06-02T22:54:46.782 INFO:teuthology.orchestra.run.smithi184.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37762.log.gz 2024-06-02T22:54:46.782 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-06-02T22:54:46.782 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44099.log 2024-06-02T22:54:46.782 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37671.log 2024-06-02T22:54:46.782 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.3.44099.log: 87.2% -- replaced with /var/log/ceph/ceph-client.3.44099.log.gz 2024-06-02T22:54:46.782 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43661.log 2024-06-02T22:54:46.782 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37671.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37671.log.gz 2024-06-02T22:54:46.782 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37631.log 2024-06-02T22:54:46.783 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.43661.log: 87.6% -- replaced with /var/log/ceph/ceph-client.1.43661.log.gz 2024-06-02T22:54:46.783 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-06-02T22:54:46.783 INFO:teuthology.orchestra.run.smithi184.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-06-02T22:54:46.783 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37631.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37631.log.gz 2024-06-02T22:54:46.783 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-06-02T22:54:46.785 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37842.log 2024-06-02T22:54:46.786 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.b.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-06-02T22:54:46.786 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37842.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37842.log.gz 2024-06-02T22:54:46.805 INFO:teuthology.orchestra.run.smithi184.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-06-02T22:54:46.856 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57723.log 2024-06-02T22:54:46.856 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49814.log: /var/log/ceph/ceph-client.admin.51075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48823.log 2024-06-02T22:54:46.856 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49814.log.gz 2024-06-02T22:54:46.856 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6%/var/log/ceph/ceph-client.admin.57723.log: -- replaced with /var/log/ceph/ceph-client.admin.51075.log.gz 2024-06-02T22:54:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54357.log 2024-06-02T22:54:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48823.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57723.log.gz 2024-06-02T22:54:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56614.log 2024-06-02T22:54:46.857 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48823.log.gz 2024-06-02T22:54:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43398.log 2024-06-02T22:54:46.857 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54357.log.gz 2024-06-02T22:54:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47937.log 2024-06-02T22:54:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56614.log: /var/log/ceph/ceph-client.admin.43398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56698.log 2024-06-02T22:54:46.858 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56614.log.gz 2024-06-02T22:54:46.858 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43398.log.gz 2024-06-02T22:54:46.858 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58119.log 2024-06-02T22:54:46.858 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47937.log: /var/log/ceph/ceph-client.admin.56698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55226.log 2024-06-02T22:54:46.858 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47937.log.gz 2024-06-02T22:54:46.858 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58119.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56698.log.gz 2024-06-02T22:54:46.858 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50550.log 2024-06-02T22:54:46.858 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58119.log.gz 2024-06-02T22:54:46.859 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57596.log 2024-06-02T22:54:46.859 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55226.log.gz 2024-06-02T22:54:46.859 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54273.log 2024-06-02T22:54:46.859 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57975.log 2024-06-02T22:54:46.859 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50550.log.gz 2024-06-02T22:54:46.859 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57596.log.gz 2024-06-02T22:54:46.859 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57011.log 2024-06-02T22:54:46.859 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54273.log.gz 2024-06-02T22:54:46.860 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46696.log 2024-06-02T22:54:46.860 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57011.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57975.log.gz 2024-06-02T22:54:46.860 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45172.log 2024-06-02T22:54:46.860 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57011.log.gz 2024-06-02T22:54:46.860 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49117.log 2024-06-02T22:54:46.860 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51203.log 2024-06-02T22:54:46.860 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46696.log.gz 2024-06-02T22:54:46.860 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48436.log 2024-06-02T22:54:46.860 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45172.log.gz 2024-06-02T22:54:46.861 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51203.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49117.log.gz 2024-06-02T22:54:46.861 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-02T22:54:46.861 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51203.log.gz 2024-06-02T22:54:46.861 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48341.log 2024-06-02T22:54:46.861 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.48436.log.gz 2024-06-02T22:54:46.861 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2024-06-02T22:54:46.861 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44159.log 2024-06-02T22:54:46.861 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48341.log.gz 2024-06-02T22:54:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44033.log 2024-06-02T22:54:46.862 INFO:teuthology.orchestra.run.smithi082.stderr: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-02T22:54:46.862 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz/var/log/ceph/ceph-client.admin.44159.log: 2024-06-02T22:54:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45046.log 2024-06-02T22:54:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44033.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44159.log.gz 2024-06-02T22:54:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48173.log 2024-06-02T22:54:46.862 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44033.log.gz 2024-06-02T22:54:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54483.log 2024-06-02T22:54:46.863 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45046.log.gz 2024-06-02T22:54:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49346.log 2024-06-02T22:54:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45608.log 2024-06-02T22:54:46.863 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48173.log.gz 2024-06-02T22:54:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46654.log 2024-06-02T22:54:46.863 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54483.log.gz 2024-06-02T22:54:46.863 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49346.log.gz 2024-06-02T22:54:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45608.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-06-02T22:54:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46654.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45608.log.gz 2024-06-02T22:54:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45614.log 2024-06-02T22:54:46.864 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46654.log.gz 2024-06-02T22:54:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57849.log 2024-06-02T22:54:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52931.log 2024-06-02T22:54:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57849.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45614.log.gz 2024-06-02T22:54:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56209.log 2024-06-02T22:54:46.864 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57849.log.gz 2024-06-02T22:54:46.865 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48131.log 2024-06-02T22:54:46.865 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52931.log.gz 2024-06-02T22:54:46.865 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.56209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56927.log 2024-06-02T22:54:46.865 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46780.log 2024-06-02T22:54:46.865 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48131.log.gz 2024-06-02T22:54:46.865 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45393.log 2024-06-02T22:54:46.865 INFO:teuthology.orchestra.run.smithi082.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56927.log.gz 2024-06-02T22:54:46.865 INFO:teuthology.orchestra.run.smithi082.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.0.56209.log.gz 2024-06-02T22:54:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43949.log 2024-06-02T22:54:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46780.log: /var/log/ceph/ceph-client.admin.45393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49900.log 2024-06-02T22:54:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43949.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.46780.log.gz 2024-06-02T22:54:46.866 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45393.log.gz 2024-06-02T22:54:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57891.log 2024-06-02T22:54:46.866 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43949.log.gz 2024-06-02T22:54:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57554.log 2024-06-02T22:54:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57891.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49900.log.gz 2024-06-02T22:54:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57639.log 2024-06-02T22:54:46.867 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57891.log.gz 2024-06-02T22:54:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45004.log 2024-06-02T22:54:46.867 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57554.log.gz 2024-06-02T22:54:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57639.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-02T22:54:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45004.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57639.log.gz 2024-06-02T22:54:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56572.log 2024-06-02T22:54:46.867 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45004.log.gz 2024-06-02T22:54:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54101.log 2024-06-02T22:54:46.867 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45351.log 2024-06-02T22:54:46.868 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56572.log.gz 2024-06-02T22:54:46.868 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2024-06-02T22:54:46.868 INFO:teuthology.orchestra.run.smithi082.stderr:gzip 88.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.54101.log.gz -- 2024-06-02T22:54:46.868 INFO:teuthology.orchestra.run.smithi082.stderr: /var/log/ceph/ceph-client.admin.49944.log 2024-06-02T22:54:46.868 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45351.log: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-02T22:54:46.868 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46738.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45351.log.gz 2024-06-02T22:54:46.868 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49507.log 2024-06-02T22:54:46.868 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2024-06-02T22:54:46.869 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58201.log 2024-06-02T22:54:46.869 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49944.log: /var/log/ceph/ceph-client.admin.49507.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49944.log.gz 2024-06-02T22:54:46.869 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57681.log 2024-06-02T22:54:46.869 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49507.log.gz 2024-06-02T22:54:46.869 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52583.log 2024-06-02T22:54:46.869 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57681.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58201.log.gz 2024-06-02T22:54:46.869 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44267.log 2024-06-02T22:54:46.869 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45616.log 2024-06-02T22:54:46.869 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57681.log.gz 2024-06-02T22:54:46.870 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52583.log.gz 2024-06-02T22:54:46.870 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49772.log 2024-06-02T22:54:46.870 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45616.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.44267.log.gz 2024-06-02T22:54:46.870 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45945.log 2024-06-02T22:54:46.870 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49772.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45616.log.gz 2024-06-02T22:54:46.870 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54525.log 2024-06-02T22:54:46.870 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49772.log.gz 2024-06-02T22:54:46.870 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46570.log 2024-06-02T22:54:46.871 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45945.log.gz 2024-06-02T22:54:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48865.log 2024-06-02T22:54:46.871 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54525.log.gz 2024-06-02T22:54:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50322.log 2024-06-02T22:54:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48865.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46570.log.gz 2024-06-02T22:54:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-06-02T22:54:46.871 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48865.log.gz 2024-06-02T22:54:46.871 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54935.log 2024-06-02T22:54:46.872 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50322.log.gz 2024-06-02T22:54:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55563.log 2024-06-02T22:54:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.54935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53351.log 2024-06-02T22:54:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.55563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49645.log 2024-06-02T22:54:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37708.log 2024-06-02T22:54:46.872 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5%/var/log/ceph/ceph-client.admin.49645.log: -- replaced with /var/log/ceph/ceph-client.admin.53351.log.gz 2024-06-02T22:54:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48949.log 2024-06-02T22:54:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37708.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49645.log.gz 2024-06-02T22:54:46.873 INFO:teuthology.orchestra.run.smithi082.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54935.log.gz 2024-06-02T22:54:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 89.5% -- replaced with /var/log/ceph/ceph-client.0.55563.log.gz 2024-06-02T22:54:46.873 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49856.log 2024-06-02T22:54:46.873 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37708.log.gz 2024-06-02T22:54:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52075.log 2024-06-02T22:54:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49856.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48949.log.gz 2024-06-02T22:54:46.873 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57291.log 2024-06-02T22:54:46.873 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49856.log.gz 2024-06-02T22:54:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49986.log 2024-06-02T22:54:46.874 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52075.log.gz 2024-06-02T22:54:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57765.log 2024-06-02T22:54:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57291.log: /var/log/ceph/ceph-client.admin.49986.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57291.log.gz 2024-06-02T22:54:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57418.log 2024-06-02T22:54:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-06-02T22:54:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57765.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49986.log.gz 2024-06-02T22:54:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46285.log 88.1% 2024-06-02T22:54:46.874 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57765.log.gz 2024-06-02T22:54:46.875 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57418.log.gz 2024-06-02T22:54:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51998.log 2024-06-02T22:54:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.46285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46289.log 2024-06-02T22:54:46.875 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46285.log.gz 2024-06-02T22:54:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49550.log 2024-06-02T22:54:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46289.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51998.log.gz 2024-06-02T22:54:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43907.log 2024-06-02T22:54:46.875 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46289.log.gz 2024-06-02T22:54:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49550.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-06-02T22:54:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43907.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.49550.log.gz --verbose 2024-06-02T22:54:46.876 INFO:teuthology.orchestra.run.smithi082.stderr: -- /var/log/ceph/ceph-client.admin.53183.log 2024-06-02T22:54:46.876 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43907.log.gz 2024-06-02T22:54:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-06-02T22:54:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53922.log 2024-06-02T22:54:46.876 INFO:teuthology.orchestra.run.smithi082.stderr: 87.3%/var/log/ceph/ceph-mgr.y.log: -- replaced with /var/log/ceph/ceph-client.admin.53183.log.gz 2024-06-02T22:54:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37341.log 2024-06-02T22:54:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58059.log 2024-06-02T22:54:46.877 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6%/var/log/ceph/ceph-client.admin.37341.log: -- replaced with /var/log/ceph/ceph-client.admin.53922.log.gz 2024-06-02T22:54:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45949.log 2024-06-02T22:54:46.877 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37341.log.gz 2024-06-02T22:54:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49426.log 2024-06-02T22:54:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58059.log: /var/log/ceph/ceph-client.admin.45949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48215.log 2024-06-02T22:54:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49426.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45949.log.gz 2024-06-02T22:54:46.877 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58059.log.gz 2024-06-02T22:54:46.877 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49426.log.gz 2024-06-02T22:54:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54059.log 2024-06-02T22:54:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48215.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-06-02T22:54:46.878 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0%/var/log/ceph/ceph-client.admin.54059.log: -- replaced with /var/log/ceph/ceph-client.admin.48215.log.gz 2024-06-02T22:54:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46282.log 2024-06-02T22:54:46.878 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54059.log.gz 2024-06-02T22:54:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45617.log 2024-06-02T22:54:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.46282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56740.log 2024-06-02T22:54:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45617.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46282.log.gz 2024-06-02T22:54:46.879 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45617.log.gz 2024-06-02T22:54:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55949.log 2024-06-02T22:54:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48991.log 2024-06-02T22:54:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55949.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56740.log.gz 2024-06-02T22:54:46.879 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55949.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54017.log 2024-06-02T22:54:46.879 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-06-02T22:54:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44075.log 2024-06-02T22:54:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54017.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48991.log.gz 2024-06-02T22:54:46.879 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54017.log.gz 2024-06-02T22:54:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43306.log 2024-06-02T22:54:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54441.log 2024-06-02T22:54:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43306.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44075.log.gz 2024-06-02T22:54:46.880 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43306.log.gz 2024-06-02T22:54:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46528.log 2024-06-02T22:54:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56824.log 2024-06-02T22:54:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46528.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54441.log.gz 2024-06-02T22:54:46.880 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46528.log.gz 2024-06-02T22:54:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46150.log 2024-06-02T22:54:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54147.log 2024-06-02T22:54:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46150.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56824.log.gz 2024-06-02T22:54:46.881 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46150.log.gz 2024-06-02T22:54:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52889.log 2024-06-02T22:54:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54147.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54147.log.gz 2024-06-02T22:54:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53015.log 2024-06-02T22:54:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52973.log 2024-06-02T22:54:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53015.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52889.log.gz 2024-06-02T22:54:46.882 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47979.log 2024-06-02T22:54:46.882 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53015.log.gz 2024-06-02T22:54:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43576.log 2024-06-02T22:54:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47979.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52973.log.gz 2024-06-02T22:54:46.882 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47979.log.gz 2024-06-02T22:54:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54399.log 2024-06-02T22:54:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56969.log 2024-06-02T22:54:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54399.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43576.log.gz 2024-06-02T22:54:46.883 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54399.log.gzgzip 2024-06-02T22:54:46.883 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53099.log 2024-06-02T22:54:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57053.log 2024-06-02T22:54:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53099.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56969.log.gz 2024-06-02T22:54:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49219.log 2024-06-02T22:54:46.883 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53099.log.gz 2024-06-02T22:54:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45436.log 2024-06-02T22:54:46.883 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57053.log.gz/var/log/ceph/ceph-client.admin.49219.log: 2024-06-02T22:54:46.884 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49219.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48746.log 2024-06-02T22:54:46.884 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-06-02T22:54:46.884 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48907.log 2024-06-02T22:54:46.884 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48746.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45436.log.gz 2024-06-02T22:54:46.884 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48746.log.gz 2024-06-02T22:54:46.884 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45611.log 2024-06-02T22:54:46.884 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48907.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31313.log 2024-06-02T22:54:46.884 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45611.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48907.log.gz 2024-06-02T22:54:46.885 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45611.log.gz 2024-06-02T22:54:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-06-02T22:54:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.tmp-client.admin.31313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53267.log 2024-06-02T22:54:46.885 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31313.log.gz 2024-06-02T22:54:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51161.log 2024-06-02T22:54:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53267.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53267.log.gz 2024-06-02T22:54:46.885 INFO:teuthology.orchestra.run.smithi082.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-06-02T22:54:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45612.log 2024-06-02T22:54:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45937.log 2024-06-02T22:54:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45612.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51161.log.gz 2024-06-02T22:54:46.886 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45612.log.gz 2024-06-02T22:54:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50112.log 2024-06-02T22:54:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48494.log 2024-06-02T22:54:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50112.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45937.log.gz 2024-06-02T22:54:46.886 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50112.log.gz 2024-06-02T22:54:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53966.log 2024-06-02T22:54:46.887 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53057.log 2024-06-02T22:54:46.887 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53966.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48494.log.gz 2024-06-02T22:54:46.887 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53966.log.gz 2024-06-02T22:54:46.887 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43618.log 2024-06-02T22:54:46.887 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49600.log 2024-06-02T22:54:46.887 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43618.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53057.log.gz 2024-06-02T22:54:46.887 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43618.log.gz 2024-06-02T22:54:46.887 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54231.log 2024-06-02T22:54:46.888 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43494.log 2024-06-02T22:54:46.888 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54231.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49600.log.gz 2024-06-02T22:54:46.888 INFO:teuthology.orchestra.run.smithi082.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54231.log.gz 2024-06-02T22:54:46.888 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49730.log 2024-06-02T22:54:46.888 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53878.log 2024-06-02T22:54:46.888 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49730.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43494.log.gz 2024-06-02T22:54:46.888 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49730.log.gz 2024-06-02T22:54:46.888 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55168.log 2024-06-02T22:54:46.889 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50508.log 2024-06-02T22:54:46.889 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55168.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53878.log.gz 2024-06-02T22:54:46.889 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55168.log.gz 2024-06-02T22:54:46.889 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44117.log 2024-06-02T22:54:46.889 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53632.log 2024-06-02T22:54:46.889 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50508.log.gz 2024-06-02T22:54:46.889 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44117.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44117.log.gz 2024-06-02T22:54:46.889 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53794.log 2024-06-02T22:54:46.890 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50918.log 2024-06-02T22:54:46.890 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53632.log.gz 2024-06-02T22:54:46.890 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45618.log 2024-06-02T22:54:46.890 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.50918.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53794.log.gz 2024-06-02T22:54:46.890 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58159.log 2024-06-02T22:54:46.890 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45618.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45618.log.gz 2024-06-02T22:54:46.890 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50028.log 2024-06-02T22:54:46.890 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58159.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.50918.log.gz 2024-06-02T22:54:46.891 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58159.log.gz 2024-06-02T22:54:46.891 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37617.log 2024-06-02T22:54:46.891 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50658.log 2024-06-02T22:54:46.891 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50028.log.gz 2024-06-02T22:54:46.891 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43863.log 2024-06-02T22:54:46.891 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50658.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37617.log.gz 2024-06-02T22:54:46.891 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46287.log 2024-06-02T22:54:46.891 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50658.log.gz 2024-06-02T22:54:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:gzip/var/log/ceph/ceph-client.admin.43863.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56462.log 2024-06-02T22:54:46.892 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43863.log.gz 2024-06-02T22:54:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46287.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46287.log.gz 2024-06-02T22:54:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52377.log 2024-06-02T22:54:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45214.log 2024-06-02T22:54:46.892 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56462.log.gz 2024-06-02T22:54:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.52377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46286.log 2024-06-02T22:54:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45214.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45214.log.gz 2024-06-02T22:54:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48257.log 2024-06-02T22:54:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46286.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46286.log.gz 2024-06-02T22:54:46.893 INFO:teuthology.orchestra.run.smithi082.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52377.log.gz 2024-06-02T22:54:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50466.log 2024-06-02T22:54:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51395.log 2024-06-02T22:54:46.893 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48257.log.gz 2024-06-02T22:54:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55110.log 2024-06-02T22:54:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51395.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50466.log.gz 2024-06-02T22:54:46.893 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51395.log.gz 2024-06-02T22:54:46.894 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55303.log 2024-06-02T22:54:46.894 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5/var/log/ceph/ceph-client.admin.55110.log: --verbose -- /var/log/ceph/ceph-client.admin.43748.log 2024-06-02T22:54:46.894 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55110.log.gz 2024-06-02T22:54:46.894 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55303.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55303.log.gz 2024-06-02T22:54:46.894 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51337.log 2024-06-02T22:54:46.894 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49033.log 2024-06-02T22:54:46.894 INFO:teuthology.orchestra.run.smithi082.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43748.log.gz 2024-06-02T22:54:46.894 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51119.log 2024-06-02T22:54:46.895 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49033.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51337.log.gz 2024-06-02T22:54:46.895 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49033.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57807.log 2024-06-02T22:54:46.895 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-06-02T22:54:46.895 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49075.log 2024-06-02T22:54:46.895 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57807.log: /var/log/ceph/ceph-client.admin.51119.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51119.log.gz 2024-06-02T22:54:46.895 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57807.log.gz 2024-06-02T22:54:46.895 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48614.log 2024-06-02T22:54:46.895 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49075.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-06-02T22:54:46.895 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49075.log.gz 2024-06-02T22:54:46.896 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45607.log 2024-06-02T22:54:46.896 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50280.log 2024-06-02T22:54:46.896 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51473.log 2024-06-02T22:54:46.896 INFO:teuthology.orchestra.run.smithi082.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48614.log.gz 2024-06-02T22:54:46.896 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4%/var/log/ceph/ceph-client.admin.50280.log: -- replaced with /var/log/ceph/ceph-client.admin.45607.log.gz 2024-06-02T22:54:46.896 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50154.log 2024-06-02T22:54:46.896 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50592.log 2024-06-02T22:54:46.896 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50280.log.gz 2024-06-02T22:54:46.897 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50154.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51473.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53477.log 2024-06-02T22:54:46.897 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-06-02T22:54:46.897 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50154.log.gz 2024-06-02T22:54:46.897 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55796.log 2024-06-02T22:54:46.897 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50592.log: /var/log/ceph/ceph-client.admin.53477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50238.log 2024-06-02T22:54:46.897 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5%/var/log/ceph/ceph-client.admin.55796.log: -- replaced with /var/log/ceph/ceph-client.admin.53477.log.gz 2024-06-02T22:54:46.897 INFO:teuthology.orchestra.run.smithi082.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50592.log.gz 2024-06-02T22:54:46.897 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55796.log.gz 2024-06-02T22:54:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45257.log 2024-06-02T22:54:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:gzip/var/log/ceph/ceph-client.admin.50238.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45942.log 2024-06-02T22:54:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45257.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50238.log.gz 2024-06-02T22:54:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52117.log 2024-06-02T22:54:46.898 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45257.log.gz 2024-06-02T22:54:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46486.log 2024-06-02T22:54:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45942.log: /var/log/ceph/ceph-client.admin.52117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44678.log 2024-06-02T22:54:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46486.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45942.log.gz 2024-06-02T22:54:46.899 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52117.log.gz 2024-06-02T22:54:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46486.log.gz 2024-06-02T22:54:46.899 INFO:teuthology.orchestra.run.smithi082.stderr: -- /var/log/ceph/ceph-client.admin.45130.log 2024-06-02T22:54:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49262.log 2024-06-02T22:54:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53225.log 2024-06-02T22:54:46.899 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45130.log.gz 2024-06-02T22:54:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50364.log 2024-06-02T22:54:46.899 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9%/var/log/ceph/ceph-client.admin.53225.log: -- replaced with /var/log/ceph/ceph-client.admin.49262.log.gz 92.7% -- replaced with /var/log/ceph/ceph-client.admin.44678.log.gz 2024-06-02T22:54:46.899 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-06-02T22:54:46.900 INFO:teuthology.orchestra.run.smithi082.stderr:gzip 88.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.44927.log 2024-06-02T22:54:46.900 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53225.log.gz 2024-06-02T22:54:46.900 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54609.log 2024-06-02T22:54:46.900 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44927.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50364.log.gz 2024-06-02T22:54:46.900 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43799.log 2024-06-02T22:54:46.900 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44927.log.gz 2024-06-02T22:54:46.900 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53309.log 2024-06-02T22:54:46.900 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46288.log 2024-06-02T22:54:46.901 INFO:teuthology.orchestra.run.smithi082.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54609.log.gz 2024-06-02T22:54:46.901 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43799.log.gz 2024-06-02T22:54:46.901 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57333.log 2024-06-02T22:54:46.901 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48572.log 2024-06-02T22:54:46.901 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53309.log.gz 2024-06-02T22:54:46.901 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57333.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46288.log.gz 2024-06-02T22:54:46.901 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45952.log 2024-06-02T22:54:46.901 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57333.log.gz 2024-06-02T22:54:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54315.log 2024-06-02T22:54:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48572.log: /var/log/ceph/ceph-client.admin.45952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47299.log 2024-06-02T22:54:46.902 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48572.log.gz 2024-06-02T22:54:46.902 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2024-06-02T22:54:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54315.log: gzip -5 --verbose 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54315.log.gz 2024-06-02T22:54:46.902 INFO:teuthology.orchestra.run.smithi082.stderr: -- /var/log/ceph/ceph-client.admin.46290.log 2024-06-02T22:54:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.47299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.47815.log 2024-06-02T22:54:46.902 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57249.log 2024-06-02T22:54:46.903 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.0.47299.log.gz 2024-06-02T22:54:46.903 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46290.log.gz 2024-06-02T22:54:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.2.47815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52641.log 2024-06-02T22:54:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47421.log 2024-06-02T22:54:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52641.log: 88.9% -- replaced with /var/log/ceph/ceph-client.2.47815.log.gz 2024-06-02T22:54:46.903 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57249.log.gz 2024-06-02T22:54:46.903 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52641.log.gz 2024-06-02T22:54:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56383.log 2024-06-02T22:54:46.903 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57468.log 2024-06-02T22:54:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54675.log 2024-06-02T22:54:46.904 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47421.log.gz 2024-06-02T22:54:46.904 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4%/var/log/ceph/ceph-client.admin.57468.log: -- replaced with /var/log/ceph/ceph-client.admin.56383.log.gz 2024-06-02T22:54:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55738.log 2024-06-02T22:54:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54189.log 2024-06-02T22:54:46.904 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57468.log.gz 2024-06-02T22:54:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55738.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54675.log.gz 2024-06-02T22:54:46.904 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45950.log 2024-06-02T22:54:46.905 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55738.log.gz 2024-06-02T22:54:46.905 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43704.log 2024-06-02T22:54:46.905 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54189.log: /var/log/ceph/ceph-client.admin.45950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57510.log 2024-06-02T22:54:46.905 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54189.log.gz 2024-06-02T22:54:46.905 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45950.log.gz/var/log/ceph/ceph-client.admin.43704.log: 2024-06-02T22:54:46.905 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45953.log 2024-06-02T22:54:46.905 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57510.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43704.log.gz 2024-06-02T22:54:46.905 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43660.log 2024-06-02T22:54:46.905 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45953.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-06-02T22:54:46.906 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57510.log.gz 2024-06-02T22:54:46.906 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45953.log.gz 2024-06-02T22:54:46.906 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53836.log 2024-06-02T22:54:46.906 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43660.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50070.log 2024-06-02T22:54:46.906 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53836.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43660.log.gz 2024-06-02T22:54:46.906 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51733.log 2024-06-02T22:54:46.906 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53836.log.gz 2024-06-02T22:54:46.906 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56884.log 2024-06-02T22:54:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.51733.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50070.log.gz 2024-06-02T22:54:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51279.log 2024-06-02T22:54:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56884.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56884.log.gz 2024-06-02T22:54:46.907 INFO:teuthology.orchestra.run.smithi082.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.51733.log.gz 2024-06-02T22:54:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55854.log 2024-06-02T22:54:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45088.log 2024-06-02T22:54:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55854.log: /var/log/ceph/ceph-client.admin.51279.log: 87.7% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51279.log.gz 2024-06-02T22:54:46.907 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55854.log.gz 2024-06-02T22:54:46.907 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53393.log 2024-06-02T22:54:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44201.log 2024-06-02T22:54:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45088.log: /var/log/ceph/ceph-client.admin.53393.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45088.log.gz 2024-06-02T22:54:46.908 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53393.log.gz 2024-06-02T22:54:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54567.log 2024-06-02T22:54:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53435.log 2024-06-02T22:54:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54567.log: /var/log/ceph/ceph-client.admin.44201.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54567.log.gz 2024-06-02T22:54:46.908 INFO:teuthology.orchestra.run.smithi082.stderr: 90.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56656.log 2024-06-02T22:54:46.908 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44201.log.gz 2024-06-02T22:54:46.908 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53435.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58017.log 2024-06-02T22:54:46.909 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53435.log.gz 2024-06-02T22:54:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53141.log 2024-06-02T22:54:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56656.log: /var/log/ceph/ceph-client.admin.58017.log: 87.9% 87.0% -- replaced with /var/log/ceph/ceph-client.admin.58017.log.gz 2024-06-02T22:54:46.909 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56656.log.gz 2024-06-02T22:54:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2024-06-02T22:54:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49304.log 2024-06-02T22:54:46.909 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53141.log.gz 2024-06-02T22:54:46.909 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52718.log 2024-06-02T22:54:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49304.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2024-06-02T22:54:46.910 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49304.log.gz 2024-06-02T22:54:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56782.log 2024-06-02T22:54:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49159.log 2024-06-02T22:54:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56782.log: /var/log/ceph/ceph-client.admin.52718.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52718.log.gz 2024-06-02T22:54:46.910 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56782.log.gz 2024-06-02T22:54:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57933.log 2024-06-02T22:54:46.910 INFO:teuthology.orchestra.run.smithi082.stderr:gzip/var/log/ceph/ceph-client.admin.49159.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57376.log 2024-06-02T22:54:46.911 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5%/var/log/ceph/ceph-client.admin.57933.log: -- replaced with /var/log/ceph/ceph-client.admin.49159.log.gz 2024-06-02T22:54:46.911 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57933.log.gz 2024-06-02T22:54:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48299.log 2024-06-02T22:54:46.911 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57376.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57376.log.gz 2024-06-02T22:54:46.912 INFO:teuthology.orchestra.run.smithi184.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-06-02T22:54:46.912 INFO:teuthology.orchestra.run.smithi184.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-06-02T22:54:46.919 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53712.log 2024-06-02T22:54:46.919 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51940.log 2024-06-02T22:54:46.919 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48299.log.gz 2024-06-02T22:54:46.919 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44869.log 2024-06-02T22:54:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51940.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53712.log.gz 2024-06-02T22:54:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57207.log 2024-06-02T22:54:46.920 INFO:teuthology.orchestra.run.smithi082.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51940.log.gz 2024-06-02T22:54:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50196.log 2024-06-02T22:54:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57207.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44869.log.gz 2024-06-02T22:54:46.920 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57207.log.gz 2024-06-02T22:54:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50406.log 2024-06-02T22:54:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46903.log 2024-06-02T22:54:46.920 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50196.log: /var/log/ceph/ceph-client.admin.50406.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50196.log.gz 2024-06-02T22:54:46.921 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50406.log.gz 2024-06-02T22:54:46.921 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49688.log 2024-06-02T22:54:46.921 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46612.log 2024-06-02T22:54:46.921 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46903.log: /var/log/ceph/ceph-client.admin.49688.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46903.log.gz 2024-06-02T22:54:46.921 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49688.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53537.log 2024-06-02T22:54:46.921 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-06-02T22:54:46.921 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48688.log 2024-06-02T22:54:46.921 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53537.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46612.log.gz 2024-06-02T22:54:46.922 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53537.log.gz 2024-06-02T22:54:46.922 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52847.log 2024-06-02T22:54:46.922 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48089.log 2024-06-02T22:54:46.922 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48688.log: /var/log/ceph/ceph-client.admin.52847.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48688.log.gz 2024-06-02T22:54:46.922 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52847.log.gz 2024-06-02T22:54:46.922 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43991.log 2024-06-02T22:54:46.922 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48089.log: /var/log/ceph/ceph-client.admin.43991.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48089.log.gz 2024-06-02T22:54:46.922 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43991.log.gz 2024-06-02T22:54:46.923 INFO:teuthology.orchestra.run.smithi082.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-06-02T22:54:47.024 INFO:teuthology.orchestra.run.smithi082.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-06-02T22:54:47.423 INFO:teuthology.orchestra.run.smithi184.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-06-02T22:54:47.456 INFO:teuthology.orchestra.run.smithi184.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-06-02T22:54:47.469 INFO:teuthology.orchestra.run.smithi082.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-06-02T22:54:47.471 INFO:teuthology.orchestra.run.smithi184.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-06-02T22:54:47.490 INFO:teuthology.orchestra.run.smithi082.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-06-02T22:54:47.511 INFO:teuthology.orchestra.run.smithi082.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-06-02T22:54:47.513 INFO:teuthology.orchestra.run.smithi082.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-06-02T22:54:47.515 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-06-02T22:54:47.515 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m0.780s 2024-06-02T22:54:47.515 INFO:teuthology.orchestra.run.smithi082.stderr:user 0m3.265s 2024-06-02T22:54:47.516 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m0.259s 2024-06-02T22:54:47.523 INFO:teuthology.orchestra.run.smithi184.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-06-02T22:54:47.525 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-06-02T22:54:47.525 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m0.766s 2024-06-02T22:54:47.526 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m2.915s 2024-06-02T22:54:47.526 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m0.127s 2024-06-02T22:54:47.526 INFO:tasks.ceph:Archiving logs... 2024-06-02T22:54:47.526 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633/remote/smithi082/log 2024-06-02T22:54:47.527 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T22:54:48.194 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633/remote/smithi184/log 2024-06-02T22:54:48.195 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T22:54:48.624 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-02T22:54:48.633 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-02T22:54:48.634 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T22:54:48.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T22:54:48.718 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-02T22:54:48.727 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-02T22:54:48.728 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T22:54:48.730 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T22:54:48.742 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-06-02T22:54:48.746 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-06-02T22:54:48.747 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T22:54:48.748 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-06-02T22:54:48.748 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 +361us[ +368us] +/- 45ms 2024-06-02T22:54:48.748 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 -978us[ -978us] +/- 79ms 2024-06-02T22:54:48.748 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 +335us[ +335us] +/- 81ms 2024-06-02T22:54:48.748 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:54:48.750 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T22:54:48.750 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-06-02T22:54:48.751 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 +361us[ +375us] +/- 45ms 2024-06-02T22:54:48.751 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -968us[ -954us] +/- 79ms 2024-06-02T22:54:48.751 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +357us[ +357us] +/- 81ms 2024-06-02T22:54:48.751 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:54:48.752 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-02T22:54:48.761 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-02T22:54:48.761 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-02T22:54:48.770 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T22:54:48.860 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T22:54:48.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T22:54:48.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:54:48.956 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T22:54:48.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:54:48.984 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-02T22:54:48.994 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-02T22:54:49.002 INFO:teuthology.task.internal:Duration was 581.274926 seconds 2024-06-02T22:54:49.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-02T22:54:49.018 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-02T22:54:49.018 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T22:54:49.021 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T22:54:49.056 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T22:54:49.063 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T22:54:49.257 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-02T22:54:49.258 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-06-02T22:54:49.258 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T22:54:49.318 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-06-02T22:54:49.318 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T22:54:49.338 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-02T22:54:49.338 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T22:54:49.361 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T22:54:49.404 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-02T22:54:49.405 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T22:54:49.427 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T22:54:49.543 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-02T22:54:49.553 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-02T22:54:49.554 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T22:54:49.578 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T22:54:49.603 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-02T22:54:49.613 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T22:54:49.621 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T22:54:49.642 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-06-02T22:54:49.666 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-06-02T22:54:49.680 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T22:54:49.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:54:49.711 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T22:54:49.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:54:49.734 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-02T22:54:49.747 INFO:teuthology.task.internal:Transferring archived files... 2024-06-02T22:54:49.747 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633/remote/smithi082 2024-06-02T22:54:49.748 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T22:54:49.784 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738633/remote/smithi184 2024-06-02T22:54:49.785 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T22:54:49.817 INFO:teuthology.task.internal:Removing archive directory... 2024-06-02T22:54:49.817 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T22:54:49.822 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T22:54:49.867 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-02T22:54:49.878 INFO:teuthology.task.internal:Not uploading archives. 2024-06-02T22:54:49.878 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-02T22:54:49.888 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-02T22:54:49.888 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T22:54:49.891 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T22:54:49.903 INFO:teuthology.orchestra.run.smithi082.stdout: 266045 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 22:54 /home/ubuntu/cephtest 2024-06-02T22:54:49.922 INFO:teuthology.orchestra.run.smithi184.stdout: 265879 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 22:54 /home/ubuntu/cephtest 2024-06-02T22:54:49.923 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-02T22:54:49.933 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-02T22:54:49.958 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/pool-perm} duration: 581.2749264240265 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7f41f15c1d6a4e8aaa535ac93f8acdf0 status: fail success: false 2024-06-02T22:54:49.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T22:54:50.036 INFO:teuthology.run:FAIL